-- Logs begin at Tue 2022-06-21 07:33:05 UTC, end at Tue 2022-06-21 08:39:09 UTC. -- Jun 21 08:01:17.359523 dv-cinder-836973-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 21 08:01:17.367984 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 08:01:17 2022] *** Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: nodename: dv-cinder-836973-7-iscsi Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: machine: x86_64 Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: clock source: unix Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: pcre jit disabled Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: detected number of CPU cores: 4 Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: current working directory: / Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: detected binary path: /usr/bin/uwsgi-core Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: your processes number limit is 47680 Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: your memory page size is 4096 bytes Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: detected max file descriptor number: 2048 Jun 21 08:01:17.371976 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: lock engine: pthread robust mutexes Jun 21 08:01:17.372703 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: thunder lock: enabled Jun 21 08:01:17.372703 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 21 08:01:17.372703 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 08:01:17.418303 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: Python main interpreter initialized at 0x56079bc0d9c0 Jun 21 08:01:17.418303 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: python threads support enabled Jun 21 08:01:17.418303 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: your server socket listen backlog is limited to 100 connections Jun 21 08:01:17.418303 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: your mercy for graceful operations on workers is 90 seconds Jun 21 08:01:17.418691 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 08:01:17.418761 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: *** Operational MODE: preforking *** Jun 21 08:01:17.419032 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: *** uWSGI is running in multiple interpreter mode *** Jun 21 08:01:17.419032 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: spawned uWSGI master process (pid: 80260) Jun 21 08:01:17.419234 dv-cinder-836973-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 21 08:01:17.420342 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: spawned uWSGI worker 1 (pid: 80269, cores: 1) Jun 21 08:01:17.420342 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: spawned uWSGI worker 2 (pid: 80270, cores: 1) Jun 21 08:01:17.420342 dv-cinder-836973-7-iscsi devstack@keystone.service[80260]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 08:01:22.950061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 08:01:22.950061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: from cryptography.utils import int_from_bytes Jun 21 08:01:22.950861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 08:01:22.950861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: from cryptography.utils import int_from_bytes Jun 21 08:01:22.954058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 08:01:22.954058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: from cryptography.utils import int_from_bytes Jun 21 08:01:22.954505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 08:01:22.954505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: from cryptography.utils import int_from_bytes Jun 21 08:01:22.999778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 08:01:23.000481 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 08:01:23.000684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] command line args: [] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 08:01:23.001106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 08:01:23.001304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ================================================================================ {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 08:01:23.001567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] admin_token = **** {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.001819 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] config_dir = [] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.002012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.002196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] config_source = [] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.002380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] debug = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.002583 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.002976 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.003077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 08:01:23.003174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.003267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 08:01:23.003359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] command line args: [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 08:01:23.003461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.003632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.003740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 08:01:23.003840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ================================================================================ {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 08:01:23.003940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] list_limit = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.004046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] log_config_append = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.004155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] admin_token = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.004250 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.004343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] config_dir = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.004435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] log_dir = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.004539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.004652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] log_file = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.004770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] config_source = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.004864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.004965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] debug = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.005048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.005148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.005225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.005340 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.005419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.005494 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.005641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.005727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.005829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.005902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.006083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.006166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.006284 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] log_config_append = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.006366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.006464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.006561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.006666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] log_dir = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.006826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.006902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] log_file = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.007067 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.007191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.007310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.007420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.007536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.007647 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.007765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.007883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.007997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.008107 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.008227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.008347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.008514 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.008640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.008767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] publish_errors = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.008895 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.009008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.009158 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.009273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.009384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.009490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.009611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.009726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.009836 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.009946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.010056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.010172 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] standard_threads = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.010293 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.010406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.010522 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.010657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.010791 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.010913 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] use_journal = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.011025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] publish_errors = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.011141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] use_json = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.011253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.011414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] use_stderr = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.011529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.011646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] use_syslog = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.011764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.011876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.011989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.012110 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.012223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.012335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.012452 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] standard_threads = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.012563 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.012682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.012799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.012911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.012911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.013125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.013236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] use_journal = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.013353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.013467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] use_json = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.013467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] use_stderr = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.013674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.013790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] use_syslog = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.013907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.014030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 08:01:23.014147 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.014259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.014369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.014481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.014591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.014724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.014836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.014947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.015058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.015174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.015292 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.015411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.015524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.016198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.016325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.016443 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.016563 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.016683 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.016810 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.016810 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.017025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.017136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.017247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.017434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.017434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.017660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.017772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.017888 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.017999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.018118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.018230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.018340 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.018451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.018562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.018706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.018831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.018944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.019061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.019173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.019283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.019399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.019519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.019637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.019750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.019860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.019968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.020079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.020197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.020308 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.020425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.020536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.020646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.020766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.020878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.020989 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.021099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.021209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.021319 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.021437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.021549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.021666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.021778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.021889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.022006 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.022125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.022237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.022348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.022458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.022575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.022699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.022887 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.023009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.023127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.023245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.023363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.023481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.023603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.023716 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.023827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.023939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.024056 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.024168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.024286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.024405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.024516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.024627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.024737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.024848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.024968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.025086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.025203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.025315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.025410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.025504 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.025610 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.025706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.025807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.025907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.026002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.026125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.026231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.026327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.026439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.026551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.026702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.026815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.026939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.027100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.027223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.027337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.027439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.027549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.027668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.027788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.027907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.028028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.028143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.028260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.028260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.028469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.028585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.028698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.028809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.028921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.029045 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.029226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.029361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.029476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.029587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.029699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.029811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.029915 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.030034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.030153 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.030257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.030367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.030479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.030590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.030727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.030832 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.030943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.031054 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.031166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.031318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.031468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.031617 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.031617 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.031904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.032058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.032218 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.032380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.032542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.032659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.032778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.032892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.033012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.033126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.033238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.033358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.033471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.033583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.033703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.033823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.033935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.034048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.034160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.034272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.034462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.034578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.034732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.034845 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.034956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.035079 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.035201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.035323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.035448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.035561 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.035673 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.035790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.035903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.036015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.036135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.036248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.036360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.036473 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.036591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.036710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.036835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.036948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.037066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] auth.external = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.037179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.037291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.037403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.037523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.037645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.037758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.037870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.037982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] auth.password = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.038102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.038215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] auth.token = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.038333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.038452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.038570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.038696 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.038821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.038966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.039089 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.039212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.039326 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.039440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.039553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.039666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.039787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.external = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.039909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.040031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.040145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] credential.caching = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.040264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.040380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.040501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.040614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.040735 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.password = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.040849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.040961 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] auth.token = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.041074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.041194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.041309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.041421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.041533 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.041646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.041760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.041881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.042007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.042193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.042392 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.042523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.042677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.042805 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.042805 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.043021 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.043142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.043257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.043371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.043492 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.043608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.043722 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.043843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.043964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.044080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.044201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] federation.caching = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.044322 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.044437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.044551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.044664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.044777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.044903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.045018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.045131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.045245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.045359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.045472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.045593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.045708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.045820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.045820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.046114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.046114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.046338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.046338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.046556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.046556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.046885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.047009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.047159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.caching = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.047339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.047515 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.047689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.047865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.047865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.047865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.048387 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.048694 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.048845 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.049039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.049229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.049524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.049710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.049710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.049950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.050064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.050189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.050189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.050404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.050517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.050517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.050828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.050956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.051062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.051160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.051273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.051386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.051499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.051624 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.051794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.051975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.052163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.052318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.052443 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.052443 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.052819 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.053012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.053012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.053367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.053554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.053757 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.053938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.053938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.054286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.054482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.054699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.054912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.054912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.055276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.055411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.055527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.055641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.055767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.055767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.055981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.056095 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.056095 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.056307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.056429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.056429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.056643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.056756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.056963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.057079 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.057235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.057354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.057470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.057720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.057892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.058085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.058289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.058289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.058751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.058946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.059139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.059332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.059544 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.059703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.059820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.059934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.060048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.060162 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.060285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.060400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.060515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.060629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.060752 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.060867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.060990 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.061105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.061219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.061333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.061333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.061547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.061670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.061670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.061885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.061998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.061998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.062212 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.062333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.062333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.063061 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.063177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.063297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.063463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.063667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.063860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.064052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.064235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.064410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.064587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.064770 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.064943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.065118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.065238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.065353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.065480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.065596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.065711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.065826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.065940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.066054 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.066175 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.066290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.066404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.066517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.066650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.066650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.066987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.066987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.067282 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.067282 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.067481 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.067595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.067717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.067717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.067932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.068045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.068158 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.068271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.068391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.068506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.068619 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.068735 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.068848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.068848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.069068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.069182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.069295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.069408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.069520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.069633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.069753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.069867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.069979 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.070093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.070205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.070319 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.070439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.070439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.070692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.070692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.070906 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.071018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.071145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.071261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.071373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.071486 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.071598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.071711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.071831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] resource.caching = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.071946 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.072058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.072173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.072286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.072398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.072520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.072635 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.072748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.072861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.072974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.073087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.073208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.073323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.073436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.073548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.073669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.073787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.073908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.074022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.074135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] role.caching = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.074249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.074362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] role.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.074475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.074596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.074740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.074853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.074978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.074978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.074978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.075404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.075522 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.075522 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.075734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.075847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.075847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.076066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.076181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.076293 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.076406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.076519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.076631 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.076752 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.076866 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.076979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] role.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.077091 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.077204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] role.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.077317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.077438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.077552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.077666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.077778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.077892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.078013 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.078128 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.078788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.079270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.079477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.079597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.079756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.079876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.080020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.080137 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.080280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.080398 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.080522 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.080636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.080750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.080862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.081007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.081119 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.081262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.081381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.081517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.081635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.081748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.081861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.081983 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.082193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.082387 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.082578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.082961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.083124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.083257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.083374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.083489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.083603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.083718 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.083833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.083833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.084058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.084172 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.084172 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.084384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.084497 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.084618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.084732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] token.caching = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.084846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.085039 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.085156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.085279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.085540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.085656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.085792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.085995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.086113 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.086260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.086426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.086604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.086807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.086950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] token.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.087065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.087192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.087315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.087430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.087430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.087649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.087762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.087885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.088000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.088113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.088226 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.088339 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.088451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.088615 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.088754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.088874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.089096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.089213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.089326 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.089561 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.089678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.089792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.089968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.090088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.090262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.090387 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.090502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.090820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.090940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.091084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.connection = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.091310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.connection = **** {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.091438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.091561 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.091722 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.091848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.092020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.092137 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.092252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.092482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.092599 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.092760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.092876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.092989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.093172 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.093288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.093402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.093594 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.093734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.094001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.094118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.094356 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.094474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.094762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.094885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.095021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.095140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.095256 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.095492 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.095622 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.095746 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.095860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.095974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 08:01:23.096252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.096633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.097026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.097400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.097785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.098164 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 08:01:23.098432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 08:01:23.128364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.128596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.128832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.137348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.137442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.137585 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.137822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.146965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.166421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.166682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.173174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.173406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.310446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.314755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.360148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.360384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.362060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.362301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.425873 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.426099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.426329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.426554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.426785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.426881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.427018 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.427099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.427242 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.427466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.427687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.427907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.452369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.452495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.452644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.452725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.452828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.452911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.453074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.453225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.453331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.453517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.453791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.453884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.454054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.454279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.464871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.465118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.477638 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.477899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.478124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.478331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.478415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.478557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.478655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.478800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.478882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.479021 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.479102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.479238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.479455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.479670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80270) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 08:01:23.497105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.497318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 08:01:23.497421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.497623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 08:01:23.497718 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.497842 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 08:01:23.497959 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.498116 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.498197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 08:01:23.498379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.498467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.498655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.498739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.498916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.498996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.499172 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.510523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.510826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.511096 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.511176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.511377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.511473 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.511687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.511968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.519896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.520851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.523241 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.523527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.523811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.524095 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.524174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.524385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.524467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.524647 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.524731 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.524917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.525007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.525190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.525273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.525458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.525537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.525723 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.525809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.525988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.526066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.526255 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.526526 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.526818 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.553308 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.554843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.554963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.555247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.556455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.556738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.560570 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.560811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.561208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.562002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.562396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.563229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.568813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.569012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.570578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.571000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.574412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.574412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.574412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.574746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.574935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.575213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.575483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.575565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.575752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.575843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.576085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.576371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.576650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.576926 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.577197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.577465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.595234 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.595510 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.597603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.597881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.600169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.602490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.603817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.604122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.606149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.606552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.609263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.612707 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.613437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.616345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.617134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.617701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.617984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.618266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.618544 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.618850 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.620319 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.620615 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.620903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.621184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.621466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.621744 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.638044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.638331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.638600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.638906 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.641636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.641921 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.642200 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.642474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.646972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.648674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.648951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.650355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.652090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.652170 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.652367 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.652452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.652724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.653018 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.653300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.655587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.655883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.657510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.657817 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.667178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.667465 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.667765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.668049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.668333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.669970 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.670270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.671058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.671342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.671629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.672935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.674585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.674930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.675210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.688843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.692189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.693591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.695552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.696899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.697295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.698975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.699257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.699536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.700211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.701944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.704080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.704368 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.704651 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.707022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.708640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.711914 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.712012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.712207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.712604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.712887 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.713564 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.716794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.717086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.717477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.717754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.722608 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.722918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.723201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.727857 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.728144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.728433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.731090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.731374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.731655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.731928 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.732198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.732573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.732863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.733135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.733407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.733686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.733974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.734238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.734554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.734855 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.736852 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80270) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 08:01:23.737133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.737412 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.737688 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.737962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.738342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.738641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.738920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.739201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.739485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.739764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.740031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.740306 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.740575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80270) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 08:01:23.773295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56079bc0d9c0 pid: 80269 (default app) Jun 21 08:01:23.776689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d22ef-29f7-4014-9fa4-3b6d5a30d447 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:23.776991 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d22ef-29f7-4014-9fa4-3b6d5a30d447 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:23.777271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d22ef-29f7-4014-9fa4-3b6d5a30d447 None None] PATH_INFO: `/v3` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:23.779706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56079bc0d9c0 pid: 80270 (default app) Jun 21 08:01:23.782140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Tue Jun 21 08:01:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:31.458376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a865e-0d98-4804-a5d5-e9138bd61c65 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:31.458979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a865e-0d98-4804-a5d5-e9138bd61c65 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:31.458979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a865e-0d98-4804-a5d5-e9138bd61c65 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:31.463387 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:01:31.469972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37560cdb-50d6-43af-9401-0232d30e1acc None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:31.470394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37560cdb-50d6-43af-9401-0232d30e1acc None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:31.470525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37560cdb-50d6-43af-9401-0232d30e1acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:31.539395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: INFO dbcounter [None req-37560cdb-50d6-43af-9401-0232d30e1acc None None] Registered counter for database keystone Jun 21 08:01:31.560171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG oslo_db.sqlalchemy.engines [None req-37560cdb-50d6-43af-9401-0232d30e1acc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:01:31.567640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writer thread running {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:01:31.748376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG passlib.handlers.bcrypt [None req-37560cdb-50d6-43af-9401-0232d30e1acc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80269) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 08:01:31.748706 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG passlib.handlers.bcrypt [None req-37560cdb-50d6-43af-9401-0232d30e1acc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80269) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 08:01:31.803516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-37560cdb-50d6-43af-9401-0232d30e1acc None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:31.805128 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-37560cdb-50d6-43af-9401-0232d30e1acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:31.929043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 21 08:01:32.089493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a865e-0d98-4804-a5d5-e9138bd61c65 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:32.174566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: INFO dbcounter [None req-3f7a865e-0d98-4804-a5d5-e9138bd61c65 None None] Registered counter for database keystone Jun 21 08:01:32.194139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG oslo_db.sqlalchemy.engines [None req-3f7a865e-0d98-4804-a5d5-e9138bd61c65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 08:01:32.200283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writer thread running {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 08:01:32.319799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a865e-0d98-4804-a5d5-e9138bd61c65 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:32.324018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bb630-f2f3-4515-87c6-8f5b0dfa0354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:32.324676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb630-f2f3-4515-87c6-8f5b0dfa0354 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:32.324955 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb630-f2f3-4515-87c6-8f5b0dfa0354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:32.325230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb630-f2f3-4515-87c6-8f5b0dfa0354 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:32.333739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bb630-f2f3-4515-87c6-8f5b0dfa0354 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:32.386895 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a00bb630-f2f3-4515-87c6-8f5b0dfa0354 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 08:01:32.387186 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bb630-f2f3-4515-87c6-8f5b0dfa0354 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:32.396875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Tue Jun 21 08:01:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 08:01:32.402783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37560cdb-50d6-43af-9401-0232d30e1acc None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:32.417342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37560cdb-50d6-43af-9401-0232d30e1acc None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:32.422571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9d670-8c2a-4d04-be57-c60274cec1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:32.423707 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9d670-8c2a-4d04-be57-c60274cec1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:32.423994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9d670-8c2a-4d04-be57-c60274cec1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:32.424270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9d670-8c2a-4d04-be57-c60274cec1bd admin admin] PATH_INFO: `/v3/projects/48e195a21c654d5fa117864a568a0c62` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:32.428360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9d670-8c2a-4d04-be57-c60274cec1bd admin admin] RBAC: Authorizing `identity:get_project(project_id=48e195a21c654d5fa117864a568a0c62)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:32.479698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0ff9d670-8c2a-4d04-be57-c60274cec1bd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 08:01:32.480231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9d670-8c2a-4d04-be57-c60274cec1bd admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:32.485136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Tue Jun 21 08:01:32 2022] GET /identity/v3/projects/48e195a21c654d5fa117864a568a0c62 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:34.507804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851accc-e02a-4c9b-8127-7f384f1af1dd None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:34.508340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851accc-e02a-4c9b-8127-7f384f1af1dd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:34.508340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851accc-e02a-4c9b-8127-7f384f1af1dd None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:34.512521 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:34.518365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa7bd2-6cc5-4373-b9a0-357c83cf6962 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:34.518813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa7bd2-6cc5-4373-b9a0-357c83cf6962 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:34.518945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa7bd2-6cc5-4373-b9a0-357c83cf6962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:34.537428 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d5aa7bd2-6cc5-4373-b9a0-357c83cf6962 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:34.538984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d5aa7bd2-6cc5-4373-b9a0-357c83cf6962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:34.547495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 08:01:34.571579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851accc-e02a-4c9b-8127-7f384f1af1dd None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:34.583721 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851accc-e02a-4c9b-8127-7f384f1af1dd None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:34.587935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c02fc-75a0-4720-b4ef-ec93b0a9620a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:34.588566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c02fc-75a0-4720-b4ef-ec93b0a9620a admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:34.588853 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c02fc-75a0-4720-b4ef-ec93b0a9620a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:34.589132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c02fc-75a0-4720-b4ef-ec93b0a9620a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:34.597256 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c02fc-75a0-4720-b4ef-ec93b0a9620a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:34.599081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c02fc-75a0-4720-b4ef-ec93b0a9620a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:34.607803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Tue Jun 21 08:01:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 08:01:34.613870 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa7bd2-6cc5-4373-b9a0-357c83cf6962 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:34.623144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa7bd2-6cc5-4373-b9a0-357c83cf6962 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:34.628112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc7a60-dfd3-4704-ab87-b28e9ece6685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:34.628958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc7a60-dfd3-4704-ab87-b28e9ece6685 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:34.629238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc7a60-dfd3-4704-ab87-b28e9ece6685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:34.629510 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc7a60-dfd3-4704-ab87-b28e9ece6685 admin admin] PATH_INFO: `/v3/users/5f407cfabb074543a5e85c709d5e3a86` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:34.630981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc7a60-dfd3-4704-ab87-b28e9ece6685 admin admin] RBAC: Authorizing `identity:get_user(user_id=5f407cfabb074543a5e85c709d5e3a86)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:34.632782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc7a60-dfd3-4704-ab87-b28e9ece6685 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:34.634333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Tue Jun 21 08:01:34 2022] GET /identity/v3/users/5f407cfabb074543a5e85c709d5e3a86 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:01:36.710554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8818e59-541e-4e58-9836-e72379702324 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:36.711109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8818e59-541e-4e58-9836-e72379702324 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:36.711213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8818e59-541e-4e58-9836-e72379702324 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:36.712691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:36.717590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6dd2c-cfdd-4f54-9c1c-13cc09106a3a None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:36.718658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6dd2c-cfdd-4f54-9c1c-13cc09106a3a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:36.718658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6dd2c-cfdd-4f54-9c1c-13cc09106a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:36.735177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-b1d6dd2c-cfdd-4f54-9c1c-13cc09106a3a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:36.736375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b1d6dd2c-cfdd-4f54-9c1c-13cc09106a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:36.815620 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976b9cc-3a56-4089-bbe4-50c720be0fbd None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:36.815905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976b9cc-3a56-4089-bbe4-50c720be0fbd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:36.816214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976b9cc-3a56-4089-bbe4-50c720be0fbd None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:36.817707 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:01:36.818194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:36.822650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f375af1-a045-4c09-94f6-fbf8c266c6a4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:36.822889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f375af1-a045-4c09-94f6-fbf8c266c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:36.823168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f375af1-a045-4c09-94f6-fbf8c266c6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:36.841849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6dd2c-cfdd-4f54-9c1c-13cc09106a3a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:36.863082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG passlib.handlers.bcrypt [None req-9f375af1-a045-4c09-94f6-fbf8c266c6a4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80270) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 08:01:36.863520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG passlib.handlers.bcrypt [None req-9f375af1-a045-4c09-94f6-fbf8c266c6a4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80270) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 08:01:36.866039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:36.909664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9f375af1-a045-4c09-94f6-fbf8c266c6a4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:36.911291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9f375af1-a045-4c09-94f6-fbf8c266c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:36.945025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6dd2c-cfdd-4f54-9c1c-13cc09106a3a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:36.978140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236b3c1-ccb1-4de6-83cf-37325e6cd843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:36.978958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236b3c1-ccb1-4de6-83cf-37325e6cd843 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:36.979241 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236b3c1-ccb1-4de6-83cf-37325e6cd843 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:36.979512 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236b3c1-ccb1-4de6-83cf-37325e6cd843 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:36.991021 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236b3c1-ccb1-4de6-83cf-37325e6cd843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-4236b3c1-ccb1-4de6-83cf-37325e6cd843 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:37.002448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:37.003523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:01:37.004337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 7/13] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:01:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:01:37.010796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236b3c1-ccb1-4de6-83cf-37325e6cd843 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:37.011707 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 7/14] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:01:37.034877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f375af1-a045-4c09-94f6-fbf8c266c6a4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:37.091807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:37.112360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236b3c1-ccb1-4de6-83cf-37325e6cd843 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:37.135658 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f375af1-a045-4c09-94f6-fbf8c266c6a4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:37.137952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:37.152122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d21ad8-2862-4280-aa40-4453409b095b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:37.152839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d21ad8-2862-4280-aa40-4453409b095b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:37.153122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d21ad8-2862-4280-aa40-4453409b095b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:37.153406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d21ad8-2862-4280-aa40-4453409b095b None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:37.154156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d21ad8-2862-4280-aa40-4453409b095b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:37.154473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d21ad8-2862-4280-aa40-4453409b095b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:37.155956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d21ad8-2862-4280-aa40-4453409b095b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:37.167627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:01:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:01:37.173289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d21ad8-2862-4280-aa40-4453409b095b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:37.188388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1d70e-e6c0-4652-9ad9-1d3b1084724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:37.189308 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1d70e-e6c0-4652-9ad9-1d3b1084724a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:37.189596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1d70e-e6c0-4652-9ad9-1d3b1084724a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:37.189871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1d70e-e6c0-4652-9ad9-1d3b1084724a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:37.260420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1d70e-e6c0-4652-9ad9-1d3b1084724a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:37.261960 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1d70e-e6c0-4652-9ad9-1d3b1084724a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:37.290466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d21ad8-2862-4280-aa40-4453409b095b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:37.324081 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc11be-4818-4bc7-ad9f-c3152648e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:37.324951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc11be-4818-4bc7-ad9f-c3152648e040 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:37.325242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc11be-4818-4bc7-ad9f-c3152648e040 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:37.325522 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc11be-4818-4bc7-ad9f-c3152648e040 None admin] PATH_INFO: `/v3/users/5f407cfabb074543a5e85c709d5e3a86` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:37.326774 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc11be-4818-4bc7-ad9f-c3152648e040 None admin] RBAC: Authorizing `identity:get_user(user_id=5f407cfabb074543a5e85c709d5e3a86)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:37.328981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc11be-4818-4bc7-ad9f-c3152648e040 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:37.330870 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 9/16] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:01:37 2022] GET /identity/v3/users/5f407cfabb074543a5e85c709d5e3a86 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:01:37.336285 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc11be-4818-4bc7-ad9f-c3152648e040 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:37.355113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:37.371916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 8/17] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 08:01:37.378215 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1d70e-e6c0-4652-9ad9-1d3b1084724a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:37.380952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:37.457666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc11be-4818-4bc7-ad9f-c3152648e040 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:37.490593 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1d70e-e6c0-4652-9ad9-1d3b1084724a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:37.492528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63550d2c-7bbb-423c-ab91-4d61cda3e246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:37.493329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63550d2c-7bbb-423c-ab91-4d61cda3e246 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:37.493612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63550d2c-7bbb-423c-ab91-4d61cda3e246 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:37.493887 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63550d2c-7bbb-423c-ab91-4d61cda3e246 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:37.495118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63550d2c-7bbb-423c-ab91-4d61cda3e246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:37.496560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63550d2c-7bbb-423c-ab91-4d61cda3e246 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:37.498294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 10/18] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:01:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:01:37.504559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63550d2c-7bbb-423c-ab91-4d61cda3e246 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:37.526219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3592531-9902-4de2-be59-f73139b901c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:37.527041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592531-9902-4de2-be59-f73139b901c0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:37.527323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592531-9902-4de2-be59-f73139b901c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:37.527597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592531-9902-4de2-be59-f73139b901c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:37.547526 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3592531-9902-4de2-be59-f73139b901c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:37.549016 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3592531-9902-4de2-be59-f73139b901c0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-d3592531-9902-4de2-be59-f73139b901c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:01:37.569064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:37.569832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:37.570690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:01:37.570690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:01:37.570690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:01:37.570690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:01:37.570690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 9/19] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:01:37.576053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3592531-9902-4de2-be59-f73139b901c0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:37.588261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:37.632803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:37.640053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63550d2c-7bbb-423c-ab91-4d61cda3e246 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:37.678246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3592531-9902-4de2-be59-f73139b901c0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:37.678947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52063533-3a6b-445c-9301-5a4cae949735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:37.679607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52063533-3a6b-445c-9301-5a4cae949735 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:37.679893 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52063533-3a6b-445c-9301-5a4cae949735 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:37.680167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52063533-3a6b-445c-9301-5a4cae949735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:37.681010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52063533-3a6b-445c-9301-5a4cae949735 None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.domain.id=default, user.id=5f407cfabb074543a5e85c709d5e3a86) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:37.681318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52063533-3a6b-445c-9301-5a4cae949735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:37.682789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52063533-3a6b-445c-9301-5a4cae949735 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:37.690286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 11/20] 10.222.0.36 () {56 vars in 1322 bytes} [Tue Jun 21 08:01:37 2022] GET /identity/v3/role_assignments?user.id=5f407cfabb074543a5e85c709d5e3a86&scope.domain.id=default&role.id=6fcc322b483a475399974562c1e5bd43 => generated 233 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:01:37.713344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa410a-a764-4f3f-a6b2-b875e72dc8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:37.714122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa410a-a764-4f3f-a6b2-b875e72dc8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:37.714352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa410a-a764-4f3f-a6b2-b875e72dc8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:37.714565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa410a-a764-4f3f-a6b2-b875e72dc8a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:37.715347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa410a-a764-4f3f-a6b2-b875e72dc8a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:37.715653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa410a-a764-4f3f-a6b2-b875e72dc8a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:37.717120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa410a-a764-4f3f-a6b2-b875e72dc8a2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:37.743906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 10/21] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:01:40.303003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4158f3-72a7-4fed-9a78-9d913293d6fc None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:40.304298 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4158f3-72a7-4fed-9a78-9d913293d6fc None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:40.305206 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4158f3-72a7-4fed-9a78-9d913293d6fc None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:40.307550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 12/22] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:40.314315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bdb22-d714-45a4-9cb6-fd84960c0b46 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:40.314830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bdb22-d714-45a4-9cb6-fd84960c0b46 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:40.314903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bdb22-d714-45a4-9cb6-fd84960c0b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:40.347756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1b4bdb22-d714-45a4-9cb6-fd84960c0b46 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:40.349018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1b4bdb22-d714-45a4-9cb6-fd84960c0b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:40.448996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 11/23] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:01:40.502698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0c520-0264-418e-8da8-9958a78624bb None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:40.503429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0c520-0264-418e-8da8-9958a78624bb None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:40.503929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0c520-0264-418e-8da8-9958a78624bb None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:40.505832 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:40.512676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8445-a5ef-4045-82f4-650eb6ee3ddb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:40.512997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8445-a5ef-4045-82f4-650eb6ee3ddb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:40.513307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8445-a5ef-4045-82f4-650eb6ee3ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:40.514839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0c520-0264-418e-8da8-9958a78624bb None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:40.538988 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-406a8445-a5ef-4045-82f4-650eb6ee3ddb None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:40.540238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-406a8445-a5ef-4045-82f4-650eb6ee3ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:40.640649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:40.688256 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 12/25] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:01:40.737366 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a8445-a5ef-4045-82f4-650eb6ee3ddb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:40.740462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0c520-0264-418e-8da8-9958a78624bb None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:40.844875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb1c19-590c-4c7e-aaf3-b5560857d3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:40.845611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb1c19-590c-4c7e-aaf3-b5560857d3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:40.845907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb1c19-590c-4c7e-aaf3-b5560857d3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:40.846188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb1c19-590c-4c7e-aaf3-b5560857d3d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:40.875586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb1c19-590c-4c7e-aaf3-b5560857d3d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-99bb1c19-590c-4c7e-aaf3-b5560857d3d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:40.891763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:40.892643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:01:40.893378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 14/26] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:01:40.899001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb1c19-590c-4c7e-aaf3-b5560857d3d7 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:40.914967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:40.964635 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a8445-a5ef-4045-82f4-650eb6ee3ddb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:41.032427 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb1c19-590c-4c7e-aaf3-b5560857d3d7 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:41.072217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b6ee9-1756-41ed-a2ea-b61e729f9872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:41.073291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b6ee9-1756-41ed-a2ea-b61e729f9872 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:41.073761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b6ee9-1756-41ed-a2ea-b61e729f9872 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:41.074185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b6ee9-1756-41ed-a2ea-b61e729f9872 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:41.075271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b6ee9-1756-41ed-a2ea-b61e729f9872 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:41.075751 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b6ee9-1756-41ed-a2ea-b61e729f9872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:41.077561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b6ee9-1756-41ed-a2ea-b61e729f9872 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:41.086864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 15/27] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:01:41.087642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d444e-13b8-4634-92eb-95da60444d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:41.088447 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d444e-13b8-4634-92eb-95da60444d8f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:41.088738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d444e-13b8-4634-92eb-95da60444d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:41.089010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d444e-13b8-4634-92eb-95da60444d8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:41.089489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe645b8-67a8-4b4b-8b7b-e183872d207c None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:41.090036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe645b8-67a8-4b4b-8b7b-e183872d207c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:41.090505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe645b8-67a8-4b4b-8b7b-e183872d207c None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:41.092062 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 16/28] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:41.095452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe645b8-67a8-4b4b-8b7b-e183872d207c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:41.124021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d444e-13b8-4634-92eb-95da60444d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:41.125537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d444e-13b8-4634-92eb-95da60444d8f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:41.175076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-8e3d444e-13b8-4634-92eb-95da60444d8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:01:41.179413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:41.180228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:41.181015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:01:41.181015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:01:41.181015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:01:41.181015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:01:41.181015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 13/29] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:01:41.181694 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12941357-7597-4845-b861-296199a585c9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:41.181980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12941357-7597-4845-b861-296199a585c9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:41.182301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12941357-7597-4845-b861-296199a585c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:41.218928 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe645b8-67a8-4b4b-8b7b-e183872d207c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:41.225087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-12941357-7597-4845-b861-296199a585c9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:41.226286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-12941357-7597-4845-b861-296199a585c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:41.261231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a1035-5967-44c3-9b83-8e79057e8153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:41.263351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a1035-5967-44c3-9b83-8e79057e8153 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:41.263846 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a1035-5967-44c3-9b83-8e79057e8153 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:41.265251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:41.265494 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a1035-5967-44c3-9b83-8e79057e8153 None admin] PATH_INFO: `/v3/users/5f407cfabb074543a5e85c709d5e3a86` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:41.268414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a1035-5967-44c3-9b83-8e79057e8153 None admin] RBAC: Authorizing `identity:get_user(user_id=5f407cfabb074543a5e85c709d5e3a86)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:41.270995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a1035-5967-44c3-9b83-8e79057e8153 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:41.274490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 17/30] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:01:41 2022] GET /identity/v3/users/5f407cfabb074543a5e85c709d5e3a86 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:41.275532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a1035-5967-44c3-9b83-8e79057e8153 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:41.322380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 14/31] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:41.323787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64132f2-b66c-406d-8128-9bc24383b21a None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:41.324124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64132f2-b66c-406d-8128-9bc24383b21a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:41.324402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64132f2-b66c-406d-8128-9bc24383b21a None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:41.326502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 15/32] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:41.327276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64132f2-b66c-406d-8128-9bc24383b21a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:41.421606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a1035-5967-44c3-9b83-8e79057e8153 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:41.453082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64132f2-b66c-406d-8128-9bc24383b21a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:41.470712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af9dc-3204-4198-8ab2-8f99b7ccc901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:41.471390 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af9dc-3204-4198-8ab2-8f99b7ccc901 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:41.471680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af9dc-3204-4198-8ab2-8f99b7ccc901 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:41.471961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af9dc-3204-4198-8ab2-8f99b7ccc901 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:41.472971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af9dc-3204-4198-8ab2-8f99b7ccc901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:41.473282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af9dc-3204-4198-8ab2-8f99b7ccc901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:41.475164 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af9dc-3204-4198-8ab2-8f99b7ccc901 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:41.477091 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:41.494379 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c02b-98fa-436e-a782-204d9e50608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:41.495577 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c02b-98fa-436e-a782-204d9e50608d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:41.496119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c02b-98fa-436e-a782-204d9e50608d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:41.496642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c02b-98fa-436e-a782-204d9e50608d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:41.498385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c02b-98fa-436e-a782-204d9e50608d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:41.500719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 18/33] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:41.501323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c02b-98fa-436e-a782-204d9e50608d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:41.504093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 16/34] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:01:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:41.505059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c02b-98fa-436e-a782-204d9e50608d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:41.506675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492c362-95bd-4589-92fa-ba6782dfab79 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:41.507005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492c362-95bd-4589-92fa-ba6782dfab79 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:41.507347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492c362-95bd-4589-92fa-ba6782dfab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:41.530216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-3492c362-95bd-4589-92fa-ba6782dfab79 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:41.532333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-3492c362-95bd-4589-92fa-ba6782dfab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:41.541913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:41.633619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 19/35] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:41.634853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492c362-95bd-4589-92fa-ba6782dfab79 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:41.668374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c02b-98fa-436e-a782-204d9e50608d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:41.705535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f782b9-6480-4a8d-86c2-20c9fdc1f4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:41.706520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f782b9-6480-4a8d-86c2-20c9fdc1f4b8 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:41.707087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f782b9-6480-4a8d-86c2-20c9fdc1f4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:41.707592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f782b9-6480-4a8d-86c2-20c9fdc1f4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:41.708531 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f782b9-6480-4a8d-86c2-20c9fdc1f4b8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:41.710197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f782b9-6480-4a8d-86c2-20c9fdc1f4b8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:41.763039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492c362-95bd-4589-92fa-ba6782dfab79 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:41.794117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:41.805744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8cbd0-a7f9-4365-82d2-1a038cf9d5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:41.806402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8cbd0-a7f9-4365-82d2-1a038cf9d5cf None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:41.806738 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8cbd0-a7f9-4365-82d2-1a038cf9d5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:41.807114 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8cbd0-a7f9-4365-82d2-1a038cf9d5cf None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:41.807827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8cbd0-a7f9-4365-82d2-1a038cf9d5cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:41.809274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8cbd0-a7f9-4365-82d2-1a038cf9d5cf None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:41.835844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 17/36] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 21 08:01:41 2022] POST /identity/v3/roles => generated 225 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:01:41.836822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f782b9-6480-4a8d-86c2-20c9fdc1f4b8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:41.944258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:41.962772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 20/37] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:01:41 2022] POST /identity/v3/projects => generated 301 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:01:41.963378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8cbd0-a7f9-4365-82d2-1a038cf9d5cf None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:41.965612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f782b9-6480-4a8d-86c2-20c9fdc1f4b8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:42.013180 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e8b8f-998e-45b7-a3e2-f0c4a8a7bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:42.015991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e8b8f-998e-45b7-a3e2-f0c4a8a7bb71 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:42.015991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e8b8f-998e-45b7-a3e2-f0c4a8a7bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:42.015991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e8b8f-998e-45b7-a3e2-f0c4a8a7bb71 None admin] PATH_INFO: `/v3/domains/default/users/5f407cfabb074543a5e85c709d5e3a86/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:42.019037 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e8b8f-998e-45b7-a3e2-f0c4a8a7bb71 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5f407cfabb074543a5e85c709d5e3a86, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:42.020872 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e8b8f-998e-45b7-a3e2-f0c4a8a7bb71 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:42.047505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 18/38] 10.222.0.36 () {58 vars in 1361 bytes} [Tue Jun 21 08:01:41 2022] PUT /identity/v3/domains/default/users/5f407cfabb074543a5e85c709d5e3a86/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:01:42.049073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676e001-26b7-4d9d-adb6-938d2eeb6742 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:42.049375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676e001-26b7-4d9d-adb6-938d2eeb6742 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:42.049659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676e001-26b7-4d9d-adb6-938d2eeb6742 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:42.051062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 19/39] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:42.053458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3ca1a-4e82-4959-a65b-1aea65ff80b9 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:42.054602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3ca1a-4e82-4959-a65b-1aea65ff80b9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:42.054602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3ca1a-4e82-4959-a65b-1aea65ff80b9 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:42.055412 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 20/40] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:42.056717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034d782-25db-44c8-8f88-3091359458ad None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:42.057002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034d782-25db-44c8-8f88-3091359458ad None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:42.057286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034d782-25db-44c8-8f88-3091359458ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:42.092049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5034d782-25db-44c8-8f88-3091359458ad None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:42.094688 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5034d782-25db-44c8-8f88-3091359458ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:42.120239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8cbd0-a7f9-4365-82d2-1a038cf9d5cf None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:42.167781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d279e-3bc1-4c58-80e9-fc958bfc2c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:42.168537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d279e-3bc1-4c58-80e9-fc958bfc2c50 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:42.168878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d279e-3bc1-4c58-80e9-fc958bfc2c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:42.169171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d279e-3bc1-4c58-80e9-fc958bfc2c50 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:42.169948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d279e-3bc1-4c58-80e9-fc958bfc2c50 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:42.173210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d279e-3bc1-4c58-80e9-fc958bfc2c50 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:42.193193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 21 08:01:41 2022] POST /identity/v3/roles => generated 219 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:01:42.194669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38288e-b77e-4fb0-8237-c8d727e95393 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:42.195072 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38288e-b77e-4fb0-8237-c8d727e95393 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:42.195173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38288e-b77e-4fb0-8237-c8d727e95393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:42.216183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 21/42] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:01:42.244210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034d782-25db-44c8-8f88-3091359458ad None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:42.327226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-1d38288e-b77e-4fb0-8237-c8d727e95393 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:42.328913 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1d38288e-b77e-4fb0-8237-c8d727e95393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:42.355019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:42.366006 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:42.385112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034d782-25db-44c8-8f88-3091359458ad None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:42.420435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 22/43] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:42.428242 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2963b-1167-4214-8f00-e00232c64289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:42.428971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2963b-1167-4214-8f00-e00232c64289 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:42.429262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2963b-1167-4214-8f00-e00232c64289 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:42.429636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2963b-1167-4214-8f00-e00232c64289 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:42.430417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2963b-1167-4214-8f00-e00232c64289 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:42.431924 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2963b-1167-4214-8f00-e00232c64289 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:42.445707 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38288e-b77e-4fb0-8237-c8d727e95393 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:42.447325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 21 08:01:42 2022] POST /identity/v3/roles => generated 223 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:01:42.576416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38288e-b77e-4fb0-8237-c8d727e95393 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:42.615447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41f4cd-9dd6-4b02-be52-78014cf0b794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:42.616244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41f4cd-9dd6-4b02-be52-78014cf0b794 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:42.616785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41f4cd-9dd6-4b02-be52-78014cf0b794 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:42.617064 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41f4cd-9dd6-4b02-be52-78014cf0b794 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:42.618256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41f4cd-9dd6-4b02-be52-78014cf0b794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:42.619766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41f4cd-9dd6-4b02-be52-78014cf0b794 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:42.621401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 23/45] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:01:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:42.626926 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2963b-1167-4214-8f00-e00232c64289 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:42.735462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2963b-1167-4214-8f00-e00232c64289 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:42.768842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88779d-fb4d-4917-95cd-cef0a92ea3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:42.769506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88779d-fb4d-4917-95cd-cef0a92ea3c5 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:42.769795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88779d-fb4d-4917-95cd-cef0a92ea3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:42.770074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88779d-fb4d-4917-95cd-cef0a92ea3c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:42.770825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88779d-fb4d-4917-95cd-cef0a92ea3c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:42.772288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88779d-fb4d-4917-95cd-cef0a92ea3c5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:42.776780 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:42.800750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:01:42 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:01:44.156648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785718d-0f33-4893-bfeb-38df2c614071 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:44.157199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785718d-0f33-4893-bfeb-38df2c614071 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:44.157199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785718d-0f33-4893-bfeb-38df2c614071 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:44.158584 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 24/47] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:44.163725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837819e-3fd4-429b-8066-7b07824ad5e6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:44.164121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837819e-3fd4-429b-8066-7b07824ad5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:44.164284 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837819e-3fd4-429b-8066-7b07824ad5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:44.182939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2837819e-3fd4-429b-8066-7b07824ad5e6 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:44.184150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2837819e-3fd4-429b-8066-7b07824ad5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:44.252654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 24/48] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:44.276614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785718d-0f33-4893-bfeb-38df2c614071 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:44.311950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:44.379640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785718d-0f33-4893-bfeb-38df2c614071 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:44.414589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb03b4-80cf-4ae0-a49e-6f0a4d4b081b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:44.415325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb03b4-80cf-4ae0-a49e-6f0a4d4b081b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:44.415607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb03b4-80cf-4ae0-a49e-6f0a4d4b081b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:44.415881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb03b4-80cf-4ae0-a49e-6f0a4d4b081b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:44.425958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb03b4-80cf-4ae0-a49e-6f0a4d4b081b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-3efb03b4-80cf-4ae0-a49e-6f0a4d4b081b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:44.433461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:44.434349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:01:44.435284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 25/49] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:01:44.440435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837819e-3fd4-429b-8066-7b07824ad5e6 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:44.540062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837819e-3fd4-429b-8066-7b07824ad5e6 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:44.556917 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:44.578288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea72cac-811a-44ff-ae3f-6813f2e4bec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:44.578994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea72cac-811a-44ff-ae3f-6813f2e4bec2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:44.579287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea72cac-811a-44ff-ae3f-6813f2e4bec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:44.579572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea72cac-811a-44ff-ae3f-6813f2e4bec2 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:44.580333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea72cac-811a-44ff-ae3f-6813f2e4bec2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:44.580651 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea72cac-811a-44ff-ae3f-6813f2e4bec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:44.582077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea72cac-811a-44ff-ae3f-6813f2e4bec2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:44.595040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 25/50] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:01:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:44.600659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb03b4-80cf-4ae0-a49e-6f0a4d4b081b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:44.694904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:44.701975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb03b4-80cf-4ae0-a49e-6f0a4d4b081b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:44.735166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3366b-2954-4453-a6e2-5357ecea6a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:44.736030 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3366b-2954-4453-a6e2-5357ecea6a05 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:44.736312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3366b-2954-4453-a6e2-5357ecea6a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:44.736588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3366b-2954-4453-a6e2-5357ecea6a05 None admin] PATH_INFO: `/v3/users/5f407cfabb074543a5e85c709d5e3a86` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:44.737773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3366b-2954-4453-a6e2-5357ecea6a05 None admin] RBAC: Authorizing `identity:get_user(user_id=5f407cfabb074543a5e85c709d5e3a86)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:44.739253 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3366b-2954-4453-a6e2-5357ecea6a05 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:44.740883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 26/51] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:01:44 2022] GET /identity/v3/users/5f407cfabb074543a5e85c709d5e3a86 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:44.746514 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea72cac-811a-44ff-ae3f-6813f2e4bec2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:44.846889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857009-82d2-4b33-a071-b0f612917a3c None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:44.847179 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857009-82d2-4b33-a071-b0f612917a3c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:44.847458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857009-82d2-4b33-a071-b0f612917a3c None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:44.848844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 27/52] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:01:44.854374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2a026-62a5-428e-a32b-2393cdb7e49b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:44.854687 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2a026-62a5-428e-a32b-2393cdb7e49b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:44.854972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2a026-62a5-428e-a32b-2393cdb7e49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:44.872933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-b5b2a026-62a5-428e-a32b-2393cdb7e49b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:44.874658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b5b2a026-62a5-428e-a32b-2393cdb7e49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:44.942654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 28/53] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:01:44.953984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea72cac-811a-44ff-ae3f-6813f2e4bec2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:44.964891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2a026-62a5-428e-a32b-2393cdb7e49b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:44.987936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95543f4-c2e1-4592-8132-85d3e429ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:44.988752 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95543f4-c2e1-4592-8132-85d3e429ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:44.989040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95543f4-c2e1-4592-8132-85d3e429ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:44.989325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95543f4-c2e1-4592-8132-85d3e429ecc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:44.990509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95543f4-c2e1-4592-8132-85d3e429ecc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:44.992261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95543f4-c2e1-4592-8132-85d3e429ecc8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:44.993900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 26/54] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:01:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:45.000132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95543f4-c2e1-4592-8132-85d3e429ecc8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:45.048436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:45.060621 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:45.070063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2a026-62a5-428e-a32b-2393cdb7e49b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:45.098754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95543f4-c2e1-4592-8132-85d3e429ecc8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:45.103955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da398103-7db2-473d-ba1f-bcde48ce91af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:45.104740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da398103-7db2-473d-ba1f-bcde48ce91af None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:45.105032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da398103-7db2-473d-ba1f-bcde48ce91af None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:45.105291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da398103-7db2-473d-ba1f-bcde48ce91af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:45.106451 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da398103-7db2-473d-ba1f-bcde48ce91af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:45.108012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da398103-7db2-473d-ba1f-bcde48ce91af None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:45.109639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 29/55] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:01:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:01:45.115083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da398103-7db2-473d-ba1f-bcde48ce91af None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:45.133360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625c12c-64f6-426a-a22a-4e4843956e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:45.134040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625c12c-64f6-426a-a22a-4e4843956e38 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:45.134325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625c12c-64f6-426a-a22a-4e4843956e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:45.134598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625c12c-64f6-426a-a22a-4e4843956e38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:45.135462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625c12c-64f6-426a-a22a-4e4843956e38 None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.domain.id=default, user.id=5f407cfabb074543a5e85c709d5e3a86) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:45.135780 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625c12c-64f6-426a-a22a-4e4843956e38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:45.137218 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625c12c-64f6-426a-a22a-4e4843956e38 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:45.146557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 27/56] 10.222.0.36 () {56 vars in 1322 bytes} [Tue Jun 21 08:01:44 2022] GET /identity/v3/role_assignments?user.id=5f407cfabb074543a5e85c709d5e3a86&scope.domain.id=default&role.id=6fcc322b483a475399974562c1e5bd43 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:01:45.229875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da398103-7db2-473d-ba1f-bcde48ce91af None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:45.267224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e28246-a1ff-4d74-85a0-cf4e0493da8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:45.267922 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e28246-a1ff-4d74-85a0-cf4e0493da8d None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:45.268193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e28246-a1ff-4d74-85a0-cf4e0493da8d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:45.268476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e28246-a1ff-4d74-85a0-cf4e0493da8d None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:45.269211 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e28246-a1ff-4d74-85a0-cf4e0493da8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:45.270722 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e28246-a1ff-4d74-85a0-cf4e0493da8d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:45.297673 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 30/57] 10.222.0.36 () {60 vars in 1140 bytes} [Tue Jun 21 08:01:45 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:01:47.342522 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776738-a314-4a2e-a870-9c764a3813ae None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:47.343095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776738-a314-4a2e-a870-9c764a3813ae None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:47.343095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776738-a314-4a2e-a870-9c764a3813ae None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:47.344479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 28/58] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:47.349561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bd8ba-39df-470f-9102-4f2a28156319 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:47.349925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bd8ba-39df-470f-9102-4f2a28156319 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:47.350133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bd8ba-39df-470f-9102-4f2a28156319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:47.367383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-cc0bd8ba-39df-470f-9102-4f2a28156319 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:47.368590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-cc0bd8ba-39df-470f-9102-4f2a28156319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:47.376351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:47.437648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 31/59] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:47.461601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776738-a314-4a2e-a870-9c764a3813ae None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:47.563633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776738-a314-4a2e-a870-9c764a3813ae None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:47.577226 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:47.598641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234f340-e0da-4971-bdf1-5771f2df8ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:47.599390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234f340-e0da-4971-bdf1-5771f2df8ebd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:47.599680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234f340-e0da-4971-bdf1-5771f2df8ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:47.599961 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234f340-e0da-4971-bdf1-5771f2df8ebd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:47.601133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234f340-e0da-4971-bdf1-5771f2df8ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:47.602598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234f340-e0da-4971-bdf1-5771f2df8ebd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:47.604248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 29/60] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:01:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:47.610643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bd8ba-39df-470f-9102-4f2a28156319 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:47.705697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bd8ba-39df-470f-9102-4f2a28156319 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:47.738513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecb681-090e-48bb-9023-259a81703664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:47.739187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecb681-090e-48bb-9023-259a81703664 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:47.739470 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecb681-090e-48bb-9023-259a81703664 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:47.739743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecb681-090e-48bb-9023-259a81703664 None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:47.740711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecb681-090e-48bb-9023-259a81703664 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:47.742406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecb681-090e-48bb-9023-259a81703664 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:47.762189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:47.770165 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 32/61] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:01:47 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:01:50.894539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66df89-c77f-45f6-b271-c79b596f9c60 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:50.895581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66df89-c77f-45f6-b271-c79b596f9c60 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:50.896063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66df89-c77f-45f6-b271-c79b596f9c60 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:50.897625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 30/62] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:50.903075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68579298-d5e2-4d17-b6d3-1335f4c426ad None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:50.903470 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68579298-d5e2-4d17-b6d3-1335f4c426ad None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:50.903633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68579298-d5e2-4d17-b6d3-1335f4c426ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:50.920458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac512bc-a921-4bad-9122-94b5a29f9023 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:50.921329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac512bc-a921-4bad-9122-94b5a29f9023 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:50.921631 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac512bc-a921-4bad-9122-94b5a29f9023 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:50.923122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:01:50.928604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c645b-e909-4536-a008-0384d133962d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:50.928897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c645b-e909-4536-a008-0384d133962d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:50.929180 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c645b-e909-4536-a008-0384d133962d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:50.933402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-68579298-d5e2-4d17-b6d3-1335f4c426ad None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:50.936824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-68579298-d5e2-4d17-b6d3-1335f4c426ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:50.956153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-299c645b-e909-4536-a008-0384d133962d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:50.957372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-299c645b-e909-4536-a008-0384d133962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:51.040970 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 32/64] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:01:51.043407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 33/65] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:51.064176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c645b-e909-4536-a008-0384d133962d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:51.076762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68579298-d5e2-4d17-b6d3-1335f4c426ad None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:51.178793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c645b-e909-4536-a008-0384d133962d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:51.187843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:51.230275 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5af48-bcce-42c7-ad5a-8699224ce483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:51.231098 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5af48-bcce-42c7-ad5a-8699224ce483 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:51.231384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5af48-bcce-42c7-ad5a-8699224ce483 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:51.231658 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5af48-bcce-42c7-ad5a-8699224ce483 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:51.261843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5af48-bcce-42c7-ad5a-8699224ce483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-80a5af48-bcce-42c7-ad5a-8699224ce483 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:51.280999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:51.281904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:01:51.282698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 33/66] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:01:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:01:51.292022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5af48-bcce-42c7-ad5a-8699224ce483 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:51.318174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68579298-d5e2-4d17-b6d3-1335f4c426ad None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:51.351028 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:51.356769 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1e811-e6ad-4430-8807-5212a4963646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:51.358341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1e811-e6ad-4430-8807-5212a4963646 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:51.358648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1e811-e6ad-4430-8807-5212a4963646 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:51.359110 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1e811-e6ad-4430-8807-5212a4963646 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:51.373294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1e811-e6ad-4430-8807-5212a4963646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-c0c1e811-e6ad-4430-8807-5212a4963646 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:51.384350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:51.386801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 34/67] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:01:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:01:51.388413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6f99f-8340-418a-850e-15a92ea6e1f0 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:51.390328 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6f99f-8340-418a-850e-15a92ea6e1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:51.390328 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6f99f-8340-418a-850e-15a92ea6e1f0 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:51.396118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 35/68] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:51.396118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6f99f-8340-418a-850e-15a92ea6e1f0 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:51.421759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5af48-bcce-42c7-ad5a-8699224ce483 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:51.460825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35353a5-94b7-4413-8ef7-a2aafa7299d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:51.461504 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35353a5-94b7-4413-8ef7-a2aafa7299d3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:51.462136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35353a5-94b7-4413-8ef7-a2aafa7299d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:51.462240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35353a5-94b7-4413-8ef7-a2aafa7299d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:51.462973 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35353a5-94b7-4413-8ef7-a2aafa7299d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:51.463290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35353a5-94b7-4413-8ef7-a2aafa7299d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:51.464803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35353a5-94b7-4413-8ef7-a2aafa7299d3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:51.474002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:01:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:51.478490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4918d79-c64b-40be-9e94-f5cb854f83c3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:51.478490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4918d79-c64b-40be-9e94-f5cb854f83c3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:51.478490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4918d79-c64b-40be-9e94-f5cb854f83c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:51.492976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d4918d79-c64b-40be-9e94-f5cb854f83c3 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:51.494177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d4918d79-c64b-40be-9e94-f5cb854f83c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:51.519324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6f99f-8340-418a-850e-15a92ea6e1f0 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:51.527135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:51.554554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964af0ea-da25-4898-9944-2c282345a0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:51.555249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af0ea-da25-4898-9944-2c282345a0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:51.555539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af0ea-da25-4898-9944-2c282345a0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:51.555823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964af0ea-da25-4898-9944-2c282345a0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:51.556581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964af0ea-da25-4898-9944-2c282345a0b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:51.556894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964af0ea-da25-4898-9944-2c282345a0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:51.558308 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964af0ea-da25-4898-9944-2c282345a0b4 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:51.569642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 36/70] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:01:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:51.572554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99931e13-94b4-4e0d-b612-615ecb32b3e3 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:51.572554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99931e13-94b4-4e0d-b612-615ecb32b3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:51.572554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99931e13-94b4-4e0d-b612-615ecb32b3e3 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:51.572857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 37/71] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:51.574886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99931e13-94b4-4e0d-b612-615ecb32b3e3 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:51.585029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 35/72] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:51.585877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4918d79-c64b-40be-9e94-f5cb854f83c3 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:51.645880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:51.701779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99931e13-94b4-4e0d-b612-615ecb32b3e3 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:51.723049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4918d79-c64b-40be-9e94-f5cb854f83c3 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:51.735440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a972f-c80e-44d2-a381-d386ce22230f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:51.736301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a972f-c80e-44d2-a381-d386ce22230f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:51.736580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a972f-c80e-44d2-a381-d386ce22230f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:51.736957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a972f-c80e-44d2-a381-d386ce22230f None admin] PATH_INFO: `/v3/users/7b5047405b9548e5a14237010269640a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:51.751958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a972f-c80e-44d2-a381-d386ce22230f None admin] RBAC: Authorizing `identity:get_user(user_id=7b5047405b9548e5a14237010269640a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:51.753548 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a972f-c80e-44d2-a381-d386ce22230f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:51.755398 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 38/73] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:01:51 2022] GET /identity/v3/users/7b5047405b9548e5a14237010269640a => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:51.756628 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d42c1-042c-4094-bfd3-97357ecddfa7 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:51.756921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d42c1-042c-4094-bfd3-97357ecddfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:51.757203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d42c1-042c-4094-bfd3-97357ecddfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:51.763441 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b870df-4fcf-43a5-b6fe-61945adad386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:51.764775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b870df-4fcf-43a5-b6fe-61945adad386 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:51.765239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b870df-4fcf-43a5-b6fe-61945adad386 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:51.765695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b870df-4fcf-43a5-b6fe-61945adad386 None admin] PATH_INFO: `/v3/users/5f407cfabb074543a5e85c709d5e3a86` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:51.767185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b870df-4fcf-43a5-b6fe-61945adad386 None admin] RBAC: Authorizing `identity:get_user(user_id=5f407cfabb074543a5e85c709d5e3a86)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:51.768864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b870df-4fcf-43a5-b6fe-61945adad386 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:51.770870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 36/74] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:01:51 2022] GET /identity/v3/users/5f407cfabb074543a5e85c709d5e3a86 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:51.771822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b870df-4fcf-43a5-b6fe-61945adad386 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:51.783291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-c58d42c1-042c-4094-bfd3-97357ecddfa7 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:51.784650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c58d42c1-042c-4094-bfd3-97357ecddfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:51.804606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:51.858247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 39/75] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:51.859623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc1553-312f-4634-9928-4f3ea7d984a4 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:51.859914 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc1553-312f-4634-9928-4f3ea7d984a4 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:51.860191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc1553-312f-4634-9928-4f3ea7d984a4 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:51.862658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 40/76] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:51.862658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc1553-312f-4634-9928-4f3ea7d984a4 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:51.884456 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b870df-4fcf-43a5-b6fe-61945adad386 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:51.916334 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:51.919377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c583ae2-57ae-429e-89cf-581103e0b048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:51.920815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c583ae2-57ae-429e-89cf-581103e0b048 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:51.921105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c583ae2-57ae-429e-89cf-581103e0b048 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:51.921435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c583ae2-57ae-429e-89cf-581103e0b048 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:51.932846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c583ae2-57ae-429e-89cf-581103e0b048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-0c583ae2-57ae-429e-89cf-581103e0b048 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:51.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:51.942778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:01:51.943527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 37/77] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:01:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:01:51.944198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c583ae2-57ae-429e-89cf-581103e0b048 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:51.992504 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc1553-312f-4634-9928-4f3ea7d984a4 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:52.031649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63a187-a6e9-4b41-adf7-14f2878c9ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:52.032300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63a187-a6e9-4b41-adf7-14f2878c9ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:52.032591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63a187-a6e9-4b41-adf7-14f2878c9ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:52.032875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63a187-a6e9-4b41-adf7-14f2878c9ea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:52.052164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:52.065735 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c583ae2-57ae-429e-89cf-581103e0b048 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:52.099664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb6766-9ea7-42d7-b3f3-2225d5557a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:52.100312 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb6766-9ea7-42d7-b3f3-2225d5557a3f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:52.100597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb6766-9ea7-42d7-b3f3-2225d5557a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:52.100877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb6766-9ea7-42d7-b3f3-2225d5557a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:52.103283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63a187-a6e9-4b41-adf7-14f2878c9ea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:52.104767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63a187-a6e9-4b41-adf7-14f2878c9ea8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:52.143480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:52.171297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb6766-9ea7-42d7-b3f3-2225d5557a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:52.172791 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb6766-9ea7-42d7-b3f3-2225d5557a3f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:52.204923 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 41/78] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:01:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:01:52.206095 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ae02a-44ac-4015-b21a-352605aceafb None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:52.206389 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ae02a-44ac-4015-b21a-352605aceafb None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:52.206690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ae02a-44ac-4015-b21a-352605aceafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:52.222885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-4f6ae02a-44ac-4015-b21a-352605aceafb None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:52.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4f6ae02a-44ac-4015-b21a-352605aceafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:52.268314 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:52.280476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 38/79] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:01:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:01:52.281118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb6766-9ea7-42d7-b3f3-2225d5557a3f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:52.291727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 42/80] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:52.292567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ae02a-44ac-4015-b21a-352605aceafb None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:52.371291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:52.383823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb6766-9ea7-42d7-b3f3-2225d5557a3f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:52.404672 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ae02a-44ac-4015-b21a-352605aceafb None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:52.418129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dfbf0-25e6-4673-b5dc-3e3e7ae50923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:52.418951 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dfbf0-25e6-4673-b5dc-3e3e7ae50923 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:52.419239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dfbf0-25e6-4673-b5dc-3e3e7ae50923 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:52.419583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dfbf0-25e6-4673-b5dc-3e3e7ae50923 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:52.430124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dfbf0-25e6-4673-b5dc-3e3e7ae50923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-320dfbf0-25e6-4673-b5dc-3e3e7ae50923 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:52.437888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:52.438784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:52.443035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:52.443035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:52.443035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:52.443035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:52.443035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:52.443035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:52.443035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:52.443035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:52.443035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:52.443035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:52.443035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:01:52.443035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:01:52.444144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7693f-3190-4c93-bd26-8470e25f7e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:52.444239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 39/81] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:01:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:01:52.444325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7693f-3190-4c93-bd26-8470e25f7e06 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:52.444325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7693f-3190-4c93-bd26-8470e25f7e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:52.444462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dfbf0-25e6-4673-b5dc-3e3e7ae50923 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:52.444537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7693f-3190-4c93-bd26-8470e25f7e06 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:52.444537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7693f-3190-4c93-bd26-8470e25f7e06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:52.444537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7693f-3190-4c93-bd26-8470e25f7e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:52.444537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7693f-3190-4c93-bd26-8470e25f7e06 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:52.451284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 43/82] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:01:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:52.451977 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7693f-3190-4c93-bd26-8470e25f7e06 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:52.497434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:52.547910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dfbf0-25e6-4673-b5dc-3e3e7ae50923 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:52.557193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7693f-3190-4c93-bd26-8470e25f7e06 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:52.583290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df2cd0-73ee-4cdb-ac9c-89a2a8a9aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:52.584149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df2cd0-73ee-4cdb-ac9c-89a2a8a9aa6e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:52.584433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df2cd0-73ee-4cdb-ac9c-89a2a8a9aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:52.584706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df2cd0-73ee-4cdb-ac9c-89a2a8a9aa6e None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:52.585894 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df2cd0-73ee-4cdb-ac9c-89a2a8a9aa6e None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:52.587395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df2cd0-73ee-4cdb-ac9c-89a2a8a9aa6e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:52.587623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:52.589194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 40/83] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:01:52 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:52.589835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df2cd0-73ee-4cdb-ac9c-89a2a8a9aa6e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:52.598356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90b15-941c-47d2-bb50-7e3618478542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:52.599268 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90b15-941c-47d2-bb50-7e3618478542 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:52.599555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90b15-941c-47d2-bb50-7e3618478542 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:52.599837 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90b15-941c-47d2-bb50-7e3618478542 None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:52.601044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90b15-941c-47d2-bb50-7e3618478542 None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:52.602502 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90b15-941c-47d2-bb50-7e3618478542 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:52.604233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 44/84] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:01:52 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:52.604992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90b15-941c-47d2-bb50-7e3618478542 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:52.694768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df2cd0-73ee-4cdb-ac9c-89a2a8a9aa6e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:52.705653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90b15-941c-47d2-bb50-7e3618478542 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:52.711400 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:52.730307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae930c3-6b27-47b2-9f1a-7b2cc9bd153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:52.731127 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae930c3-6b27-47b2-9f1a-7b2cc9bd153a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:52.731418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae930c3-6b27-47b2-9f1a-7b2cc9bd153a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:52.731698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae930c3-6b27-47b2-9f1a-7b2cc9bd153a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:52.733499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae930c3-6b27-47b2-9f1a-7b2cc9bd153a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:52.735001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae930c3-6b27-47b2-9f1a-7b2cc9bd153a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:52.736635 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 41/85] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:01:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:52.737385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae930c3-6b27-47b2-9f1a-7b2cc9bd153a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:52.744448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ffde8-53f4-4156-8d21-38c358f40a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:52.745123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ffde8-53f4-4156-8d21-38c358f40a86 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:52.745412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ffde8-53f4-4156-8d21-38c358f40a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:52.745693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ffde8-53f4-4156-8d21-38c358f40a86 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:52.746443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ffde8-53f4-4156-8d21-38c358f40a86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:52.746796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ffde8-53f4-4156-8d21-38c358f40a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:52.748751 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ffde8-53f4-4156-8d21-38c358f40a86 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:52.757316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 45/86] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:01:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:52.758096 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ffde8-53f4-4156-8d21-38c358f40a86 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:52.815998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:52.838752 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae930c3-6b27-47b2-9f1a-7b2cc9bd153a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:52.858486 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ffde8-53f4-4156-8d21-38c358f40a86 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:52.873172 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d3e26-75cf-498e-8fac-761abff38cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:52.874101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d3e26-75cf-498e-8fac-761abff38cde None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:52.874383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d3e26-75cf-498e-8fac-761abff38cde None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:52.874687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d3e26-75cf-498e-8fac-761abff38cde None admin] PATH_INFO: `/v3/users/7b5047405b9548e5a14237010269640a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:52.875918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d3e26-75cf-498e-8fac-761abff38cde None admin] RBAC: Authorizing `identity:get_user(user_id=7b5047405b9548e5a14237010269640a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:52.877376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d3e26-75cf-498e-8fac-761abff38cde None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:52.879052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 42/87] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:01:52 2022] GET /identity/v3/users/7b5047405b9548e5a14237010269640a => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:52.879884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d3e26-75cf-498e-8fac-761abff38cde None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:52.897450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ac61-d308-4bb8-8294-4d170f525414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:52.898311 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ac61-d308-4bb8-8294-4d170f525414 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:52.898603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ac61-d308-4bb8-8294-4d170f525414 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:52.898930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ac61-d308-4bb8-8294-4d170f525414 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:52.899769 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ac61-d308-4bb8-8294-4d170f525414 None admin] RBAC: Adding query filter params (role.id=9eb3c16b00c04e1c850bab61de15c44c, scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6, user.id=7b5047405b9548e5a14237010269640a) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:52.900089 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ac61-d308-4bb8-8294-4d170f525414 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:52.901547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ac61-d308-4bb8-8294-4d170f525414 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:52.907459 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 46/88] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:01:52 2022] GET /identity/v3/role_assignments?user.id=7b5047405b9548e5a14237010269640a&scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6&role.id=9eb3c16b00c04e1c850bab61de15c44c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:52.908217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ac61-d308-4bb8-8294-4d170f525414 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:52.937795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:52.989719 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d3e26-75cf-498e-8fac-761abff38cde None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:53.030201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ac61-d308-4bb8-8294-4d170f525414 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:53.039312 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc803c7-cd30-480a-a2d1-6da063d278cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:53.039987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc803c7-cd30-480a-a2d1-6da063d278cd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:53.040274 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc803c7-cd30-480a-a2d1-6da063d278cd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:53.040561 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc803c7-cd30-480a-a2d1-6da063d278cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:53.041422 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc803c7-cd30-480a-a2d1-6da063d278cd None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6, user.id=5f407cfabb074543a5e85c709d5e3a86) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:53.041742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc803c7-cd30-480a-a2d1-6da063d278cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:53.043271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc803c7-cd30-480a-a2d1-6da063d278cd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:53.058667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 43/89] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:01:52 2022] GET /identity/v3/role_assignments?user.id=5f407cfabb074543a5e85c709d5e3a86&scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6&role.id=6fcc322b483a475399974562c1e5bd43 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:53.058667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc803c7-cd30-480a-a2d1-6da063d278cd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:53.069474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:53.087065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9c37d-99db-4028-a142-8c9af74ee1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:53.087932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9c37d-99db-4028-a142-8c9af74ee1a1 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:53.088295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9c37d-99db-4028-a142-8c9af74ee1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:53.088646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9c37d-99db-4028-a142-8c9af74ee1a1 None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:53.089461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9c37d-99db-4028-a142-8c9af74ee1a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:53.091067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9c37d-99db-4028-a142-8c9af74ee1a1 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:53.119235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 47/90] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:01:52 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:01:53.120630 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9c37d-99db-4028-a142-8c9af74ee1a1 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:53.240875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc803c7-cd30-480a-a2d1-6da063d278cd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:53.267843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:53.293209 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaec2b-9f96-4ed8-b605-27174063cd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:53.294114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaec2b-9f96-4ed8-b605-27174063cd66 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:53.294394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaec2b-9f96-4ed8-b605-27174063cd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:53.297663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9c37d-99db-4028-a142-8c9af74ee1a1 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:53.299457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaec2b-9f96-4ed8-b605-27174063cd66 None admin] PATH_INFO: `/v3/users/7b5047405b9548e5a14237010269640a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:53.301490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaec2b-9f96-4ed8-b605-27174063cd66 None admin] RBAC: Authorizing `identity:get_user(user_id=7b5047405b9548e5a14237010269640a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:53.304109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaec2b-9f96-4ed8-b605-27174063cd66 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:53.311859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 44/91] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:01:53 2022] GET /identity/v3/users/7b5047405b9548e5a14237010269640a => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:53.319289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaec2b-9f96-4ed8-b605-27174063cd66 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:53.352977 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a84a7-0e6f-41ef-92f3-ceb57f5a4fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:53.353642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a84a7-0e6f-41ef-92f3-ceb57f5a4fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:53.353931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a84a7-0e6f-41ef-92f3-ceb57f5a4fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:53.354204 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a84a7-0e6f-41ef-92f3-ceb57f5a4fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:53.428874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:53.453839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a84a7-0e6f-41ef-92f3-ceb57f5a4fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:53.455477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a84a7-0e6f-41ef-92f3-ceb57f5a4fe8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:53.457102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaec2b-9f96-4ed8-b605-27174063cd66 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:53.495849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d462f93-1af3-4409-9ebb-21658a5d50e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:53.496510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d462f93-1af3-4409-9ebb-21658a5d50e6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:53.496797 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d462f93-1af3-4409-9ebb-21658a5d50e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:53.497076 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d462f93-1af3-4409-9ebb-21658a5d50e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:53.557662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:53.572153 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 48/92] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:01:53.573200 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d462f93-1af3-4409-9ebb-21658a5d50e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:53.577611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d462f93-1af3-4409-9ebb-21658a5d50e6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:53.579784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a84a7-0e6f-41ef-92f3-ceb57f5a4fe8 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:53.687850 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:53.712067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a84a7-0e6f-41ef-92f3-ceb57f5a4fe8 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:53.722446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 45/93] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 08:01:53.728701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d462f93-1af3-4409-9ebb-21658a5d50e6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:53.753353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27456974-f299-4c8d-874b-1cc3894bc4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:53.754279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27456974-f299-4c8d-874b-1cc3894bc4eb None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:53.754575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27456974-f299-4c8d-874b-1cc3894bc4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:53.754885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27456974-f299-4c8d-874b-1cc3894bc4eb None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:53.756142 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27456974-f299-4c8d-874b-1cc3894bc4eb None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:53.757620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27456974-f299-4c8d-874b-1cc3894bc4eb None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:53.759551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 49/94] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:01:53 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:01:53.765959 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27456974-f299-4c8d-874b-1cc3894bc4eb None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:53.832409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:53.850363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d462f93-1af3-4409-9ebb-21658a5d50e6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:53.879565 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27456974-f299-4c8d-874b-1cc3894bc4eb None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:53.900483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7da67-41dc-4a7e-bb3f-1e9bf4e789b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:53.901361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7da67-41dc-4a7e-bb3f-1e9bf4e789b6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:53.901647 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7da67-41dc-4a7e-bb3f-1e9bf4e789b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:53.901926 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7da67-41dc-4a7e-bb3f-1e9bf4e789b6 None admin] PATH_INFO: `/v3/projects/a1e170b0ff5f45fcb7f56c14ee3734fa` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:53.903189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7da67-41dc-4a7e-bb3f-1e9bf4e789b6 None admin] RBAC: Authorizing `identity:get_project(project_id=a1e170b0ff5f45fcb7f56c14ee3734fa)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:53.905859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7da67-41dc-4a7e-bb3f-1e9bf4e789b6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:53.912077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 46/95] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:01:53 2022] GET /identity/v3/projects/a1e170b0ff5f45fcb7f56c14ee3734fa => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:53.917518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec434466-19e8-4277-8b06-45ae9503b6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:53.917669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7da67-41dc-4a7e-bb3f-1e9bf4e789b6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:53.918336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec434466-19e8-4277-8b06-45ae9503b6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:53.918681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec434466-19e8-4277-8b06-45ae9503b6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:53.918971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec434466-19e8-4277-8b06-45ae9503b6b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:53.919945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec434466-19e8-4277-8b06-45ae9503b6b5 None admin] RBAC: Adding query filter params (role.id=8d803b40a63540ba80e3039f16774d46, scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6, user.id=7b5047405b9548e5a14237010269640a) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:53.920266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec434466-19e8-4277-8b06-45ae9503b6b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:53.921753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec434466-19e8-4277-8b06-45ae9503b6b5 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:53.928267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 50/96] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:01:53 2022] GET /identity/v3/role_assignments?user.id=7b5047405b9548e5a14237010269640a&scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6&role.id=8d803b40a63540ba80e3039f16774d46 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:01:54.065208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7da67-41dc-4a7e-bb3f-1e9bf4e789b6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:54.114565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900ec71-5e17-477e-a658-52693694f887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:54.115261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900ec71-5e17-477e-a658-52693694f887 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:54.115607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900ec71-5e17-477e-a658-52693694f887 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:54.115894 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900ec71-5e17-477e-a658-52693694f887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:54.116999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900ec71-5e17-477e-a658-52693694f887 None admin] RBAC: Adding query filter params (role.id=9eb3c16b00c04e1c850bab61de15c44c, scope.project.id=a1e170b0ff5f45fcb7f56c14ee3734fa, user.id=7b5047405b9548e5a14237010269640a) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:54.117317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900ec71-5e17-477e-a658-52693694f887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:54.118803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900ec71-5e17-477e-a658-52693694f887 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:54.129642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 47/97] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:01:53 2022] GET /identity/v3/role_assignments?user.id=7b5047405b9548e5a14237010269640a&scope.project.id=a1e170b0ff5f45fcb7f56c14ee3734fa&role.id=9eb3c16b00c04e1c850bab61de15c44c => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:55.452723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949ded-6663-45f8-90ee-1127a65bcd37 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:55.453274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949ded-6663-45f8-90ee-1127a65bcd37 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:55.453274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949ded-6663-45f8-90ee-1127a65bcd37 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:55.454865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 51/98] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:55.461099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30aaad-4163-4316-9888-68eba09fd167 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:55.461648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30aaad-4163-4316-9888-68eba09fd167 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:55.461648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30aaad-4163-4316-9888-68eba09fd167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:55.487236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5e30aaad-4163-4316-9888-68eba09fd167 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:55.488458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5e30aaad-4163-4316-9888-68eba09fd167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:55.505053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:55.574244 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 48/99] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:55.596797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2949ded-6663-45f8-90ee-1127a65bcd37 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:55.613340 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:55.708111 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2949ded-6663-45f8-90ee-1127a65bcd37 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:55.745030 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8721c9f-6845-4404-a6c8-8d74fc0f24e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:55.745840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8721c9f-6845-4404-a6c8-8d74fc0f24e0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:55.746123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8721c9f-6845-4404-a6c8-8d74fc0f24e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:55.746404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8721c9f-6845-4404-a6c8-8d74fc0f24e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:55.757435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8721c9f-6845-4404-a6c8-8d74fc0f24e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-e8721c9f-6845-4404-a6c8-8d74fc0f24e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:55.765937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:55.766795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:01:55.767957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 52/100] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:01:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:01:55.773346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30aaad-4163-4316-9888-68eba09fd167 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:55.876522 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30aaad-4163-4316-9888-68eba09fd167 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:55.912387 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887303a3-441b-4e40-b760-19eb689ce110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:55.913066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887303a3-441b-4e40-b760-19eb689ce110 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:55.913354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887303a3-441b-4e40-b760-19eb689ce110 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:55.913635 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887303a3-441b-4e40-b760-19eb689ce110 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:55.914450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887303a3-441b-4e40-b760-19eb689ce110 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:55.914796 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887303a3-441b-4e40-b760-19eb689ce110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:55.916239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887303a3-441b-4e40-b760-19eb689ce110 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:55.924942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 49/101] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:01:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:55.930469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8721c9f-6845-4404-a6c8-8d74fc0f24e0 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:56.007988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:56.041066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8721c9f-6845-4404-a6c8-8d74fc0f24e0 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:56.077015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a2745-e596-4bac-8fb8-63eba42167e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:56.077900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a2745-e596-4bac-8fb8-63eba42167e4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:56.078189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a2745-e596-4bac-8fb8-63eba42167e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:56.078473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a2745-e596-4bac-8fb8-63eba42167e4 None admin] PATH_INFO: `/v3/users/7b5047405b9548e5a14237010269640a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:56.079737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a2745-e596-4bac-8fb8-63eba42167e4 None admin] RBAC: Authorizing `identity:get_user(user_id=7b5047405b9548e5a14237010269640a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:56.081221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a2745-e596-4bac-8fb8-63eba42167e4 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:56.083263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 53/102] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:01:55 2022] GET /identity/v3/users/7b5047405b9548e5a14237010269640a => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:56.088755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887303a3-441b-4e40-b760-19eb689ce110 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:56.102417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:56.201776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887303a3-441b-4e40-b760-19eb689ce110 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:56.238583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003c636-fd12-4e7a-8965-2d17a994b3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:56.239550 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003c636-fd12-4e7a-8965-2d17a994b3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:56.239841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003c636-fd12-4e7a-8965-2d17a994b3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:56.240119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003c636-fd12-4e7a-8965-2d17a994b3a7 None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:56.241677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003c636-fd12-4e7a-8965-2d17a994b3a7 None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:56.243173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003c636-fd12-4e7a-8965-2d17a994b3a7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:56.244904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 50/103] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:01:56 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:56.251295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a2745-e596-4bac-8fb8-63eba42167e4 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:56.384529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a2745-e596-4bac-8fb8-63eba42167e4 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:56.435862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16a2df-b232-48c8-bf89-977941f8d4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:56.436795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16a2df-b232-48c8-bf89-977941f8d4dc None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:56.437090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16a2df-b232-48c8-bf89-977941f8d4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:56.437383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16a2df-b232-48c8-bf89-977941f8d4dc None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6/users/7b5047405b9548e5a14237010269640a/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:56.439489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16a2df-b232-48c8-bf89-977941f8d4dc None admin] RBAC: Authorizing `identity:create_grant(project_id=989c7a7c2f7f49e5be8e751b4ec32db6, user_id=7b5047405b9548e5a14237010269640a, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:56.440960 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16a2df-b232-48c8-bf89-977941f8d4dc None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:56.470509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:56.474681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 54/104] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:01:56 2022] PUT /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6/users/7b5047405b9548e5a14237010269640a/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:01:56.635299 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa90977-de09-4050-96ef-754e58bd5762 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:56.635789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa90977-de09-4050-96ef-754e58bd5762 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:56.635789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa90977-de09-4050-96ef-754e58bd5762 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:56.637163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 51/105] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:56.642904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501b3e8-c856-4931-b059-35318f37b47d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:56.643202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501b3e8-c856-4931-b059-35318f37b47d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:56.643489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501b3e8-c856-4931-b059-35318f37b47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:56.667213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f501b3e8-c856-4931-b059-35318f37b47d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:56.668426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f501b3e8-c856-4931-b059-35318f37b47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:56.743390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b55ec4-1816-4c26-861b-7013dcadb8fd None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:56.743390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b55ec4-1816-4c26-861b-7013dcadb8fd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:56.743390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b55ec4-1816-4c26-861b-7013dcadb8fd None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:56.745310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 52/106] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:56.754014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaf160-5c13-4aae-baf8-73daff1d7132 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:56.754305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaf160-5c13-4aae-baf8-73daff1d7132 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:56.754590 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaf160-5c13-4aae-baf8-73daff1d7132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:56.780378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 55/107] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:56.780769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4fbaf160-5c13-4aae-baf8-73daff1d7132 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:56.781997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4fbaf160-5c13-4aae-baf8-73daff1d7132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:56.866399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501b3e8-c856-4931-b059-35318f37b47d None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:56.880861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 53/108] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:01:56.891718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204cff-ba0d-4c1b-81aa-572689e780f1 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:56.891977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204cff-ba0d-4c1b-81aa-572689e780f1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:56.892222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204cff-ba0d-4c1b-81aa-572689e780f1 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:56.893709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 54/109] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:56.898757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffd77a-8d1a-4f4e-bab3-52f9bca3ca40 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:56.899050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffd77a-8d1a-4f4e-bab3-52f9bca3ca40 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:56.899335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffd77a-8d1a-4f4e-bab3-52f9bca3ca40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:56.921170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-81ffd77a-8d1a-4f4e-bab3-52f9bca3ca40 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:56.922354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-81ffd77a-8d1a-4f4e-bab3-52f9bca3ca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:56.924684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:57.023191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501b3e8-c856-4931-b059-35318f37b47d None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:57.035121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 55/110] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:57.036120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffd77a-8d1a-4f4e-bab3-52f9bca3ca40 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:57.072069 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:57.081352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebedf3b-ba34-4231-a7fc-127eb5ffe487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:57.082156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebedf3b-ba34-4231-a7fc-127eb5ffe487 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:57.082443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebedf3b-ba34-4231-a7fc-127eb5ffe487 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:57.082751 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebedf3b-ba34-4231-a7fc-127eb5ffe487 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:57.097571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebedf3b-ba34-4231-a7fc-127eb5ffe487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-8ebedf3b-ba34-4231-a7fc-127eb5ffe487 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:57.108198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:57.109063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:57.109825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:57.109825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:57.109825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:57.109825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:57.109825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:57.109825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:57.109825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:57.109825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:57.109825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:57.109825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:57.109825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:01:57.109825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:01:57.110972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 56/111] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:01:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:01:57.114022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b092d54-78b6-4e67-a33f-2827fd3d0208 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:57.114022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b092d54-78b6-4e67-a33f-2827fd3d0208 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:57.114022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b092d54-78b6-4e67-a33f-2827fd3d0208 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:57.114022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 57/112] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:57.115186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b092d54-78b6-4e67-a33f-2827fd3d0208 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:57.160833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffd77a-8d1a-4f4e-bab3-52f9bca3ca40 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:57.200915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2a59c-b5ef-4d32-b9ba-bdb5b03eee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:57.201841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2a59c-b5ef-4d32-b9ba-bdb5b03eee3a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:57.202135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2a59c-b5ef-4d32-b9ba-bdb5b03eee3a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:57.202417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2a59c-b5ef-4d32-b9ba-bdb5b03eee3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:57.203672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2a59c-b5ef-4d32-b9ba-bdb5b03eee3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:57.205482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2a59c-b5ef-4d32-b9ba-bdb5b03eee3a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:57.207369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 56/113] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:01:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:57.207929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2a59c-b5ef-4d32-b9ba-bdb5b03eee3a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:57.218670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:57.259012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b092d54-78b6-4e67-a33f-2827fd3d0208 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:57.297459 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465832-2e6d-4090-8d1d-eb1020fe73eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:57.298295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465832-2e6d-4090-8d1d-eb1020fe73eb None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:57.298582 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465832-2e6d-4090-8d1d-eb1020fe73eb None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:57.298916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465832-2e6d-4090-8d1d-eb1020fe73eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:57.310479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2465832-2e6d-4090-8d1d-eb1020fe73eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-a2465832-2e6d-4090-8d1d-eb1020fe73eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:57.319025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:57.320133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:01:57.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 58/114] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:01:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:01:57.321645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71f83-bd67-44e2-90fb-59f928b5075d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:57.321645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71f83-bd67-44e2-90fb-59f928b5075d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:57.321645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71f83-bd67-44e2-90fb-59f928b5075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:57.340613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-79e71f83-bd67-44e2-90fb-59f928b5075d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:57.343750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-79e71f83-bd67-44e2-90fb-59f928b5075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:57.345220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2a59c-b5ef-4d32-b9ba-bdb5b03eee3a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:57.394459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105065c-0f9b-49cc-b744-1875751afe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:57.395703 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105065c-0f9b-49cc-b744-1875751afe75 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:57.396163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105065c-0f9b-49cc-b744-1875751afe75 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:57.396584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105065c-0f9b-49cc-b744-1875751afe75 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:57.397186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:57.399475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105065c-0f9b-49cc-b744-1875751afe75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:57.399818 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105065c-0f9b-49cc-b744-1875751afe75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:57.401330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105065c-0f9b-49cc-b744-1875751afe75 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:57.412831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 57/115] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:01:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:57.413675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105065c-0f9b-49cc-b744-1875751afe75 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:57.430197 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 59/116] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:57.431430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e71f83-bd67-44e2-90fb-59f928b5075d None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:57.513534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:57.553406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e71f83-bd67-44e2-90fb-59f928b5075d None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:57.557705 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105065c-0f9b-49cc-b744-1875751afe75 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:57.593682 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb0d04-312e-4224-9ec7-0e93fed59098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:57.594348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb0d04-312e-4224-9ec7-0e93fed59098 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:57.594646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb0d04-312e-4224-9ec7-0e93fed59098 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:57.594928 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb0d04-312e-4224-9ec7-0e93fed59098 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:57.595938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb0d04-312e-4224-9ec7-0e93fed59098 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:57.596180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb0d04-312e-4224-9ec7-0e93fed59098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:57.596547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8d15f-4d93-44cf-b972-abfab60cd55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:57.597214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8d15f-4d93-44cf-b972-abfab60cd55e None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:57.597497 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8d15f-4d93-44cf-b972-abfab60cd55e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:57.597592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb0d04-312e-4224-9ec7-0e93fed59098 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:57.597780 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8d15f-4d93-44cf-b972-abfab60cd55e None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:57.598484 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8d15f-4d93-44cf-b972-abfab60cd55e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:57.600071 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8d15f-4d93-44cf-b972-abfab60cd55e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:57.605710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 60/117] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:01:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:57.607543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb0d04-312e-4224-9ec7-0e93fed59098 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:57.626431 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 58/118] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:01:57 2022] POST /identity/v3/projects => generated 302 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:01:57.627583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8d15f-4d93-44cf-b972-abfab60cd55e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:57.669904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:57.750773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb0d04-312e-4224-9ec7-0e93fed59098 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:57.767375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8d15f-4d93-44cf-b972-abfab60cd55e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:57.799223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54463f3-0dc2-4c64-8a37-215f3b7cfc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:57.799952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:57.800905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54463f3-0dc2-4c64-8a37-215f3b7cfc6a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:57.800905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54463f3-0dc2-4c64-8a37-215f3b7cfc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:57.801215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54463f3-0dc2-4c64-8a37-215f3b7cfc6a None admin] PATH_INFO: `/v3/users/5f407cfabb074543a5e85c709d5e3a86` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:57.802579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54463f3-0dc2-4c64-8a37-215f3b7cfc6a None admin] RBAC: Authorizing `identity:get_user(user_id=5f407cfabb074543a5e85c709d5e3a86)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:57.804751 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54463f3-0dc2-4c64-8a37-215f3b7cfc6a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:57.805892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 61/119] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:01:57 2022] GET /identity/v3/users/5f407cfabb074543a5e85c709d5e3a86 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:57.810656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3bf95-41fb-42e3-b026-f2838f28650a None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:57.810656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3bf95-41fb-42e3-b026-f2838f28650a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:57.810656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3bf95-41fb-42e3-b026-f2838f28650a None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:57.810656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 62/120] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:57.810656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3bf95-41fb-42e3-b026-f2838f28650a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:57.824772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f87e44-6723-4265-875e-aeea7917387c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:57.826108 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f87e44-6723-4265-875e-aeea7917387c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:57.826395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f87e44-6723-4265-875e-aeea7917387c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:57.826949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f87e44-6723-4265-875e-aeea7917387c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:57.841518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f87e44-6723-4265-875e-aeea7917387c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-44f87e44-6723-4265-875e-aeea7917387c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:57.849339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:57.850221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:01:57.851031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 59/121] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:01:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:01:57.851662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f87e44-6723-4265-875e-aeea7917387c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:57.953643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3bf95-41fb-42e3-b026-f2838f28650a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:57.970433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f87e44-6723-4265-875e-aeea7917387c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:57.974983 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:57.998858 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724f05a-a21e-4567-9e6b-83a0dcb1bdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:58.000029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724f05a-a21e-4567-9e6b-83a0dcb1bdfd None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:58.000325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724f05a-a21e-4567-9e6b-83a0dcb1bdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:58.000615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724f05a-a21e-4567-9e6b-83a0dcb1bdfd None admin] PATH_INFO: `/v3/users/7b5047405b9548e5a14237010269640a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:58.002338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724f05a-a21e-4567-9e6b-83a0dcb1bdfd None admin] RBAC: Authorizing `identity:get_user(user_id=7b5047405b9548e5a14237010269640a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:58.004144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724f05a-a21e-4567-9e6b-83a0dcb1bdfd None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:58.005961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 63/122] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:01:57 2022] GET /identity/v3/users/7b5047405b9548e5a14237010269640a => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:58.006872 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67b6b9-8856-491c-8271-e18d1bc3c47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:58.007016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a373c-301d-450e-9110-8fd604b896be None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:58.007299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a373c-301d-450e-9110-8fd604b896be None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:58.007617 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a373c-301d-450e-9110-8fd604b896be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:58.008125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b6b9-8856-491c-8271-e18d1bc3c47a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:58.008511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b6b9-8856-491c-8271-e18d1bc3c47a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:58.008915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b6b9-8856-491c-8271-e18d1bc3c47a None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:58.010409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67b6b9-8856-491c-8271-e18d1bc3c47a None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:58.012191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67b6b9-8856-491c-8271-e18d1bc3c47a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:58.014702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 60/123] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:01:57 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:58.015607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67b6b9-8856-491c-8271-e18d1bc3c47a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:58.030185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-909a373c-301d-450e-9110-8fd604b896be None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:58.031500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-909a373c-301d-450e-9110-8fd604b896be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:58.086971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:58.118535 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 64/124] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:58.119419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a373c-301d-450e-9110-8fd604b896be None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:58.145087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67b6b9-8856-491c-8271-e18d1bc3c47a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:58.188907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d3a20-f707-4ac6-acff-4472effd98ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:58.189995 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d3a20-f707-4ac6-acff-4472effd98ac None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:58.190563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d3a20-f707-4ac6-acff-4472effd98ac None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:58.190896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d3a20-f707-4ac6-acff-4472effd98ac None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:58.191812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d3a20-f707-4ac6-acff-4472effd98ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:58.192131 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d3a20-f707-4ac6-acff-4472effd98ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:58.194138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d3a20-f707-4ac6-acff-4472effd98ac None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:58.204381 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 61/125] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:01:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:58.207078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d3a20-f707-4ac6-acff-4472effd98ac None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:58.249393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a373c-301d-450e-9110-8fd604b896be None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:58.259551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:58.289467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19939ad5-0baf-4e4e-89d5-463dbf725b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:58.290550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19939ad5-0baf-4e4e-89d5-463dbf725b4f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:58.291071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19939ad5-0baf-4e4e-89d5-463dbf725b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:58.291560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19939ad5-0baf-4e4e-89d5-463dbf725b4f None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:58.292999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19939ad5-0baf-4e4e-89d5-463dbf725b4f None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:58.295387 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19939ad5-0baf-4e4e-89d5-463dbf725b4f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:58.297513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 65/126] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:01:58 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:58.298840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19939ad5-0baf-4e4e-89d5-463dbf725b4f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:58.338319 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d3a20-f707-4ac6-acff-4472effd98ac None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:58.352405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:58.388001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1a0c6-11a6-40e9-b3ef-bd1302d43eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:58.389753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1a0c6-11a6-40e9-b3ef-bd1302d43eff None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:58.390220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1a0c6-11a6-40e9-b3ef-bd1302d43eff None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:58.390700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1a0c6-11a6-40e9-b3ef-bd1302d43eff None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6/users/5f407cfabb074543a5e85c709d5e3a86/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:58.393989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1a0c6-11a6-40e9-b3ef-bd1302d43eff None admin] RBAC: Authorizing `identity:create_grant(project_id=989c7a7c2f7f49e5be8e751b4ec32db6, user_id=5f407cfabb074543a5e85c709d5e3a86, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:58.396535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1a0c6-11a6-40e9-b3ef-bd1302d43eff None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:58.416192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 62/127] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:01:58 2022] PUT /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6/users/5f407cfabb074543a5e85c709d5e3a86/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:01:58.417574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1a0c6-11a6-40e9-b3ef-bd1302d43eff None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:58.433503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19939ad5-0baf-4e4e-89d5-463dbf725b4f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:58.522099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b807d85-0371-4e00-9a98-b5bc8e6dd482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:58.523160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b807d85-0371-4e00-9a98-b5bc8e6dd482 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:58.523333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b807d85-0371-4e00-9a98-b5bc8e6dd482 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:58.523618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b807d85-0371-4e00-9a98-b5bc8e6dd482 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:58.549689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1a0c6-11a6-40e9-b3ef-bd1302d43eff None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:58.551667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b807d85-0371-4e00-9a98-b5bc8e6dd482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-2b807d85-0371-4e00-9a98-b5bc8e6dd482 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:58.568377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:58.569717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:01:58.570471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 66/128] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:01:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:01:58.573733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b807d85-0371-4e00-9a98-b5bc8e6dd482 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:58.604477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28279727-106d-451c-a4e5-944b50e95521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:58.605658 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28279727-106d-451c-a4e5-944b50e95521 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:58.606131 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28279727-106d-451c-a4e5-944b50e95521 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:58.607401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28279727-106d-451c-a4e5-944b50e95521 None admin] PATH_INFO: `/v3/users/f6e24804f65f440cb9dc77d13c05b38f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:58.627417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28279727-106d-451c-a4e5-944b50e95521 None admin] RBAC: Authorizing `identity:get_user(user_id=f6e24804f65f440cb9dc77d13c05b38f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:58.629606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28279727-106d-451c-a4e5-944b50e95521 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:58.632274 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 63/129] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:01:58 2022] GET /identity/v3/users/f6e24804f65f440cb9dc77d13c05b38f => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:58.633251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28279727-106d-451c-a4e5-944b50e95521 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:58.673154 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:58.677951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:58.775968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b807d85-0371-4e00-9a98-b5bc8e6dd482 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:58.780421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28279727-106d-451c-a4e5-944b50e95521 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:58.819348 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754420f3-9408-49f0-88df-557255b5cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:58.820149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754420f3-9408-49f0-88df-557255b5cd6f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:58.820541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754420f3-9408-49f0-88df-557255b5cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:58.820822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754420f3-9408-49f0-88df-557255b5cd6f None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:58.821574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754420f3-9408-49f0-88df-557255b5cd6f None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:01:58.821691 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157d204-2f27-4fe2-8b66-b34a3c64a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:58.821879 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754420f3-9408-49f0-88df-557255b5cd6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:58.822496 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d204-2f27-4fe2-8b66-b34a3c64a69f None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:58.822820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d204-2f27-4fe2-8b66-b34a3c64a69f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:58.823105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d204-2f27-4fe2-8b66-b34a3c64a69f None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6/users/7b5047405b9548e5a14237010269640a/roles/8d803b40a63540ba80e3039f16774d46` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:58.823265 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754420f3-9408-49f0-88df-557255b5cd6f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:58.826231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157d204-2f27-4fe2-8b66-b34a3c64a69f None admin] RBAC: Authorizing `identity:create_grant(project_id=989c7a7c2f7f49e5be8e751b4ec32db6, user_id=7b5047405b9548e5a14237010269640a, role_id=8d803b40a63540ba80e3039f16774d46)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:58.827782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157d204-2f27-4fe2-8b66-b34a3c64a69f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:58.833126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 64/130] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:01:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:58.834155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754420f3-9408-49f0-88df-557255b5cd6f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:58.857446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 67/131] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:01:58 2022] PUT /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6/users/7b5047405b9548e5a14237010269640a/roles/8d803b40a63540ba80e3039f16774d46 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:01:58.858574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157d204-2f27-4fe2-8b66-b34a3c64a69f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:59.023908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:59.031847 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157d204-2f27-4fe2-8b66-b34a3c64a69f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:59.060748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:59.079634 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754420f3-9408-49f0-88df-557255b5cd6f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:59.080333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804f5b4-cd93-4103-b01f-238cefe4d993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:59.081245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804f5b4-cd93-4103-b01f-238cefe4d993 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:59.081532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804f5b4-cd93-4103-b01f-238cefe4d993 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:59.081813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804f5b4-cd93-4103-b01f-238cefe4d993 None admin] PATH_INFO: `/v3/users/7b5047405b9548e5a14237010269640a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:59.083121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804f5b4-cd93-4103-b01f-238cefe4d993 None admin] RBAC: Authorizing `identity:get_user(user_id=7b5047405b9548e5a14237010269640a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:59.084682 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804f5b4-cd93-4103-b01f-238cefe4d993 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:59.086741 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 68/132] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:01:58 2022] GET /identity/v3/users/7b5047405b9548e5a14237010269640a => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:59.095032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f447f48-d6b4-4c10-b0f5-aeaf5c8e2a5f None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:59.095352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f447f48-d6b4-4c10-b0f5-aeaf5c8e2a5f None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:59.095634 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f447f48-d6b4-4c10-b0f5-aeaf5c8e2a5f None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:59.097982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 69/133] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:01:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:01:59.098775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f447f48-d6b4-4c10-b0f5-aeaf5c8e2a5f None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:59.134865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443e8dc-a13c-49a7-8ab2-1ef4a9e24f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:59.135871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443e8dc-a13c-49a7-8ab2-1ef4a9e24f18 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:59.136170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443e8dc-a13c-49a7-8ab2-1ef4a9e24f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:59.136742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443e8dc-a13c-49a7-8ab2-1ef4a9e24f18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:59.243920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443e8dc-a13c-49a7-8ab2-1ef4a9e24f18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:59.245417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443e8dc-a13c-49a7-8ab2-1ef4a9e24f18 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:59.267580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f447f48-d6b4-4c10-b0f5-aeaf5c8e2a5f None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:59.334560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af8870-301c-480b-8057-c70cf59c00cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:59.335376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af8870-301c-480b-8057-c70cf59c00cd None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:59.335667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af8870-301c-480b-8057-c70cf59c00cd None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:59.335952 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af8870-301c-480b-8057-c70cf59c00cd None admin] PATH_INFO: `/v3/projects/a1e170b0ff5f45fcb7f56c14ee3734fa` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:59.337169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af8870-301c-480b-8057-c70cf59c00cd None admin] RBAC: Authorizing `identity:get_project(project_id=a1e170b0ff5f45fcb7f56c14ee3734fa)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:59.338643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af8870-301c-480b-8057-c70cf59c00cd None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:59.345802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 70/134] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:01:59 2022] GET /identity/v3/projects/a1e170b0ff5f45fcb7f56c14ee3734fa => generated 312 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:59.347143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60d0f-2ff5-4abe-881f-75e7b2799269 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:59.347438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60d0f-2ff5-4abe-881f-75e7b2799269 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:59.347722 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60d0f-2ff5-4abe-881f-75e7b2799269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:59.365254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-cfb60d0f-2ff5-4abe-881f-75e7b2799269 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:01:59.366754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-cfb60d0f-2ff5-4abe-881f-75e7b2799269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:01:59.407092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:59.425708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:59.435044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 65/135] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:01:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:01:59.441496 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443e8dc-a13c-49a7-8ab2-1ef4a9e24f18 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:59.442225 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 71/136] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:01:59.443200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb60d0f-2ff5-4abe-881f-75e7b2799269 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:59.548676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb60d0f-2ff5-4abe-881f-75e7b2799269 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:59.626351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0854d4-c7da-457e-8d79-e80c93e54985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:59.628849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443e8dc-a13c-49a7-8ab2-1ef4a9e24f18 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:59.629864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0854d4-c7da-457e-8d79-e80c93e54985 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:59.630294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0854d4-c7da-457e-8d79-e80c93e54985 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:59.630745 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0854d4-c7da-457e-8d79-e80c93e54985 None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:59.633528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0854d4-c7da-457e-8d79-e80c93e54985 None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:59.636047 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0854d4-c7da-457e-8d79-e80c93e54985 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:59.641169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 72/137] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:01:59 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:01:59.642111 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0854d4-c7da-457e-8d79-e80c93e54985 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:59.707235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87735fb-6f6d-410a-ad44-9d7a08d238ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:59.709665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87735fb-6f6d-410a-ad44-9d7a08d238ad None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:59.710138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:59.711646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87735fb-6f6d-410a-ad44-9d7a08d238ad None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:59.712352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87735fb-6f6d-410a-ad44-9d7a08d238ad None admin] PATH_INFO: `/v3/projects/a1e170b0ff5f45fcb7f56c14ee3734fa/users/7b5047405b9548e5a14237010269640a/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:59.718639 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87735fb-6f6d-410a-ad44-9d7a08d238ad None admin] RBAC: Authorizing `identity:create_grant(project_id=a1e170b0ff5f45fcb7f56c14ee3734fa, user_id=7b5047405b9548e5a14237010269640a, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:01:59.720404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87735fb-6f6d-410a-ad44-9d7a08d238ad None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:01:59.755045 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 66/138] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:01:59 2022] PUT /identity/v3/projects/a1e170b0ff5f45fcb7f56c14ee3734fa/users/7b5047405b9548e5a14237010269640a/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:01:59.756151 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87735fb-6f6d-410a-ad44-9d7a08d238ad None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:59.839853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0854d4-c7da-457e-8d79-e80c93e54985 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:01:59.862280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:01:59.881817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f07688-bcb9-4897-b8d3-b71365d9f1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:01:59.883002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07688-bcb9-4897-b8d3-b71365d9f1bc None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:01:59.883511 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07688-bcb9-4897-b8d3-b71365d9f1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:01:59.883971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07688-bcb9-4897-b8d3-b71365d9f1bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:01:59.897201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f07688-bcb9-4897-b8d3-b71365d9f1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-f8f07688-bcb9-4897-b8d3-b71365d9f1bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:01:59.906031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:01:59.907103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:01:59.907971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:01:59.907971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:01:59.907971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:01:59.907971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:01:59.907971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:01:59.907971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:01:59.907971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:01:59.907971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:01:59.907971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:01:59.907971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:01:59.907971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:01:59.907971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:01:59.910087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 73/139] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:01:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:01:59.920064 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f07688-bcb9-4897-b8d3-b71365d9f1bc None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:01:59.994674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87735fb-6f6d-410a-ad44-9d7a08d238ad None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:00.049031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de44e3-a28c-473d-bb29-fbdcb0df719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:00.050220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de44e3-a28c-473d-bb29-fbdcb0df719a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:00.050703 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de44e3-a28c-473d-bb29-fbdcb0df719a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:00.051057 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:00.051289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de44e3-a28c-473d-bb29-fbdcb0df719a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:00.052450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de44e3-a28c-473d-bb29-fbdcb0df719a None admin] RBAC: Adding query filter params (role.id=10b654dbef184b75888fa0bbd288b1c2, scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6, user.id=f6e24804f65f440cb9dc77d13c05b38f) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:00.053339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de44e3-a28c-473d-bb29-fbdcb0df719a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:00.054989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de44e3-a28c-473d-bb29-fbdcb0df719a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:00.065304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 67/140] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:01:59 2022] GET /identity/v3/role_assignments?user.id=f6e24804f65f440cb9dc77d13c05b38f&scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6&role.id=10b654dbef184b75888fa0bbd288b1c2 => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:00.073461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f07688-bcb9-4897-b8d3-b71365d9f1bc None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:00.077291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fc87d-f477-463b-b772-178cd24641ac None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:00.077455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fc87d-f477-463b-b772-178cd24641ac None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:00.077595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fc87d-f477-463b-b772-178cd24641ac None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:00.079081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 68/141] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:00.084477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a1050-c829-46b1-9505-9651f96392ac None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:00.084787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a1050-c829-46b1-9505-9651f96392ac None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:00.085046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a1050-c829-46b1-9505-9651f96392ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:00.103359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-bd9a1050-c829-46b1-9505-9651f96392ac None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:00.104633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-bd9a1050-c829-46b1-9505-9651f96392ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:00.160527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac799-338b-43d7-a2ae-fc5b4eac7365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:00.161185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac799-338b-43d7-a2ae-fc5b4eac7365 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:00.161555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac799-338b-43d7-a2ae-fc5b4eac7365 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:00.161841 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac799-338b-43d7-a2ae-fc5b4eac7365 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:00.162609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfac799-338b-43d7-a2ae-fc5b4eac7365 None admin] RBAC: Adding query filter params (name=member) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:00.162934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfac799-338b-43d7-a2ae-fc5b4eac7365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:00.164388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfac799-338b-43d7-a2ae-fc5b4eac7365 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:00.185319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 74/142] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:01:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:00.190902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac799-338b-43d7-a2ae-fc5b4eac7365 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:00.214292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 69/143] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:00.254855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a1050-c829-46b1-9505-9651f96392ac None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:00.362995 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:00.401130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac799-338b-43d7-a2ae-fc5b4eac7365 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:00.469820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a1050-c829-46b1-9505-9651f96392ac None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:00.479291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3a232-905b-4e10-95cb-153fdffc22b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:00.480174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a232-905b-4e10-95cb-153fdffc22b8 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:00.480456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a232-905b-4e10-95cb-153fdffc22b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:00.480731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a232-905b-4e10-95cb-153fdffc22b8 None admin] PATH_INFO: `/v3/users/7b5047405b9548e5a14237010269640a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:00.482065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3a232-905b-4e10-95cb-153fdffc22b8 None admin] RBAC: Authorizing `identity:get_user(user_id=7b5047405b9548e5a14237010269640a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:00.483654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3a232-905b-4e10-95cb-153fdffc22b8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:00.490236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 75/144] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:00 2022] GET /identity/v3/users/7b5047405b9548e5a14237010269640a => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:00.491356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3a232-905b-4e10-95cb-153fdffc22b8 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:00.545013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63199c07-ea03-442c-a6e2-2b30f4fad184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:00.545877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63199c07-ea03-442c-a6e2-2b30f4fad184 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:00.546162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63199c07-ea03-442c-a6e2-2b30f4fad184 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:00.546435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63199c07-ea03-442c-a6e2-2b30f4fad184 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:00.550796 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63199c07-ea03-442c-a6e2-2b30f4fad184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:00.550987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:00.552271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63199c07-ea03-442c-a6e2-2b30f4fad184 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:00.554086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 70/145] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:00.559878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63199c07-ea03-442c-a6e2-2b30f4fad184 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:00.733659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3a232-905b-4e10-95cb-153fdffc22b8 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:00.812507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63199c07-ea03-442c-a6e2-2b30f4fad184 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:00.829876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4d0ea-08e1-469c-a4ed-ba0077284bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:00.830539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4d0ea-08e1-469c-a4ed-ba0077284bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:00.830852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4d0ea-08e1-469c-a4ed-ba0077284bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:00.831124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4d0ea-08e1-469c-a4ed-ba0077284bd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:00.848608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:00.903424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b1549-09e9-4a87-a9c3-a6cede1f4096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:00.904206 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b1549-09e9-4a87-a9c3-a6cede1f4096 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:00.904497 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b1549-09e9-4a87-a9c3-a6cede1f4096 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:00.904785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b1549-09e9-4a87-a9c3-a6cede1f4096 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:00.905526 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b1549-09e9-4a87-a9c3-a6cede1f4096 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:00.907014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b1549-09e9-4a87-a9c3-a6cede1f4096 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:00.946136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4d0ea-08e1-469c-a4ed-ba0077284bd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:00.947720 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4d0ea-08e1-469c-a4ed-ba0077284bd9 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:00.963054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 71/146] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:02:00 2022] POST /identity/v3/users => generated 283 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:02:00.991401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:01.111459 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 76/147] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:01.117310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b1549-09e9-4a87-a9c3-a6cede1f4096 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:01.254998 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b1549-09e9-4a87-a9c3-a6cede1f4096 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:01.301359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad6533-46dc-4f7e-ac64-fcac370d95af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:01.302235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad6533-46dc-4f7e-ac64-fcac370d95af None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:01.302522 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad6533-46dc-4f7e-ac64-fcac370d95af None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:01.302882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad6533-46dc-4f7e-ac64-fcac370d95af None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:01.304079 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad6533-46dc-4f7e-ac64-fcac370d95af None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:01.305551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad6533-46dc-4f7e-ac64-fcac370d95af None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:01.307292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 72/148] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:01 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:01.313705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4d0ea-08e1-469c-a4ed-ba0077284bd9 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:01.441895 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4d0ea-08e1-469c-a4ed-ba0077284bd9 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:01.472660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:01.486271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a42f6-413b-481c-bc5f-9ecd72fc707e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:01.486553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a42f6-413b-481c-bc5f-9ecd72fc707e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:01.486957 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a42f6-413b-481c-bc5f-9ecd72fc707e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:01.488254 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 73/149] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:02:01.488711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b82ce3-e57c-4988-a162-4bd914867b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:01.489430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b82ce3-e57c-4988-a162-4bd914867b93 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:01.489714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b82ce3-e57c-4988-a162-4bd914867b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:01.489992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b82ce3-e57c-4988-a162-4bd914867b93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:01.491117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b82ce3-e57c-4988-a162-4bd914867b93 None admin] RBAC: Adding query filter params (role.id=9eb3c16b00c04e1c850bab61de15c44c, scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6, user.id=7b5047405b9548e5a14237010269640a) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:01.491430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b82ce3-e57c-4988-a162-4bd914867b93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:01.492966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b82ce3-e57c-4988-a162-4bd914867b93 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:01.493551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19133-4c33-48c6-b5a1-c0805c3bad09 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:01.493882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19133-4c33-48c6-b5a1-c0805c3bad09 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:01.494170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19133-4c33-48c6-b5a1-c0805c3bad09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:01.504049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 77/150] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:01 2022] GET /identity/v3/role_assignments?user.id=7b5047405b9548e5a14237010269640a&scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6&role.id=9eb3c16b00c04e1c850bab61de15c44c => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:01.513677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f5b19133-4c33-48c6-b5a1-c0805c3bad09 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:01.514472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16067d59-2a64-441c-ac67-1eb839f62dcb None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:01.514784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f5b19133-4c33-48c6-b5a1-c0805c3bad09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:01.514907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16067d59-2a64-441c-ac67-1eb839f62dcb None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:01.515073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16067d59-2a64-441c-ac67-1eb839f62dcb None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:01.516709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 78/151] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:01.521876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613cdf8-1813-4a55-8dac-ede4861f62f5 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:01.522165 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613cdf8-1813-4a55-8dac-ede4861f62f5 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:01.522436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613cdf8-1813-4a55-8dac-ede4861f62f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:01.550541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:01.556003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d613cdf8-1813-4a55-8dac-ede4861f62f5 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:01.557246 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d613cdf8-1813-4a55-8dac-ede4861f62f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:01.599683 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 74/152] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:01.628122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b19133-4c33-48c6-b5a1-c0805c3bad09 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:01.712260 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 79/153] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:01.748776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b19133-4c33-48c6-b5a1-c0805c3bad09 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:01.755729 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613cdf8-1813-4a55-8dac-ede4861f62f5 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:01.787891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05597ca-cbd6-4c8c-9fa4-37f91db6d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:01.788908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05597ca-cbd6-4c8c-9fa4-37f91db6d147 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:01.789195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05597ca-cbd6-4c8c-9fa4-37f91db6d147 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:01.789470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05597ca-cbd6-4c8c-9fa4-37f91db6d147 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:01.802986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05597ca-cbd6-4c8c-9fa4-37f91db6d147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e05597ca-cbd6-4c8c-9fa4-37f91db6d147 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:01.812401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:01.814858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:01.816669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 75/154] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:02:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:01.822640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05597ca-cbd6-4c8c-9fa4-37f91db6d147 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:01.867058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:01.942982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613cdf8-1813-4a55-8dac-ede4861f62f5 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:01.964168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:01.993461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05597ca-cbd6-4c8c-9fa4-37f91db6d147 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:02.021168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555be33-42c0-455d-a6b1-9bd1df65be1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:02.022284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555be33-42c0-455d-a6b1-9bd1df65be1c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:02.022766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555be33-42c0-455d-a6b1-9bd1df65be1c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:02.023213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555be33-42c0-455d-a6b1-9bd1df65be1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:02.036183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cada8a-f6c4-45aa-a98a-f3b22b5e3732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:02.036853 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cada8a-f6c4-45aa-a98a-f3b22b5e3732 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:02.037134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cada8a-f6c4-45aa-a98a-f3b22b5e3732 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:02.037409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cada8a-f6c4-45aa-a98a-f3b22b5e3732 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:02.038212 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cada8a-f6c4-45aa-a98a-f3b22b5e3732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:02.038464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cada8a-f6c4-45aa-a98a-f3b22b5e3732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:02.040067 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cada8a-f6c4-45aa-a98a-f3b22b5e3732 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:02.050173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 76/155] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:02.055572 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555be33-42c0-455d-a6b1-9bd1df65be1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:02.055763 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cada8a-f6c4-45aa-a98a-f3b22b5e3732 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-2555be33-42c0-455d-a6b1-9bd1df65be1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:02.070644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:02.071708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:02.072557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:02.072557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:02.072557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:02.072557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:02.072557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:02.072557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:02.072557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:02.072557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:02.072557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:02.072557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:02.072557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:02.072557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:02.075239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 80/156] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:02:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:02.081997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555be33-42c0-455d-a6b1-9bd1df65be1c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:02.173800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cada8a-f6c4-45aa-a98a-f3b22b5e3732 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:02.199702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:02.215920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca843-b21f-4b44-8034-90859045a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:02.216810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca843-b21f-4b44-8034-90859045a57a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:02.217122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca843-b21f-4b44-8034-90859045a57a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:02.222267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca843-b21f-4b44-8034-90859045a57a None admin] PATH_INFO: `/v3/users/5f407cfabb074543a5e85c709d5e3a86` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:02.222267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ca843-b21f-4b44-8034-90859045a57a None admin] RBAC: Authorizing `identity:get_user(user_id=5f407cfabb074543a5e85c709d5e3a86)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:02.222267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ca843-b21f-4b44-8034-90859045a57a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:02.222514 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 77/157] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:02 2022] GET /identity/v3/users/5f407cfabb074543a5e85c709d5e3a86 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:02.230758 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca843-b21f-4b44-8034-90859045a57a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:02.330660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555be33-42c0-455d-a6b1-9bd1df65be1c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:02.397123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdee0c-7318-475f-b748-a60670beeced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:02.397948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdee0c-7318-475f-b748-a60670beeced None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:02.398234 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdee0c-7318-475f-b748-a60670beeced None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:02.398506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdee0c-7318-475f-b748-a60670beeced None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:02.399288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdee0c-7318-475f-b748-a60670beeced None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:02.399591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdee0c-7318-475f-b748-a60670beeced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:02.401677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdee0c-7318-475f-b748-a60670beeced None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:02.414680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 81/158] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:02.423892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdee0c-7318-475f-b748-a60670beeced None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:02.440903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca843-b21f-4b44-8034-90859045a57a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:02.494026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:02.500753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68f604-812d-4d57-8603-ffb8fc0425dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:02.501421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68f604-812d-4d57-8603-ffb8fc0425dc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:02.501708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68f604-812d-4d57-8603-ffb8fc0425dc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:02.501983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68f604-812d-4d57-8603-ffb8fc0425dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:02.549104 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:02.585896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdee0c-7318-475f-b748-a60670beeced None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:02.630004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70691ee7-1387-4d96-b70e-a689bccce860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:02.630905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70691ee7-1387-4d96-b70e-a689bccce860 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:02.631187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70691ee7-1387-4d96-b70e-a689bccce860 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:02.631462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70691ee7-1387-4d96-b70e-a689bccce860 None admin] PATH_INFO: `/v3/users/7b5047405b9548e5a14237010269640a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:02.636171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70691ee7-1387-4d96-b70e-a689bccce860 None admin] RBAC: Authorizing `identity:get_user(user_id=7b5047405b9548e5a14237010269640a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:02.640214 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70691ee7-1387-4d96-b70e-a689bccce860 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:02.641948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 82/159] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:02 2022] GET /identity/v3/users/7b5047405b9548e5a14237010269640a => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:02.643200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bacb7-5ab7-4178-84d4-cf754b76e6cd None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:02.643488 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bacb7-5ab7-4178-84d4-cf754b76e6cd None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:02.643763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bacb7-5ab7-4178-84d4-cf754b76e6cd None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:02.645176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 83/160] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:02.653788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63937107-b2a5-4190-a321-f483ff81ec56 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:02.657525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68f604-812d-4d57-8603-ffb8fc0425dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:02.659071 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68f604-812d-4d57-8603-ffb8fc0425dc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:02.660980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63937107-b2a5-4190-a321-f483ff81ec56 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:02.661296 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63937107-b2a5-4190-a321-f483ff81ec56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:02.696097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-63937107-b2a5-4190-a321-f483ff81ec56 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:02.697311 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-63937107-b2a5-4190-a321-f483ff81ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:02.818416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 78/161] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:02.819321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68f604-812d-4d57-8603-ffb8fc0425dc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:02.828324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 84/162] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:02.829207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63937107-b2a5-4190-a321-f483ff81ec56 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:02.881390 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:02.911660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:02.963559 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68f604-812d-4d57-8603-ffb8fc0425dc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:02.998234 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63937107-b2a5-4190-a321-f483ff81ec56 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:03.015499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b25d59-2a1d-43dc-99fd-8b17a01133d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:03.016467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b25d59-2a1d-43dc-99fd-8b17a01133d9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:03.016467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b25d59-2a1d-43dc-99fd-8b17a01133d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:03.016965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b25d59-2a1d-43dc-99fd-8b17a01133d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:03.077577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eec953-8827-40e7-b43f-d17d2f39a18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:03.078458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eec953-8827-40e7-b43f-d17d2f39a18c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:03.078767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eec953-8827-40e7-b43f-d17d2f39a18c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:03.079043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eec953-8827-40e7-b43f-d17d2f39a18c None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:03.083851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eec953-8827-40e7-b43f-d17d2f39a18c None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:03.087963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eec953-8827-40e7-b43f-d17d2f39a18c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:03.092710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 85/163] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:02 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:03.093627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eec953-8827-40e7-b43f-d17d2f39a18c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:03.133996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b25d59-2a1d-43dc-99fd-8b17a01133d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:03.136054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b25d59-2a1d-43dc-99fd-8b17a01133d9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:03.252840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:03.316639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eec953-8827-40e7-b43f-d17d2f39a18c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:03.338998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:03.379509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cf885-82c9-4ce6-ac9c-4bdea68418df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:03.380337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cf885-82c9-4ce6-ac9c-4bdea68418df None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:03.380631 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cf885-82c9-4ce6-ac9c-4bdea68418df None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:03.380886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cf885-82c9-4ce6-ac9c-4bdea68418df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:03.385428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 79/164] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:03.386328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b25d59-2a1d-43dc-99fd-8b17a01133d9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:03.402827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cf885-82c9-4ce6-ac9c-4bdea68418df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-496cf885-82c9-4ce6-ac9c-4bdea68418df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:03.415053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:03.415931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:03.416712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:03.416712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:03.416712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:03.416712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:03.416712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:03.416712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:03.416712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:03.416712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:03.416712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:03.416712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:03.416712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:03.416712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:03.418063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 86/165] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:03.418063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cf885-82c9-4ce6-ac9c-4bdea68418df None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:03.617394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cf885-82c9-4ce6-ac9c-4bdea68418df None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:03.644910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b25d59-2a1d-43dc-99fd-8b17a01133d9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:03.665263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40ce02-33e3-45fb-921d-5ea657c15b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:03.666501 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40ce02-33e3-45fb-921d-5ea657c15b02 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:03.667017 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40ce02-33e3-45fb-921d-5ea657c15b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:03.667501 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40ce02-33e3-45fb-921d-5ea657c15b02 None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:03.669077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40ce02-33e3-45fb-921d-5ea657c15b02 None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:03.670768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40ce02-33e3-45fb-921d-5ea657c15b02 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:03.672779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 87/166] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:03 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:03.673801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40ce02-33e3-45fb-921d-5ea657c15b02 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:03.722325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eb7a6-31e3-44e1-8cb5-79b962585abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:03.723031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eb7a6-31e3-44e1-8cb5-79b962585abf None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:03.723319 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eb7a6-31e3-44e1-8cb5-79b962585abf None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:03.723602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eb7a6-31e3-44e1-8cb5-79b962585abf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:03.724406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:03.724510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84eb7a6-31e3-44e1-8cb5-79b962585abf None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6, user.id=5f407cfabb074543a5e85c709d5e3a86) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:03.724754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84eb7a6-31e3-44e1-8cb5-79b962585abf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:03.726213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84eb7a6-31e3-44e1-8cb5-79b962585abf None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:03.745174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 80/167] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:03 2022] GET /identity/v3/role_assignments?user.id=5f407cfabb074543a5e85c709d5e3a86&scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6&role.id=6fcc322b483a475399974562c1e5bd43 => generated 608 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:03.746096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eb7a6-31e3-44e1-8cb5-79b962585abf None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:03.797498 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:03.807280 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40ce02-33e3-45fb-921d-5ea657c15b02 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:03.846592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e23105-10df-4907-a33d-ae797e167a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:03.848175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23105-10df-4907-a33d-ae797e167a4c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:03.848655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23105-10df-4907-a33d-ae797e167a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:03.849127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23105-10df-4907-a33d-ae797e167a4c None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:03.850074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e23105-10df-4907-a33d-ae797e167a4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:03.850592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e23105-10df-4907-a33d-ae797e167a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:03.852208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e23105-10df-4907-a33d-ae797e167a4c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:03.862574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 88/168] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:03.864349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2a393-6aa0-4a34-b5c3-0299b0565d6e None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:03.864843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2a393-6aa0-4a34-b5c3-0299b0565d6e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:03.865316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2a393-6aa0-4a34-b5c3-0299b0565d6e None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:03.867109 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 89/169] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:03.875376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df797c04-5c3f-41fd-9ca1-8286e5f9ae62 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:03.876013 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df797c04-5c3f-41fd-9ca1-8286e5f9ae62 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:03.876489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df797c04-5c3f-41fd-9ca1-8286e5f9ae62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:03.904822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-df797c04-5c3f-41fd-9ca1-8286e5f9ae62 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:03.906357 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-df797c04-5c3f-41fd-9ca1-8286e5f9ae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:03.933943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eb7a6-31e3-44e1-8cb5-79b962585abf None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:03.999252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e63a74-bace-4d7b-b17e-6c5bd8d2b009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:03.999252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e63a74-bace-4d7b-b17e-6c5bd8d2b009 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:03.999252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e63a74-bace-4d7b-b17e-6c5bd8d2b009 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:03.999252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e63a74-bace-4d7b-b17e-6c5bd8d2b009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:03.999663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e63a74-bace-4d7b-b17e-6c5bd8d2b009 None admin] RBAC: Adding query filter params (role.id=8d803b40a63540ba80e3039f16774d46, scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6, user.id=7b5047405b9548e5a14237010269640a) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:03.999663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e63a74-bace-4d7b-b17e-6c5bd8d2b009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:04.000019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e63a74-bace-4d7b-b17e-6c5bd8d2b009 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:04.010681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 81/170] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:03 2022] GET /identity/v3/role_assignments?user.id=7b5047405b9548e5a14237010269640a&scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6&role.id=8d803b40a63540ba80e3039f16774d46 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:04.019623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e63a74-bace-4d7b-b17e-6c5bd8d2b009 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:04.026818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 90/171] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:04.069686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df797c04-5c3f-41fd-9ca1-8286e5f9ae62 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:04.123833 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:04.171139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:04.195235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e63a74-bace-4d7b-b17e-6c5bd8d2b009 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:04.246254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df797c04-5c3f-41fd-9ca1-8286e5f9ae62 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:04.249937 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea22398-73d7-4735-a755-7bb8bbe456d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:04.250855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea22398-73d7-4735-a755-7bb8bbe456d6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:04.251143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea22398-73d7-4735-a755-7bb8bbe456d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:04.251419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea22398-73d7-4735-a755-7bb8bbe456d6 None admin] PATH_INFO: `/v3/users/7b5047405b9548e5a14237010269640a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:04.252657 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea22398-73d7-4735-a755-7bb8bbe456d6 None admin] RBAC: Authorizing `identity:get_user(user_id=7b5047405b9548e5a14237010269640a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:04.254152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea22398-73d7-4735-a755-7bb8bbe456d6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:04.256133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 82/172] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:04 2022] GET /identity/v3/users/7b5047405b9548e5a14237010269640a => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:04.261533 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea22398-73d7-4735-a755-7bb8bbe456d6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:04.290314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bd512-699f-44cf-abbe-0d95292c9cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:04.291193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bd512-699f-44cf-abbe-0d95292c9cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:04.291475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bd512-699f-44cf-abbe-0d95292c9cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:04.291753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bd512-699f-44cf-abbe-0d95292c9cb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:04.314782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bd512-699f-44cf-abbe-0d95292c9cb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-fa8bd512-699f-44cf-abbe-0d95292c9cb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:04.325055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:04.326513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:04.327348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 91/173] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:04.334555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bd512-699f-44cf-abbe-0d95292c9cb4 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:04.441856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea22398-73d7-4735-a755-7bb8bbe456d6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:04.487437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d29fc-5d6d-476a-b6d9-9a90497b69e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:04.488198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d29fc-5d6d-476a-b6d9-9a90497b69e9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:04.488528 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d29fc-5d6d-476a-b6d9-9a90497b69e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:04.488802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d29fc-5d6d-476a-b6d9-9a90497b69e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:04.494529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:04.517923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:04.524697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bd512-699f-44cf-abbe-0d95292c9cb4 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:04.565164 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd7ed1-5d05-4171-a079-19219b3c86fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:04.566385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd7ed1-5d05-4171-a079-19219b3c86fc None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:04.566903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd7ed1-5d05-4171-a079-19219b3c86fc None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:04.567368 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd7ed1-5d05-4171-a079-19219b3c86fc None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:04.568329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd7ed1-5d05-4171-a079-19219b3c86fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:04.568897 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd7ed1-5d05-4171-a079-19219b3c86fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:04.570577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd7ed1-5d05-4171-a079-19219b3c86fc None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:04.579861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d29fc-5d6d-476a-b6d9-9a90497b69e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:04.580807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 92/174] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:04.582237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d29fc-5d6d-476a-b6d9-9a90497b69e9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:04.583136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdd1ae-e871-4dec-8bc8-06eb4a5d8e24 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:04.583711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdd1ae-e871-4dec-8bc8-06eb4a5d8e24 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:04.584190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdd1ae-e871-4dec-8bc8-06eb4a5d8e24 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:04.585675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 93/175] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:04.592620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8082b-56a8-4520-af24-d7bc27b7b9a8 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:04.592910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8082b-56a8-4520-af24-d7bc27b7b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:04.593190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8082b-56a8-4520-af24-d7bc27b7b9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:04.612533 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-35c8082b-56a8-4520-af24-d7bc27b7b9a8 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:04.613874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-35c8082b-56a8-4520-af24-d7bc27b7b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:04.690695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 83/176] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 08:02:04.695867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d29fc-5d6d-476a-b6d9-9a90497b69e9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:04.709090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 94/177] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:04.711299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8082b-56a8-4520-af24-d7bc27b7b9a8 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:04.779680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:04.807353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:04.834418 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8082b-56a8-4520-af24-d7bc27b7b9a8 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:04.835248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d29fc-5d6d-476a-b6d9-9a90497b69e9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:04.873766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535da7d-40d5-42b4-b8e1-939b234c5aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:04.874748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7470ea4-60b0-429b-9720-05fcd7724536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:04.874890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535da7d-40d5-42b4-b8e1-939b234c5aad None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:04.875227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535da7d-40d5-42b4-b8e1-939b234c5aad None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:04.875511 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535da7d-40d5-42b4-b8e1-939b234c5aad None admin] PATH_INFO: `/v3/projects/a1e170b0ff5f45fcb7f56c14ee3734fa` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:04.875764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7470ea4-60b0-429b-9720-05fcd7724536 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:04.876045 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7470ea4-60b0-429b-9720-05fcd7724536 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:04.876420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7470ea4-60b0-429b-9720-05fcd7724536 None admin] PATH_INFO: `/v3/users/f6e24804f65f440cb9dc77d13c05b38f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:04.876878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535da7d-40d5-42b4-b8e1-939b234c5aad None admin] RBAC: Authorizing `identity:get_project(project_id=a1e170b0ff5f45fcb7f56c14ee3734fa)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:04.877649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7470ea4-60b0-429b-9720-05fcd7724536 None admin] RBAC: Authorizing `identity:get_user(user_id=f6e24804f65f440cb9dc77d13c05b38f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:04.878443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535da7d-40d5-42b4-b8e1-939b234c5aad None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:04.879131 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7470ea4-60b0-429b-9720-05fcd7724536 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:04.880758 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 84/179] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:04 2022] GET /identity/v3/users/f6e24804f65f440cb9dc77d13c05b38f => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:04.881515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7470ea4-60b0-429b-9720-05fcd7724536 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:04.885102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 95/179] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:04 2022] GET /identity/v3/projects/a1e170b0ff5f45fcb7f56c14ee3734fa => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:04.886508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535da7d-40d5-42b4-b8e1-939b234c5aad None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:04.996691 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535da7d-40d5-42b4-b8e1-939b234c5aad None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:04.999705 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7470ea4-60b0-429b-9720-05fcd7724536 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:05.022023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:05.035422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f967eec-2fe9-43c7-81f1-b06909145279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:05.036193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f967eec-2fe9-43c7-81f1-b06909145279 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.036591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f967eec-2fe9-43c7-81f1-b06909145279 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.036964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f967eec-2fe9-43c7-81f1-b06909145279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.037807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f967eec-2fe9-43c7-81f1-b06909145279 None admin] RBAC: Adding query filter params (role.id=9eb3c16b00c04e1c850bab61de15c44c, scope.project.id=a1e170b0ff5f45fcb7f56c14ee3734fa, user.id=7b5047405b9548e5a14237010269640a) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:05.038128 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f967eec-2fe9-43c7-81f1-b06909145279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:05.038871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76cfe9-da19-4cb1-a169-1b4afcbd0c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:05.039745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76cfe9-da19-4cb1-a169-1b4afcbd0c04 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.039919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f967eec-2fe9-43c7-81f1-b06909145279 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:05.040165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76cfe9-da19-4cb1-a169-1b4afcbd0c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.040510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76cfe9-da19-4cb1-a169-1b4afcbd0c04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.050795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 96/180] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:04 2022] GET /identity/v3/role_assignments?user.id=7b5047405b9548e5a14237010269640a&scope.project.id=a1e170b0ff5f45fcb7f56c14ee3734fa&role.id=9eb3c16b00c04e1c850bab61de15c44c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:05.051697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f967eec-2fe9-43c7-81f1-b06909145279 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:05.066194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76cfe9-da19-4cb1-a169-1b4afcbd0c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:05.075590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-da76cfe9-da19-4cb1-a169-1b4afcbd0c04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:05.079878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:05.081720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:05.082736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 85/181] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:02:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:05.091007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76cfe9-da19-4cb1-a169-1b4afcbd0c04 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:05.197575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f967eec-2fe9-43c7-81f1-b06909145279 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:05.238136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072fee5-f67a-4d86-81a1-23ab2c753154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:05.239045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072fee5-f67a-4d86-81a1-23ab2c753154 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.239331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072fee5-f67a-4d86-81a1-23ab2c753154 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.239613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072fee5-f67a-4d86-81a1-23ab2c753154 None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.241658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072fee5-f67a-4d86-81a1-23ab2c753154 None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:05.243285 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072fee5-f67a-4d86-81a1-23ab2c753154 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:05.245341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 97/182] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:05 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:05.246822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeeb93-c779-4d75-84c9-0654c81c8b5c None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.247096 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeeb93-c779-4d75-84c9-0654c81c8b5c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.247307 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeeb93-c779-4d75-84c9-0654c81c8b5c None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.248851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 98/183] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:05.251169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeeb93-c779-4d75-84c9-0654c81c8b5c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:05.300358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76cfe9-da19-4cb1-a169-1b4afcbd0c04 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:05.339092 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a3302-a6ce-4f5c-aede-d524ff1917f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:05.340675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a3302-a6ce-4f5c-aede-d524ff1917f0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.341021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a3302-a6ce-4f5c-aede-d524ff1917f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.342048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a3302-a6ce-4f5c-aede-d524ff1917f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.342829 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a3302-a6ce-4f5c-aede-d524ff1917f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:05.343134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a3302-a6ce-4f5c-aede-d524ff1917f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:05.344523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a3302-a6ce-4f5c-aede-d524ff1917f0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:05.346557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:05.353002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 86/184] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:05.353002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a309b3-3301-46bf-9b8b-4a6b2c7d2239 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.353002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a309b3-3301-46bf-9b8b-4a6b2c7d2239 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.353002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a309b3-3301-46bf-9b8b-4a6b2c7d2239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.370922 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-29a309b3-3301-46bf-9b8b-4a6b2c7d2239 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:05.372125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-29a309b3-3301-46bf-9b8b-4a6b2c7d2239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:05.374307 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeeb93-c779-4d75-84c9-0654c81c8b5c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:05.406899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:05.409702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e6b2d-5565-40ce-9e88-9352e95ba559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:05.410610 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e6b2d-5565-40ce-9e88-9352e95ba559 None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.410921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e6b2d-5565-40ce-9e88-9352e95ba559 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.411195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e6b2d-5565-40ce-9e88-9352e95ba559 None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6/users/f6e24804f65f440cb9dc77d13c05b38f/roles/10b654dbef184b75888fa0bbd288b1c2` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.413147 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e6b2d-5565-40ce-9e88-9352e95ba559 None admin] RBAC: Authorizing `identity:create_grant(project_id=989c7a7c2f7f49e5be8e751b4ec32db6, user_id=f6e24804f65f440cb9dc77d13c05b38f, role_id=10b654dbef184b75888fa0bbd288b1c2)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:05.414690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e6b2d-5565-40ce-9e88-9352e95ba559 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:05.426553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 99/185] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:02:05 2022] PUT /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6/users/f6e24804f65f440cb9dc77d13c05b38f/roles/10b654dbef184b75888fa0bbd288b1c2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:05.427814 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea375393-9562-4779-beed-74da14b10e52 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.428101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea375393-9562-4779-beed-74da14b10e52 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.428377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea375393-9562-4779-beed-74da14b10e52 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.429864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 100/186] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:05.430377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea375393-9562-4779-beed-74da14b10e52 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:05.441269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 87/187] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:05.443040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4bea0-3907-40f8-a743-755a134492c9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.443538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4bea0-3907-40f8-a743-755a134492c9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.444127 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4bea0-3907-40f8-a743-755a134492c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.470519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-65c4bea0-3907-40f8-a743-755a134492c9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:05.471747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-65c4bea0-3907-40f8-a743-755a134492c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:05.558725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 88/188] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:05.558725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4bea0-3907-40f8-a743-755a134492c9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:05.593966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea375393-9562-4779-beed-74da14b10e52 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:05.631319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c64e3a-eff9-466d-9498-f2ca8c8c855a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:05.632779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c64e3a-eff9-466d-9498-f2ca8c8c855a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.633067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c64e3a-eff9-466d-9498-f2ca8c8c855a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.633343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c64e3a-eff9-466d-9498-f2ca8c8c855a None admin] PATH_INFO: `/v3/users/b5956277e8aa4e64bb2dba260907abcb` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.635892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:05.655316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c64e3a-eff9-466d-9498-f2ca8c8c855a None admin] RBAC: Authorizing `identity:get_user(user_id=b5956277e8aa4e64bb2dba260907abcb)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:05.657329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c64e3a-eff9-466d-9498-f2ca8c8c855a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:05.660348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 101/189] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:05 2022] GET /identity/v3/users/b5956277e8aa4e64bb2dba260907abcb => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:05.661977 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c64e3a-eff9-466d-9498-f2ca8c8c855a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:05.673678 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4bea0-3907-40f8-a743-755a134492c9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:05.675396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:05.709982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f7a61-689b-4b2c-bfdb-cf97551bf6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:05.711132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f7a61-689b-4b2c-bfdb-cf97551bf6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.711413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f7a61-689b-4b2c-bfdb-cf97551bf6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.711685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f7a61-689b-4b2c-bfdb-cf97551bf6d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.713043 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f7a61-689b-4b2c-bfdb-cf97551bf6d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:05.714499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f7a61-689b-4b2c-bfdb-cf97551bf6d3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:05.716994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 89/190] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:05.720060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f7a61-689b-4b2c-bfdb-cf97551bf6d3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:05.769789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c64e3a-eff9-466d-9498-f2ca8c8c855a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:05.808264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a8587-8fb6-45ec-a28d-5ea62041130d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:05.809971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a8587-8fb6-45ec-a28d-5ea62041130d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.810232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a8587-8fb6-45ec-a28d-5ea62041130d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.810656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a8587-8fb6-45ec-a28d-5ea62041130d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.821791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a8587-8fb6-45ec-a28d-5ea62041130d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:05.824078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f7a61-689b-4b2c-bfdb-cf97551bf6d3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-364a8587-8fb6-45ec-a28d-5ea62041130d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:05.829933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:05.830843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 102/191] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:02:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:05.836854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a8587-8fb6-45ec-a28d-5ea62041130d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:05.866204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34152e20-c291-4226-9aee-610482c0dc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:05.866883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34152e20-c291-4226-9aee-610482c0dc58 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.867166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34152e20-c291-4226-9aee-610482c0dc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.867438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34152e20-c291-4226-9aee-610482c0dc58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.892243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:05.911022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:05.942600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a8587-8fb6-45ec-a28d-5ea62041130d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:05.943235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34152e20-c291-4226-9aee-610482c0dc58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:05.944713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34152e20-c291-4226-9aee-610482c0dc58 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:05.985147 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b762a1-1399-44c0-bbd5-8064d7ba352b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:05.986143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b762a1-1399-44c0-bbd5-8064d7ba352b None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:05.987090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b762a1-1399-44c0-bbd5-8064d7ba352b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:05.987553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b762a1-1399-44c0-bbd5-8064d7ba352b None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:05.988853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b762a1-1399-44c0-bbd5-8064d7ba352b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:05.991287 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b762a1-1399-44c0-bbd5-8064d7ba352b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:06.015153 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 103/192] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:02:05 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:02:06.016198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b762a1-1399-44c0-bbd5-8064d7ba352b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:06.071557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 90/193] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:06.085695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34152e20-c291-4226-9aee-610482c0dc58 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:06.159671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b762a1-1399-44c0-bbd5-8064d7ba352b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:06.172418 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:06.176776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:06.215350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44739a4-a173-4428-b9c3-72a3cb398e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:06.216115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44739a4-a173-4428-b9c3-72a3cb398e8a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:06.216394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44739a4-a173-4428-b9c3-72a3cb398e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:06.216669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44739a4-a173-4428-b9c3-72a3cb398e8a None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:06.217427 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44739a4-a173-4428-b9c3-72a3cb398e8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:06.218280 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44739a4-a173-4428-b9c3-72a3cb398e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:06.219158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44739a4-a173-4428-b9c3-72a3cb398e8a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:06.228414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 104/194] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:06.228977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34152e20-c291-4226-9aee-610482c0dc58 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:06.234569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44739a4-a173-4428-b9c3-72a3cb398e8a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:06.272055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b9e8e-ff79-44aa-854f-d936a249f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:06.273318 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b9e8e-ff79-44aa-854f-d936a249f112 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:06.273829 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b9e8e-ff79-44aa-854f-d936a249f112 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:06.274316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b9e8e-ff79-44aa-854f-d936a249f112 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:06.275808 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b9e8e-ff79-44aa-854f-d936a249f112 None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:06.277491 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b9e8e-ff79-44aa-854f-d936a249f112 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:06.279839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 91/195] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:06 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:06.285683 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b9e8e-ff79-44aa-854f-d936a249f112 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:06.374762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44739a4-a173-4428-b9c3-72a3cb398e8a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:06.411457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b9e8e-ff79-44aa-854f-d936a249f112 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:06.415406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282b1af-d779-4329-bb3c-864d68398bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:06.416277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282b1af-d779-4329-bb3c-864d68398bae None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:06.416558 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282b1af-d779-4329-bb3c-864d68398bae None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:06.416831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282b1af-d779-4329-bb3c-864d68398bae None admin] PATH_INFO: `/v3/users/b5956277e8aa4e64bb2dba260907abcb` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:06.418039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282b1af-d779-4329-bb3c-864d68398bae None admin] RBAC: Authorizing `identity:get_user(user_id=b5956277e8aa4e64bb2dba260907abcb)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:06.419787 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282b1af-d779-4329-bb3c-864d68398bae None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:06.421666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 105/196] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:06 2022] GET /identity/v3/users/b5956277e8aa4e64bb2dba260907abcb => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:06.426839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282b1af-d779-4329-bb3c-864d68398bae None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:06.453287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225b35-f03a-4570-aa2b-c3719ec1a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:06.454285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225b35-f03a-4570-aa2b-c3719ec1a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:06.454777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225b35-f03a-4570-aa2b-c3719ec1a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:06.455404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225b35-f03a-4570-aa2b-c3719ec1a2c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:06.456550 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b225b35-f03a-4570-aa2b-c3719ec1a2c6 None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=5270bea9dd60407aa2ea22723624bbef, user.id=b5956277e8aa4e64bb2dba260907abcb) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:06.458956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b225b35-f03a-4570-aa2b-c3719ec1a2c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:06.460695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b225b35-f03a-4570-aa2b-c3719ec1a2c6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:06.473278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:06.475555 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 92/197] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:06 2022] GET /identity/v3/role_assignments?user.id=b5956277e8aa4e64bb2dba260907abcb&scope.project.id=5270bea9dd60407aa2ea22723624bbef&role.id=6fcc322b483a475399974562c1e5bd43 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:06.601375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282b1af-d779-4329-bb3c-864d68398bae None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:06.661674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4383-20a8-499c-b189-4ceacf896526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:06.662679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4383-20a8-499c-b189-4ceacf896526 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:06.663161 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4383-20a8-499c-b189-4ceacf896526 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:06.663631 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4383-20a8-499c-b189-4ceacf896526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:06.740477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae4383-20a8-499c-b189-4ceacf896526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:06.742220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae4383-20a8-499c-b189-4ceacf896526 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:06.788772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:06.858209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 106/198] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 08:02:06.859474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225b35-f03a-4570-aa2b-c3719ec1a2c6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:06.870950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:06.995733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225b35-f03a-4570-aa2b-c3719ec1a2c6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:07.046401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbe539-17fb-4782-aeab-31c5741087ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:07.047301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbe539-17fb-4782-aeab-31c5741087ad None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:07.047587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbe539-17fb-4782-aeab-31c5741087ad None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:07.047923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbe539-17fb-4782-aeab-31c5741087ad None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:07.049206 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbe539-17fb-4782-aeab-31c5741087ad None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:07.055803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbe539-17fb-4782-aeab-31c5741087ad None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:07.057865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 93/199] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:06 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:07.063970 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4383-20a8-499c-b189-4ceacf896526 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:07.222076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4383-20a8-499c-b189-4ceacf896526 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:07.272862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aeb7b4-853a-4641-910d-726f00cffc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:07.273447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aeb7b4-853a-4641-910d-726f00cffc11 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:07.273732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aeb7b4-853a-4641-910d-726f00cffc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:07.274009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aeb7b4-853a-4641-910d-726f00cffc11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:07.274877 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aeb7b4-853a-4641-910d-726f00cffc11 None admin] RBAC: Adding query filter params (role.id=8d803b40a63540ba80e3039f16774d46, scope.project.id=5270bea9dd60407aa2ea22723624bbef, user.id=b5956277e8aa4e64bb2dba260907abcb) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:07.275195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aeb7b4-853a-4641-910d-726f00cffc11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:07.276637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aeb7b4-853a-4641-910d-726f00cffc11 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:07.283806 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 107/200] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:07 2022] GET /identity/v3/role_assignments?user.id=b5956277e8aa4e64bb2dba260907abcb&scope.project.id=5270bea9dd60407aa2ea22723624bbef&role.id=8d803b40a63540ba80e3039f16774d46 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:07.869063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e2868-f742-42a3-99e5-ee0357f6a632 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:07.869549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e2868-f742-42a3-99e5-ee0357f6a632 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:07.869549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e2868-f742-42a3-99e5-ee0357f6a632 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:07.870960 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 94/201] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:07.888956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa1bd8-74a4-4e78-b58d-3d270e1cdf4a None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:07.889283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa1bd8-74a4-4e78-b58d-3d270e1cdf4a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:07.889524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa1bd8-74a4-4e78-b58d-3d270e1cdf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:07.894874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:07.911684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-beaa1bd8-74a4-4e78-b58d-3d270e1cdf4a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:07.912888 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-beaa1bd8-74a4-4e78-b58d-3d270e1cdf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:07.997459 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 108/202] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:08.020874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e2868-f742-42a3-99e5-ee0357f6a632 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:08.118980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:08.159947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e2868-f742-42a3-99e5-ee0357f6a632 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:08.212688 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230ce01-7b0c-44d8-9e89-c5a7bf6eb40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:08.213492 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230ce01-7b0c-44d8-9e89-c5a7bf6eb40c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:08.213785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230ce01-7b0c-44d8-9e89-c5a7bf6eb40c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:08.214064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230ce01-7b0c-44d8-9e89-c5a7bf6eb40c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:08.227675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230ce01-7b0c-44d8-9e89-c5a7bf6eb40c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-9230ce01-7b0c-44d8-9e89-c5a7bf6eb40c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:08.236790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:08.237692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:08.238475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:08.238475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:08.238475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:08.238475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:08.238475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:08.238475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:08.238475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:08.238475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:08.238475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:08.238475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:08.238475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:08.238475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:08.245166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 95/203] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:08.252093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa1bd8-74a4-4e78-b58d-3d270e1cdf4a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:08.411888 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa1bd8-74a4-4e78-b58d-3d270e1cdf4a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:08.457184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4fb6c-9dd5-4442-bb63-dab3d2daa369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:08.457865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4fb6c-9dd5-4442-bb63-dab3d2daa369 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:08.458147 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4fb6c-9dd5-4442-bb63-dab3d2daa369 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:08.458422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4fb6c-9dd5-4442-bb63-dab3d2daa369 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:08.459216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4fb6c-9dd5-4442-bb63-dab3d2daa369 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:08.459717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:08.460169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4fb6c-9dd5-4442-bb63-dab3d2daa369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:08.461741 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4fb6c-9dd5-4442-bb63-dab3d2daa369 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:08.472784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 109/204] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:08.479753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230ce01-7b0c-44d8-9e89-c5a7bf6eb40c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:08.650033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230ce01-7b0c-44d8-9e89-c5a7bf6eb40c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:08.686888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:08.692605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7cece-d185-45d7-8426-dc8641bd167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:08.693718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7cece-d185-45d7-8426-dc8641bd167d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:08.694008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7cece-d185-45d7-8426-dc8641bd167d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:08.694342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7cece-d185-45d7-8426-dc8641bd167d None admin] PATH_INFO: `/v3/users/f6e24804f65f440cb9dc77d13c05b38f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:08.699375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7cece-d185-45d7-8426-dc8641bd167d None admin] RBAC: Authorizing `identity:get_user(user_id=f6e24804f65f440cb9dc77d13c05b38f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:08.701601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7cece-d185-45d7-8426-dc8641bd167d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:08.703650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 96/205] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:08 2022] GET /identity/v3/users/f6e24804f65f440cb9dc77d13c05b38f => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:08.709501 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4fb6c-9dd5-4442-bb63-dab3d2daa369 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:08.737404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb63ec-0ba4-4cb8-9769-ffda8f3f9aa7 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:08.737721 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb63ec-0ba4-4cb8-9769-ffda8f3f9aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:08.737965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb63ec-0ba4-4cb8-9769-ffda8f3f9aa7 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:08.739512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 97/206] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:08.744717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a40f5-b2e3-48b3-aab8-a6426b69cb3f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:08.745007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a40f5-b2e3-48b3-aab8-a6426b69cb3f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:08.745291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a40f5-b2e3-48b3-aab8-a6426b69cb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:08.763904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a83a40f5-b2e3-48b3-aab8-a6426b69cb3f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:08.765303 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a83a40f5-b2e3-48b3-aab8-a6426b69cb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:08.842775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4fb6c-9dd5-4442-bb63-dab3d2daa369 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:08.883023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d9d1d-deed-429a-ad7a-fcf1cf916bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:08.884021 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d9d1d-deed-429a-ad7a-fcf1cf916bce None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:08.884501 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d9d1d-deed-429a-ad7a-fcf1cf916bce None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:08.884974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d9d1d-deed-429a-ad7a-fcf1cf916bce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:08.900204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 98/207] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:08.945424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a40f5-b2e3-48b3-aab8-a6426b69cb3f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:08.958696 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:08.977532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d9d1d-deed-429a-ad7a-fcf1cf916bce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:08.979456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d9d1d-deed-429a-ad7a-fcf1cf916bce None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:09.084652 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a40f5-b2e3-48b3-aab8-a6426b69cb3f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:09.093264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 110/208] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:09.099049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d80ec-ae97-41b0-8f63-297e9331114e None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.099340 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d80ec-ae97-41b0-8f63-297e9331114e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.099626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d80ec-ae97-41b0-8f63-297e9331114e None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.101053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 111/209] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:09.101985 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a053-ac16-4bfa-9ccb-5ab57c3552b7 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.102268 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a053-ac16-4bfa-9ccb-5ab57c3552b7 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.102542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a053-ac16-4bfa-9ccb-5ab57c3552b7 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.106929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 112/210] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:09.106929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97a053-ac16-4bfa-9ccb-5ab57c3552b7 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:09.120802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:09.129131 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca7e5f-bc67-4f0e-abc1-101730c93681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:09.129927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca7e5f-bc67-4f0e-abc1-101730c93681 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.130209 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca7e5f-bc67-4f0e-abc1-101730c93681 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.130503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca7e5f-bc67-4f0e-abc1-101730c93681 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.131716 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca7e5f-bc67-4f0e-abc1-101730c93681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:09.133190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca7e5f-bc67-4f0e-abc1-101730c93681 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:09.134856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 99/211] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:09.136016 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e770010-0b06-43c9-bd9b-84b701dd526a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.136309 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e770010-0b06-43c9-bd9b-84b701dd526a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.136576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e770010-0b06-43c9-bd9b-84b701dd526a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.154819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9e770010-0b06-43c9-bd9b-84b701dd526a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:09.156007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9e770010-0b06-43c9-bd9b-84b701dd526a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:09.225256 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 100/212] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:09.226827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc8a36-c176-42de-be82-ab638a19f22d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.227238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc8a36-c176-42de-be82-ab638a19f22d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.227576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc8a36-c176-42de-be82-ab638a19f22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.241584 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:09.251448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97a053-ac16-4bfa-9ccb-5ab57c3552b7 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:09.252633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9acc8a36-c176-42de-be82-ab638a19f22d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:09.254168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9acc8a36-c176-42de-be82-ab638a19f22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:09.289332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f7f10-37d0-4704-9fcd-ce2f34582c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:09.290893 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f7f10-37d0-4704-9fcd-ce2f34582c0f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.291379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f7f10-37d0-4704-9fcd-ce2f34582c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.291854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f7f10-37d0-4704-9fcd-ce2f34582c0f None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.293259 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f7f10-37d0-4704-9fcd-ce2f34582c0f None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:09.295025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f7f10-37d0-4704-9fcd-ce2f34582c0f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:09.296967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 113/213] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:09 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:09.297902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f7f10-37d0-4704-9fcd-ce2f34582c0f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:09.334955 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 101/214] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:09.343509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc8a36-c176-42de-be82-ab638a19f22d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:09.407736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:09.412910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f7f10-37d0-4704-9fcd-ce2f34582c0f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:09.449346 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aee2b-a58b-4c26-95e0-807cfcf7df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:09.450230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aee2b-a58b-4c26-95e0-807cfcf7df8e None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.450531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aee2b-a58b-4c26-95e0-807cfcf7df8e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.450839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aee2b-a58b-4c26-95e0-807cfcf7df8e None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.451551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0aee2b-a58b-4c26-95e0-807cfcf7df8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:09.453018 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0aee2b-a58b-4c26-95e0-807cfcf7df8e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:09.458774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc8a36-c176-42de-be82-ab638a19f22d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:09.480403 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 114/215] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:02:09 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:02:09.488315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aee2b-a58b-4c26-95e0-807cfcf7df8e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:09.504611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df328830-2122-42c1-8e3e-ac5c715d3df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:09.506042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df328830-2122-42c1-8e3e-ac5c715d3df7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.506544 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df328830-2122-42c1-8e3e-ac5c715d3df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.507095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df328830-2122-42c1-8e3e-ac5c715d3df7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.519052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:09.521515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df328830-2122-42c1-8e3e-ac5c715d3df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-df328830-2122-42c1-8e3e-ac5c715d3df7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:09.533736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:09.534734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:09.535543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:09.535543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:09.535543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:09.535543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:09.535543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:09.535543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:09.535543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:09.535543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:09.535543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:09.535543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:09.535543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:09.535543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:09.538192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 102/216] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:09.540234 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df328830-2122-42c1-8e3e-ac5c715d3df7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:09.618318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aee2b-a58b-4c26-95e0-807cfcf7df8e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:09.662951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea82795-669f-4df6-b330-19ea010ddd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:09.664303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea82795-669f-4df6-b330-19ea010ddd4b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.664303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea82795-669f-4df6-b330-19ea010ddd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.664303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea82795-669f-4df6-b330-19ea010ddd4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.665123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea82795-669f-4df6-b330-19ea010ddd4b None admin] RBAC: Adding query filter params (role.id=10b654dbef184b75888fa0bbd288b1c2, scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6, user.id=f6e24804f65f440cb9dc77d13c05b38f) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:09.665440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea82795-669f-4df6-b330-19ea010ddd4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:09.667040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea82795-669f-4df6-b330-19ea010ddd4b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:09.676664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 115/217] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:09 2022] GET /identity/v3/role_assignments?user.id=f6e24804f65f440cb9dc77d13c05b38f&scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6&role.id=10b654dbef184b75888fa0bbd288b1c2 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:09.677890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea82795-669f-4df6-b330-19ea010ddd4b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:09.687641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df328830-2122-42c1-8e3e-ac5c715d3df7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:09.708340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:09.730242 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a4f4-51ff-4de4-9924-09c66be4a210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:09.731921 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a4f4-51ff-4de4-9924-09c66be4a210 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.732248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a4f4-51ff-4de4-9924-09c66be4a210 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.732627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a4f4-51ff-4de4-9924-09c66be4a210 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.748830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411a4f4-51ff-4de4-9924-09c66be4a210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-5411a4f4-51ff-4de4-9924-09c66be4a210 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:09.758243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:09.759261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:09.760057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 103/218] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:02:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:09.767972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a4f4-51ff-4de4-9924-09c66be4a210 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:09.800048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:09.829895 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea82795-669f-4df6-b330-19ea010ddd4b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:09.896003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ae3b-c36b-4573-b409-603e58ed17d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:09.896720 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ae3b-c36b-4573-b409-603e58ed17d0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.897005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ae3b-c36b-4573-b409-603e58ed17d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.897285 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ae3b-c36b-4573-b409-603e58ed17d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.898053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787ae3b-c36b-4573-b409-603e58ed17d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:09.898363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787ae3b-c36b-4573-b409-603e58ed17d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:09.899812 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787ae3b-c36b-4573-b409-603e58ed17d0 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:09.910237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a4f4-51ff-4de4-9924-09c66be4a210 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:09.913343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 116/219] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:09.914591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5516de-36b5-4ead-84a4-6a1800018191 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.916062 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5516de-36b5-4ead-84a4-6a1800018191 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.916347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5516de-36b5-4ead-84a4-6a1800018191 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.917649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 117/220] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:09.922835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5516de-36b5-4ead-84a4-6a1800018191 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:09.952540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b46dd4-652e-457c-8dca-8d2d2f186919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:09.953667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b46dd4-652e-457c-8dca-8d2d2f186919 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.954280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b46dd4-652e-457c-8dca-8d2d2f186919 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.954565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b46dd4-652e-457c-8dca-8d2d2f186919 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.955363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b46dd4-652e-457c-8dca-8d2d2f186919 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:09.955675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b46dd4-652e-457c-8dca-8d2d2f186919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:09.957196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b46dd4-652e-457c-8dca-8d2d2f186919 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:09.970322 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 104/221] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:09.971883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e97db7-18c6-4de9-967f-e1404c044353 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:09.972178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e97db7-18c6-4de9-967f-e1404c044353 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:09.972458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e97db7-18c6-4de9-967f-e1404c044353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:09.992559 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-49e97db7-18c6-4de9-967f-e1404c044353 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:09.993882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-49e97db7-18c6-4de9-967f-e1404c044353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:10.032911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:10.033701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5516de-36b5-4ead-84a4-6a1800018191 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:10.075378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05866dde-ac44-4153-9a29-6bad6325acf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:10.076592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05866dde-ac44-4153-9a29-6bad6325acf4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:10.076879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05866dde-ac44-4153-9a29-6bad6325acf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:10.077155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05866dde-ac44-4153-9a29-6bad6325acf4 None admin] PATH_INFO: `/v3/users/f28a641debca48329c2bd98c44a7576a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:10.079930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 105/222] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:10.080927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e97db7-18c6-4de9-967f-e1404c044353 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:10.103565 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05866dde-ac44-4153-9a29-6bad6325acf4 None admin] RBAC: Authorizing `identity:get_user(user_id=f28a641debca48329c2bd98c44a7576a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:10.105107 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05866dde-ac44-4153-9a29-6bad6325acf4 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:10.108200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 118/223] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:09 2022] GET /identity/v3/users/f28a641debca48329c2bd98c44a7576a => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:10.114905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05866dde-ac44-4153-9a29-6bad6325acf4 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:10.118913 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:10.220654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e97db7-18c6-4de9-967f-e1404c044353 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:10.263169 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142f0d8-d2d5-42e6-ace9-b268eeb55dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:10.263963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142f0d8-d2d5-42e6-ace9-b268eeb55dcb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:10.264450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142f0d8-d2d5-42e6-ace9-b268eeb55dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:10.264556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142f0d8-d2d5-42e6-ace9-b268eeb55dcb None admin] PATH_INFO: `/v3/users/b5956277e8aa4e64bb2dba260907abcb` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:10.265730 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142f0d8-d2d5-42e6-ace9-b268eeb55dcb None admin] RBAC: Authorizing `identity:get_user(user_id=b5956277e8aa4e64bb2dba260907abcb)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:10.267256 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142f0d8-d2d5-42e6-ace9-b268eeb55dcb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:10.268919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 106/224] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:10 2022] GET /identity/v3/users/b5956277e8aa4e64bb2dba260907abcb => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:10.269695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142f0d8-d2d5-42e6-ace9-b268eeb55dcb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:10.271459 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05866dde-ac44-4153-9a29-6bad6325acf4 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:10.310603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278db1-ef2f-4e4c-b67e-87493a477928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:10.311671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:10.313336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278db1-ef2f-4e4c-b67e-87493a477928 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:10.316146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278db1-ef2f-4e4c-b67e-87493a477928 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:10.316146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278db1-ef2f-4e4c-b67e-87493a477928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:10.382860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142f0d8-d2d5-42e6-ace9-b268eeb55dcb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:10.398739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f278db1-ef2f-4e4c-b67e-87493a477928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:10.400588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f278db1-ef2f-4e4c-b67e-87493a477928 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:10.402972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:10.419737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94beb4-152f-4391-8188-f5a8332699fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:10.420556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94beb4-152f-4391-8188-f5a8332699fd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:10.420844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94beb4-152f-4391-8188-f5a8332699fd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:10.421205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94beb4-152f-4391-8188-f5a8332699fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:10.432560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94beb4-152f-4391-8188-f5a8332699fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ea94beb4-152f-4391-8188-f5a8332699fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:10.441072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:10.441935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 107/225] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:02:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:10.447185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94beb4-152f-4391-8188-f5a8332699fd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:10.529017 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 119/226] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:10.529017 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278db1-ef2f-4e4c-b67e-87493a477928 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:10.583624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:10.590188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94beb4-152f-4391-8188-f5a8332699fd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:10.627830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406d7c0-8c8f-47c9-ac59-6fc2cd6fa0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:10.628589 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406d7c0-8c8f-47c9-ac59-6fc2cd6fa0ed None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:10.628877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406d7c0-8c8f-47c9-ac59-6fc2cd6fa0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:10.629157 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406d7c0-8c8f-47c9-ac59-6fc2cd6fa0ed None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:10.630387 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406d7c0-8c8f-47c9-ac59-6fc2cd6fa0ed None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:10.631904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406d7c0-8c8f-47c9-ac59-6fc2cd6fa0ed None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:10.639135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 108/227] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:10 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:10.640027 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406d7c0-8c8f-47c9-ac59-6fc2cd6fa0ed None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:10.661642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278db1-ef2f-4e4c-b67e-87493a477928 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:10.663917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:10.704206 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efb9f6-5357-4188-adff-5404accddb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:10.704939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb9f6-5357-4188-adff-5404accddb16 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:10.705163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb9f6-5357-4188-adff-5404accddb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:10.705455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb9f6-5357-4188-adff-5404accddb16 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:10.706204 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efb9f6-5357-4188-adff-5404accddb16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:10.706512 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efb9f6-5357-4188-adff-5404accddb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:10.707937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efb9f6-5357-4188-adff-5404accddb16 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:10.721325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 120/228] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:10.721325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efb9f6-5357-4188-adff-5404accddb16 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:10.773091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406d7c0-8c8f-47c9-ac59-6fc2cd6fa0ed None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:10.809298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34b5c9-0d0d-49c1-8e80-f78e0fe82be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:10.810134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b5c9-0d0d-49c1-8e80-f78e0fe82be9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:10.810424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b5c9-0d0d-49c1-8e80-f78e0fe82be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:10.810732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b5c9-0d0d-49c1-8e80-f78e0fe82be9 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:10.812137 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34b5c9-0d0d-49c1-8e80-f78e0fe82be9 None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:10.813469 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34b5c9-0d0d-49c1-8e80-f78e0fe82be9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:10.820075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 109/229] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:10 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:10.820075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34b5c9-0d0d-49c1-8e80-f78e0fe82be9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:10.851421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:10.860511 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efb9f6-5357-4188-adff-5404accddb16 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:10.897391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323eb7f-fe0a-4c73-a540-5006926aa2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:10.898323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323eb7f-fe0a-4c73-a540-5006926aa2a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:10.898641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323eb7f-fe0a-4c73-a540-5006926aa2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:10.898936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323eb7f-fe0a-4c73-a540-5006926aa2a8 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef/users/b5956277e8aa4e64bb2dba260907abcb/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:10.901919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323eb7f-fe0a-4c73-a540-5006926aa2a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5270bea9dd60407aa2ea22723624bbef, user_id=b5956277e8aa4e64bb2dba260907abcb, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:10.904026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323eb7f-fe0a-4c73-a540-5006926aa2a8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:10.926728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 121/230] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:02:10 2022] PUT /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef/users/b5956277e8aa4e64bb2dba260907abcb/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:10.928072 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323eb7f-fe0a-4c73-a540-5006926aa2a8 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:10.959659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34b5c9-0d0d-49c1-8e80-f78e0fe82be9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:10.987009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:11.037541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b84ae-b1c8-42a7-8d59-f290f503745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:11.038436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b84ae-b1c8-42a7-8d59-f290f503745d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:11.038744 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b84ae-b1c8-42a7-8d59-f290f503745d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:11.039019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b84ae-b1c8-42a7-8d59-f290f503745d None admin] PATH_INFO: `/v3/users/b5956277e8aa4e64bb2dba260907abcb` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:11.041176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b84ae-b1c8-42a7-8d59-f290f503745d None admin] RBAC: Authorizing `identity:get_user(user_id=b5956277e8aa4e64bb2dba260907abcb)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:11.042690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b84ae-b1c8-42a7-8d59-f290f503745d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:11.047275 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 110/231] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:10 2022] GET /identity/v3/users/b5956277e8aa4e64bb2dba260907abcb => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:11.053061 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b84ae-b1c8-42a7-8d59-f290f503745d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:11.143750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323eb7f-fe0a-4c73-a540-5006926aa2a8 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:11.180155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407106-60fe-4987-812a-d1d9a0cca1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:11.180770 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407106-60fe-4987-812a-d1d9a0cca1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:11.181045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407106-60fe-4987-812a-d1d9a0cca1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:11.181316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407106-60fe-4987-812a-d1d9a0cca1b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:11.182152 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26407106-60fe-4987-812a-d1d9a0cca1b7 None admin] RBAC: Adding query filter params (role.id=9eb3c16b00c04e1c850bab61de15c44c, scope.project.id=5270bea9dd60407aa2ea22723624bbef, user.id=f28a641debca48329c2bd98c44a7576a) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:11.182460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26407106-60fe-4987-812a-d1d9a0cca1b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:11.184017 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26407106-60fe-4987-812a-d1d9a0cca1b7 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:11.190094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 122/232] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:10 2022] GET /identity/v3/role_assignments?user.id=f28a641debca48329c2bd98c44a7576a&scope.project.id=5270bea9dd60407aa2ea22723624bbef&role.id=9eb3c16b00c04e1c850bab61de15c44c => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:11.205695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:11.207972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b84ae-b1c8-42a7-8d59-f290f503745d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:11.249500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd4a41-dd6a-4bbb-84a6-26c9b982bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:11.250434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd4a41-dd6a-4bbb-84a6-26c9b982bca3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:11.250755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd4a41-dd6a-4bbb-84a6-26c9b982bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:11.251031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd4a41-dd6a-4bbb-84a6-26c9b982bca3 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:11.252253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd4a41-dd6a-4bbb-84a6-26c9b982bca3 None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:11.253749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd4a41-dd6a-4bbb-84a6-26c9b982bca3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:11.255972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 111/233] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:11 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:11.261455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407106-60fe-4987-812a-d1d9a0cca1b7 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:11.359677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:11.373592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407106-60fe-4987-812a-d1d9a0cca1b7 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:11.416586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0388e-8a9d-4bbf-af16-d4ba86c2c618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:11.417398 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0388e-8a9d-4bbf-af16-d4ba86c2c618 None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:11.417676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0388e-8a9d-4bbf-af16-d4ba86c2c618 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:11.417947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0388e-8a9d-4bbf-af16-d4ba86c2c618 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef/users/b5956277e8aa4e64bb2dba260907abcb/roles/8d803b40a63540ba80e3039f16774d46` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:11.424655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0388e-8a9d-4bbf-af16-d4ba86c2c618 None admin] RBAC: Authorizing `identity:create_grant(project_id=5270bea9dd60407aa2ea22723624bbef, user_id=b5956277e8aa4e64bb2dba260907abcb, role_id=8d803b40a63540ba80e3039f16774d46)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:11.426129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0388e-8a9d-4bbf-af16-d4ba86c2c618 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:11.454121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 123/234] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:02:11 2022] PUT /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef/users/b5956277e8aa4e64bb2dba260907abcb/roles/8d803b40a63540ba80e3039f16774d46 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:02:12.138527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72067277-85d5-46cd-a833-5f5ebdc20646 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:12.139081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72067277-85d5-46cd-a833-5f5ebdc20646 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:12.139155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72067277-85d5-46cd-a833-5f5ebdc20646 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:12.140785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 112/235] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:12.146062 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479711-8273-4783-a635-02195e3f6e01 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:12.146358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479711-8273-4783-a635-02195e3f6e01 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:12.146654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479711-8273-4783-a635-02195e3f6e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:12.167663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-60479711-8273-4783-a635-02195e3f6e01 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:12.170005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-60479711-8273-4783-a635-02195e3f6e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:12.197110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df579d9-19af-4bb9-a360-167ec7b33158 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:12.197420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df579d9-19af-4bb9-a360-167ec7b33158 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:12.197670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df579d9-19af-4bb9-a360-167ec7b33158 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:12.199879 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 113/236] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:12.204479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f8e9c-d98f-48db-9220-08ea83ad9673 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:12.204764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f8e9c-d98f-48db-9220-08ea83ad9673 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:12.205041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f8e9c-d98f-48db-9220-08ea83ad9673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:12.237742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a59f8e9c-d98f-48db-9220-08ea83ad9673 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:12.238972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a59f8e9c-d98f-48db-9220-08ea83ad9673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:12.296641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 124/237] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:12.332741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 114/238] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 21 08:02:12.336329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60479711-8273-4783-a635-02195e3f6e01 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:12.359839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f8e9c-d98f-48db-9220-08ea83ad9673 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:12.468490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:12.470111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f8e9c-d98f-48db-9220-08ea83ad9673 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:12.478009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:12.503989 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60479711-8273-4783-a635-02195e3f6e01 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:12.517631 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38270331-0aa8-4629-962f-58cd668d4b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:12.518430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38270331-0aa8-4629-962f-58cd668d4b9f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:12.518735 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38270331-0aa8-4629-962f-58cd668d4b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:12.519010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38270331-0aa8-4629-962f-58cd668d4b9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:12.520251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38270331-0aa8-4629-962f-58cd668d4b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:12.521715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38270331-0aa8-4629-962f-58cd668d4b9f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:12.531534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 115/239] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:12.534148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38270331-0aa8-4629-962f-58cd668d4b9f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:12.598573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f84a9-2b5c-4976-9f05-37615e83041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:12.599398 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f84a9-2b5c-4976-9f05-37615e83041a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:12.599679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f84a9-2b5c-4976-9f05-37615e83041a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:12.599957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f84a9-2b5c-4976-9f05-37615e83041a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:12.627909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f84a9-2b5c-4976-9f05-37615e83041a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-c94f84a9-2b5c-4976-9f05-37615e83041a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:12.641719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:12.642602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:12.643430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 125/240] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:12.649487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f84a9-2b5c-4976-9f05-37615e83041a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:12.768130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f84a9-2b5c-4976-9f05-37615e83041a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:12.782436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38270331-0aa8-4629-962f-58cd668d4b9f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:12.823155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df731f60-8702-4c0b-a090-be55e352869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:12.823829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df731f60-8702-4c0b-a090-be55e352869e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:12.824115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df731f60-8702-4c0b-a090-be55e352869e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:12.824992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df731f60-8702-4c0b-a090-be55e352869e None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:12.825909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df731f60-8702-4c0b-a090-be55e352869e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:12.826222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df731f60-8702-4c0b-a090-be55e352869e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:12.834028 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df731f60-8702-4c0b-a090-be55e352869e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:12.844908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:12.845943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f028-df30-4f8e-8a8e-29bcf97ff96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:12.846664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f028-df30-4f8e-8a8e-29bcf97ff96f None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:12.846955 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f028-df30-4f8e-8a8e-29bcf97ff96f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:12.847236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f028-df30-4f8e-8a8e-29bcf97ff96f None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:12.847982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73f028-df30-4f8e-8a8e-29bcf97ff96f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:12.849481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73f028-df30-4f8e-8a8e-29bcf97ff96f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:12.855836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 126/241] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:12.873879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df731f60-8702-4c0b-a090-be55e352869e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:12.897566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 116/242] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:02:12 2022] POST /identity/v3/users => generated 293 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:02:13.041024 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df731f60-8702-4c0b-a090-be55e352869e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:13.091466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180db34f-8974-4b3b-84c7-d56fe3175e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:13.092352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180db34f-8974-4b3b-84c7-d56fe3175e4e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:13.092632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180db34f-8974-4b3b-84c7-d56fe3175e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:13.092905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180db34f-8974-4b3b-84c7-d56fe3175e4e None admin] PATH_INFO: `/v3/users/d5c88e89325046328043124cabd3eca2` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:13.111948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180db34f-8974-4b3b-84c7-d56fe3175e4e None admin] RBAC: Authorizing `identity:get_user(user_id=d5c88e89325046328043124cabd3eca2)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:13.113430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180db34f-8974-4b3b-84c7-d56fe3175e4e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:13.115190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 127/243] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:12 2022] GET /identity/v3/users/d5c88e89325046328043124cabd3eca2 => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:13.121114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f028-df30-4f8e-8a8e-29bcf97ff96f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:13.153022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:13.249777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f028-df30-4f8e-8a8e-29bcf97ff96f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:13.290080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26b407-157b-416b-b025-53e3d52e23ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:13.290775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26b407-157b-416b-b025-53e3d52e23ba None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:13.291119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26b407-157b-416b-b025-53e3d52e23ba None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:13.291344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26b407-157b-416b-b025-53e3d52e23ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:13.381497 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26b407-157b-416b-b025-53e3d52e23ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:13.383049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26b407-157b-416b-b025-53e3d52e23ba None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:13.409713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:13.493203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 117/244] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:13.503762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180db34f-8974-4b3b-84c7-d56fe3175e4e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:13.548253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19b184-3a09-4223-8b50-4b844bf08a08 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:13.548540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19b184-3a09-4223-8b50-4b844bf08a08 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:13.548721 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19b184-3a09-4223-8b50-4b844bf08a08 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:13.550093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 118/245] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:13.556414 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ccbc-e9e6-4e28-875b-3f661d2d3c87 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:13.556684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ccbc-e9e6-4e28-875b-3f661d2d3c87 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:13.556956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ccbc-e9e6-4e28-875b-3f661d2d3c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:13.574208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3425ccbc-e9e6-4e28-875b-3f661d2d3c87 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:13.578854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3425ccbc-e9e6-4e28-875b-3f661d2d3c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:13.601898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:13.656076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180db34f-8974-4b3b-84c7-d56fe3175e4e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:13.659157 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 119/246] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:13.684771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425ccbc-e9e6-4e28-875b-3f661d2d3c87 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:13.698634 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7376c2-6f65-4cae-a055-681af4cb734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:13.699573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7376c2-6f65-4cae-a055-681af4cb734f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:13.700530 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7376c2-6f65-4cae-a055-681af4cb734f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:13.700811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7376c2-6f65-4cae-a055-681af4cb734f None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:13.703412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7376c2-6f65-4cae-a055-681af4cb734f None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:13.704876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7376c2-6f65-4cae-a055-681af4cb734f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:13.706664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 128/247] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:13 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:13.712380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7376c2-6f65-4cae-a055-681af4cb734f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:13.744160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:13.799020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425ccbc-e9e6-4e28-875b-3f661d2d3c87 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:13.837665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696c1fd-b490-4e44-9bdf-2786e1e076cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:13.838947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696c1fd-b490-4e44-9bdf-2786e1e076cc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:13.839431 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696c1fd-b490-4e44-9bdf-2786e1e076cc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:13.840456 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696c1fd-b490-4e44-9bdf-2786e1e076cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:13.852148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696c1fd-b490-4e44-9bdf-2786e1e076cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-a696c1fd-b490-4e44-9bdf-2786e1e076cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:13.860770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:13.861648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:13.862409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:13.862409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:13.862409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:13.862409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:13.862409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:13.862409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:13.862409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:13.862409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:13.862409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:13.862409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:13.862409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:13.862409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:13.864830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 120/248] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:02:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:13.870858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696c1fd-b490-4e44-9bdf-2786e1e076cc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:13.905779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7376c2-6f65-4cae-a055-681af4cb734f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:13.933176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:13.959326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214ed8a-da19-4ce3-a413-a0e3174902d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:13.959998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214ed8a-da19-4ce3-a413-a0e3174902d7 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:13.960281 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214ed8a-da19-4ce3-a413-a0e3174902d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:13.960556 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214ed8a-da19-4ce3-a413-a0e3174902d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:13.961399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214ed8a-da19-4ce3-a413-a0e3174902d7 None admin] RBAC: Adding query filter params (role.id=10b654dbef184b75888fa0bbd288b1c2, scope.project.id=5270bea9dd60407aa2ea22723624bbef, user.id=d5c88e89325046328043124cabd3eca2) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:13.961712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214ed8a-da19-4ce3-a413-a0e3174902d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:13.963188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214ed8a-da19-4ce3-a413-a0e3174902d7 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:13.974759 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 129/249] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:13 2022] GET /identity/v3/role_assignments?user.id=d5c88e89325046328043124cabd3eca2&scope.project.id=5270bea9dd60407aa2ea22723624bbef&role.id=10b654dbef184b75888fa0bbd288b1c2 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:13.983599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696c1fd-b490-4e44-9bdf-2786e1e076cc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:13.999659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:13.999967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd2a5-4ed4-4846-a2e5-322998753b25 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:14.000752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd2a5-4ed4-4846-a2e5-322998753b25 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:14.001050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd2a5-4ed4-4846-a2e5-322998753b25 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:14.002539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 130/250] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:02:14.017221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fbf10-2100-4dde-8660-d3b05218ef97 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:14.017505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fbf10-2100-4dde-8660-d3b05218ef97 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:14.017786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fbf10-2100-4dde-8660-d3b05218ef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:14.029792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a3d38-9fd8-4aa8-b7e4-c36923a49e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:14.030801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a3d38-9fd8-4aa8-b7e4-c36923a49e33 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:14.031289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a3d38-9fd8-4aa8-b7e4-c36923a49e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:14.031736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a3d38-9fd8-4aa8-b7e4-c36923a49e33 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:14.032793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a3d38-9fd8-4aa8-b7e4-c36923a49e33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:14.034397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a3d38-9fd8-4aa8-b7e4-c36923a49e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:14.039847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a3d38-9fd8-4aa8-b7e4-c36923a49e33 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:14.056449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 121/251] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:14.057699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-2a8fbf10-2100-4dde-8660-d3b05218ef97 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:14.059690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2a8fbf10-2100-4dde-8660-d3b05218ef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:14.071181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a3d38-9fd8-4aa8-b7e4-c36923a49e33 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:14.185003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a3d38-9fd8-4aa8-b7e4-c36923a49e33 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:14.201730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 131/252] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:14.203135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149685e-7b50-4072-96c4-92d9ec19b12c None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:14.203432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149685e-7b50-4072-96c4-92d9ec19b12c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:14.203713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149685e-7b50-4072-96c4-92d9ec19b12c None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:14.205093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 132/253] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:14.210581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc279c-b8d7-49d4-ac2e-86e91213d3bb None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:14.211082 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc279c-b8d7-49d4-ac2e-86e91213d3bb None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:14.211496 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc279c-b8d7-49d4-ac2e-86e91213d3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:14.225915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8350e-1b46-4d3a-9271-7d097666e4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:14.231953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8350e-1b46-4d3a-9271-7d097666e4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:14.232498 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8350e-1b46-4d3a-9271-7d097666e4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:14.232992 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8350e-1b46-4d3a-9271-7d097666e4c6 None admin] PATH_INFO: `/v3/users/b5956277e8aa4e64bb2dba260907abcb` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:14.234598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8350e-1b46-4d3a-9271-7d097666e4c6 None admin] RBAC: Authorizing `identity:get_user(user_id=b5956277e8aa4e64bb2dba260907abcb)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:14.236315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8350e-1b46-4d3a-9271-7d097666e4c6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:14.238377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 122/254] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:14 2022] GET /identity/v3/users/b5956277e8aa4e64bb2dba260907abcb => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:14.241407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8350e-1b46-4d3a-9271-7d097666e4c6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:14.245899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-86bc279c-b8d7-49d4-ac2e-86e91213d3bb None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:14.248465 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-86bc279c-b8d7-49d4-ac2e-86e91213d3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:14.326134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 133/255] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:14.331480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc279c-b8d7-49d4-ac2e-86e91213d3bb None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:14.358983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:14.409224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:14.469350 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8350e-1b46-4d3a-9271-7d097666e4c6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:14.473780 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc279c-b8d7-49d4-ac2e-86e91213d3bb None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:14.506049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97092b83-a6a3-47f1-a937-c12f8c85a24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:14.507238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97092b83-a6a3-47f1-a937-c12f8c85a24e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:14.507737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97092b83-a6a3-47f1-a937-c12f8c85a24e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:14.508221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97092b83-a6a3-47f1-a937-c12f8c85a24e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:14.521462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97092b83-a6a3-47f1-a937-c12f8c85a24e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-97092b83-a6a3-47f1-a937-c12f8c85a24e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:14.529812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:14.530954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:14.531748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:14.531748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:14.531748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:14.531748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:14.531748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:14.531748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:14.531748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:14.531748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:14.531748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:14.531748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:14.531748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:14.531748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:14.534213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 123/256] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:14.535356 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97092b83-a6a3-47f1-a937-c12f8c85a24e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:14.555293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9be9bc-1327-4f96-9094-d18292a8b3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:14.556637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9be9bc-1327-4f96-9094-d18292a8b3ae None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:14.557116 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9be9bc-1327-4f96-9094-d18292a8b3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:14.557606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9be9bc-1327-4f96-9094-d18292a8b3ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:14.701691 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9be9bc-1327-4f96-9094-d18292a8b3ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:14.703548 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9be9bc-1327-4f96-9094-d18292a8b3ae None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:14.744424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97092b83-a6a3-47f1-a937-c12f8c85a24e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:14.750921 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:14.803673 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:14.809805 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37240f6-c5f9-48d9-a208-c7e8bf449518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:14.809805 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37240f6-c5f9-48d9-a208-c7e8bf449518 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:14.810042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37240f6-c5f9-48d9-a208-c7e8bf449518 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:14.810344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37240f6-c5f9-48d9-a208-c7e8bf449518 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:14.821182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37240f6-c5f9-48d9-a208-c7e8bf449518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-a37240f6-c5f9-48d9-a208-c7e8bf449518 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:14.829835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:14.830757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:14.831529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 124/257] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:02:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:14.832182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37240f6-c5f9-48d9-a208-c7e8bf449518 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:14.917169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 134/258] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:14.919063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9be9bc-1327-4f96-9094-d18292a8b3ae None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:15.032759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37240f6-c5f9-48d9-a208-c7e8bf449518 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:15.096209 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887e569-8550-4b7a-9656-cb0f0022233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:15.097840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887e569-8550-4b7a-9656-cb0f0022233e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:15.098482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887e569-8550-4b7a-9656-cb0f0022233e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:15.100148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887e569-8550-4b7a-9656-cb0f0022233e None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:15.101745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887e569-8550-4b7a-9656-cb0f0022233e None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:15.102466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887e569-8550-4b7a-9656-cb0f0022233e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:15.104671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887e569-8550-4b7a-9656-cb0f0022233e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:15.112097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9be9bc-1327-4f96-9094-d18292a8b3ae None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:15.125441 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 125/259] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:15.126487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887e569-8550-4b7a-9656-cb0f0022233e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:15.174446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:15.175681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584601ca-a1f7-4f92-b181-6e460aef7e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:15.176683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584601ca-a1f7-4f92-b181-6e460aef7e34 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:15.177842 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584601ca-a1f7-4f92-b181-6e460aef7e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:15.178469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584601ca-a1f7-4f92-b181-6e460aef7e34 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:15.180502 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584601ca-a1f7-4f92-b181-6e460aef7e34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:15.181770 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584601ca-a1f7-4f92-b181-6e460aef7e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:15.184122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584601ca-a1f7-4f92-b181-6e460aef7e34 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:15.204383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 135/260] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:15.205586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584601ca-a1f7-4f92-b181-6e460aef7e34 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:15.229514 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:15.309388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887e569-8550-4b7a-9656-cb0f0022233e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:15.377201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6a7cf-622b-4e0f-bd42-6776751e0ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:15.379102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6a7cf-622b-4e0f-bd42-6776751e0ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:15.379748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6a7cf-622b-4e0f-bd42-6776751e0ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:15.381408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6a7cf-622b-4e0f-bd42-6776751e0ad2 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:15.383674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6a7cf-622b-4e0f-bd42-6776751e0ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:15.385938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6a7cf-622b-4e0f-bd42-6776751e0ad2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:15.388687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 126/261] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:15 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:15.391738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6a7cf-622b-4e0f-bd42-6776751e0ad2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:15.395224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584601ca-a1f7-4f92-b181-6e460aef7e34 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:15.452436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62391e1c-88cd-4b52-ad89-6d19b6977df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:15.455121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391e1c-88cd-4b52-ad89-6d19b6977df6 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:15.455433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391e1c-88cd-4b52-ad89-6d19b6977df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:15.455709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391e1c-88cd-4b52-ad89-6d19b6977df6 None admin] PATH_INFO: `/v3/users/f28a641debca48329c2bd98c44a7576a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:15.458228 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62391e1c-88cd-4b52-ad89-6d19b6977df6 None admin] RBAC: Authorizing `identity:get_user(user_id=f28a641debca48329c2bd98c44a7576a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:15.462665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62391e1c-88cd-4b52-ad89-6d19b6977df6 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:15.464452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 136/262] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:15 2022] GET /identity/v3/users/f28a641debca48329c2bd98c44a7576a => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:15.471030 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62391e1c-88cd-4b52-ad89-6d19b6977df6 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:15.535133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:15.550642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6a7cf-622b-4e0f-bd42-6776751e0ad2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:15.585264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1b321-0bc0-4651-b845-e3d4a2b04107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:15.586148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1b321-0bc0-4651-b845-e3d4a2b04107 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:15.586428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1b321-0bc0-4651-b845-e3d4a2b04107 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:15.586724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1b321-0bc0-4651-b845-e3d4a2b04107 None admin] PATH_INFO: `/v3/users/b5956277e8aa4e64bb2dba260907abcb` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:15.589727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1b321-0bc0-4651-b845-e3d4a2b04107 None admin] RBAC: Authorizing `identity:get_user(user_id=b5956277e8aa4e64bb2dba260907abcb)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:15.592963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1b321-0bc0-4651-b845-e3d4a2b04107 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:15.597055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 127/263] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:15 2022] GET /identity/v3/users/b5956277e8aa4e64bb2dba260907abcb => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:15.597838 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1b321-0bc0-4651-b845-e3d4a2b04107 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:15.648191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:15.690854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62391e1c-88cd-4b52-ad89-6d19b6977df6 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:15.748500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1b321-0bc0-4651-b845-e3d4a2b04107 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:15.783343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983c3d-739d-48a3-82dc-df87102f6c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:15.784211 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983c3d-739d-48a3-82dc-df87102f6c2d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:15.784501 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983c3d-739d-48a3-82dc-df87102f6c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:15.784784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983c3d-739d-48a3-82dc-df87102f6c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:15.785366 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9126cf-4fe9-40ad-9355-916abbefb6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:15.785626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983c3d-739d-48a3-82dc-df87102f6c2d None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=5270bea9dd60407aa2ea22723624bbef, user.id=b5956277e8aa4e64bb2dba260907abcb) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:15.785941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983c3d-739d-48a3-82dc-df87102f6c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:15.786524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9126cf-4fe9-40ad-9355-916abbefb6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:15.786938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9126cf-4fe9-40ad-9355-916abbefb6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:15.787308 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9126cf-4fe9-40ad-9355-916abbefb6e1 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:15.787416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983c3d-739d-48a3-82dc-df87102f6c2d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:15.788670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9126cf-4fe9-40ad-9355-916abbefb6e1 None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:15.790285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9126cf-4fe9-40ad-9355-916abbefb6e1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:15.792166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 128/264] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:15 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:15.793041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9126cf-4fe9-40ad-9355-916abbefb6e1 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:15.809245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 137/265] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:15 2022] GET /identity/v3/role_assignments?user.id=b5956277e8aa4e64bb2dba260907abcb&scope.project.id=5270bea9dd60407aa2ea22723624bbef&role.id=6fcc322b483a475399974562c1e5bd43 => generated 608 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:15.810070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983c3d-739d-48a3-82dc-df87102f6c2d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:15.865908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:15.985448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983c3d-739d-48a3-82dc-df87102f6c2d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:15.994409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9126cf-4fe9-40ad-9355-916abbefb6e1 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:16.059970 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9393c08-b6a0-442c-90c1-ae7f0b859b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:16.060303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc68a1-7acf-4177-8d3a-468c75139613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:16.061142 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc68a1-7acf-4177-8d3a-468c75139613 None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.061320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9393c08-b6a0-442c-90c1-ae7f0b859b65 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.061415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc68a1-7acf-4177-8d3a-468c75139613 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.061602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9393c08-b6a0-442c-90c1-ae7f0b859b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.061698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc68a1-7acf-4177-8d3a-468c75139613 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef/users/f28a641debca48329c2bd98c44a7576a/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.061874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9393c08-b6a0-442c-90c1-ae7f0b859b65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.063701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc68a1-7acf-4177-8d3a-468c75139613 None admin] RBAC: Authorizing `identity:create_grant(project_id=5270bea9dd60407aa2ea22723624bbef, user_id=f28a641debca48329c2bd98c44a7576a, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:16.065509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc68a1-7acf-4177-8d3a-468c75139613 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:16.084870 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 138/266] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:02:15 2022] PUT /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef/users/f28a641debca48329c2bd98c44a7576a/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:16.086600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926703d-eab5-4070-8591-a47c2a669d78 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.086922 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926703d-eab5-4070-8591-a47c2a669d78 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.087281 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926703d-eab5-4070-8591-a47c2a669d78 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.089125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 139/267] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:16.093693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87916b-f830-4a01-9cc3-4a8997d74420 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.093693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87916b-f830-4a01-9cc3-4a8997d74420 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.093693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87916b-f830-4a01-9cc3-4a8997d74420 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.094043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 140/268] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:16.100615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68b1d8-fc23-448e-8d09-50bedcf4b6e5 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.100877 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68b1d8-fc23-448e-8d09-50bedcf4b6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.101722 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68b1d8-fc23-448e-8d09-50bedcf4b6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.113654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:16.131764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-bb68b1d8-fc23-448e-8d09-50bedcf4b6e5 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:16.133462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-bb68b1d8-fc23-448e-8d09-50bedcf4b6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:16.181272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9393c08-b6a0-442c-90c1-ae7f0b859b65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:16.184987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9393c08-b6a0-442c-90c1-ae7f0b859b65 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:16.220889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:16.227333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 141/269] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:16.228965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80295d15-474b-478c-8bd8-1cace5f56821 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.229450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80295d15-474b-478c-8bd8-1cace5f56821 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.229903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80295d15-474b-478c-8bd8-1cace5f56821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.264624 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-80295d15-474b-478c-8bd8-1cace5f56821 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:16.266103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-80295d15-474b-478c-8bd8-1cace5f56821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:16.334163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 129/270] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:16.335054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9393c08-b6a0-442c-90c1-ae7f0b859b65 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:16.358175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 142/271] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:16.359776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80295d15-474b-478c-8bd8-1cace5f56821 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:16.438933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:16.470306 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9393c08-b6a0-442c-90c1-ae7f0b859b65 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:16.493587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80295d15-474b-478c-8bd8-1cace5f56821 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:16.499689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:16.509011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a648851-ea4f-477f-aab4-a8022360b106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:16.510042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a648851-ea4f-477f-aab4-a8022360b106 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.510469 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a648851-ea4f-477f-aab4-a8022360b106 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.510932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a648851-ea4f-477f-aab4-a8022360b106 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.523174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a648851-ea4f-477f-aab4-a8022360b106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-8a648851-ea4f-477f-aab4-a8022360b106 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:16.534640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:16.535726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 130/272] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:16.536646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a648851-ea4f-477f-aab4-a8022360b106 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:16.546279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed541e2-09df-4f73-8baf-990312bd87bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:16.547419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed541e2-09df-4f73-8baf-990312bd87bf None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.548396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed541e2-09df-4f73-8baf-990312bd87bf None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.548812 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed541e2-09df-4f73-8baf-990312bd87bf None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.550715 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed541e2-09df-4f73-8baf-990312bd87bf None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:16.553083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed541e2-09df-4f73-8baf-990312bd87bf None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:16.560997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 143/273] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:16 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:16.560997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed541e2-09df-4f73-8baf-990312bd87bf None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:16.659768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a648851-ea4f-477f-aab4-a8022360b106 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:16.683282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed541e2-09df-4f73-8baf-990312bd87bf None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:16.698831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf74d8-e4a2-494a-b78b-7b17ed0e4912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:16.699609 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf74d8-e4a2-494a-b78b-7b17ed0e4912 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.699892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf74d8-e4a2-494a-b78b-7b17ed0e4912 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.700162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf74d8-e4a2-494a-b78b-7b17ed0e4912 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.701374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf74d8-e4a2-494a-b78b-7b17ed0e4912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:16.702869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf74d8-e4a2-494a-b78b-7b17ed0e4912 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:16.704596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 131/274] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:16.705261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf74d8-e4a2-494a-b78b-7b17ed0e4912 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:16.718788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:16.725315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293e802-69d4-4804-91d0-7bd855585360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:16.725973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293e802-69d4-4804-91d0-7bd855585360 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.726250 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293e802-69d4-4804-91d0-7bd855585360 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.726519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293e802-69d4-4804-91d0-7bd855585360 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.727289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293e802-69d4-4804-91d0-7bd855585360 None admin] RBAC: Adding query filter params (name=member) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:16.727598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293e802-69d4-4804-91d0-7bd855585360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:16.728964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293e802-69d4-4804-91d0-7bd855585360 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:16.737932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 144/275] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:16.739188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73f87e-5208-44ae-8720-cf56195f877d None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.739476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73f87e-5208-44ae-8720-cf56195f877d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.739755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73f87e-5208-44ae-8720-cf56195f877d None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.745506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 145/276] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:16.746354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73f87e-5208-44ae-8720-cf56195f877d None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:16.768375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:16.814509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf74d8-e4a2-494a-b78b-7b17ed0e4912 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:16.850158 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50caea0-2aaa-4c17-82b6-594c2f0d9e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:16.850830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50caea0-2aaa-4c17-82b6-594c2f0d9e52 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.851110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50caea0-2aaa-4c17-82b6-594c2f0d9e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.851591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50caea0-2aaa-4c17-82b6-594c2f0d9e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.852204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50caea0-2aaa-4c17-82b6-594c2f0d9e52 None admin] RBAC: Adding query filter params (role.id=8d803b40a63540ba80e3039f16774d46, scope.project.id=5270bea9dd60407aa2ea22723624bbef, user.id=b5956277e8aa4e64bb2dba260907abcb) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:16.852507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50caea0-2aaa-4c17-82b6-594c2f0d9e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:16.853937 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50caea0-2aaa-4c17-82b6-594c2f0d9e52 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:16.858518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73f87e-5208-44ae-8720-cf56195f877d None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:16.860235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 132/277] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:16 2022] GET /identity/v3/role_assignments?user.id=b5956277e8aa4e64bb2dba260907abcb&scope.project.id=5270bea9dd60407aa2ea22723624bbef&role.id=8d803b40a63540ba80e3039f16774d46 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:16.860896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50caea0-2aaa-4c17-82b6-594c2f0d9e52 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:16.910820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0abb4-9b6f-4508-87e3-e9b4d5b16d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:16.911986 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0abb4-9b6f-4508-87e3-e9b4d5b16d96 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.912531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0abb4-9b6f-4508-87e3-e9b4d5b16d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.913061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0abb4-9b6f-4508-87e3-e9b4d5b16d96 None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.914029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0abb4-9b6f-4508-87e3-e9b4d5b16d96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:16.916014 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0abb4-9b6f-4508-87e3-e9b4d5b16d96 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:16.941093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 146/278] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:02:16 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:02:16.943046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf46d7c-3e5f-4997-9491-6caf3b245fb2 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:16.943717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf46d7c-3e5f-4997-9491-6caf3b245fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:16.944299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf46d7c-3e5f-4997-9491-6caf3b245fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:16.965408 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-fdf46d7c-3e5f-4997-9491-6caf3b245fb2 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:16.967148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-fdf46d7c-3e5f-4997-9491-6caf3b245fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:17.012744 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50caea0-2aaa-4c17-82b6-594c2f0d9e52 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:17.028086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:17.066668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 147/279] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:17.071025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:17.089205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf46d7c-3e5f-4997-9491-6caf3b245fb2 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:17.107504 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d22640-1e9b-4055-aedd-8769b5154e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:17.108444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d22640-1e9b-4055-aedd-8769b5154e97 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:17.108733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d22640-1e9b-4055-aedd-8769b5154e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:17.109017 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d22640-1e9b-4055-aedd-8769b5154e97 None admin] PATH_INFO: `/v3/users/e789d9ff55d747689bda56b63669d6df` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:17.129841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d22640-1e9b-4055-aedd-8769b5154e97 None admin] RBAC: Authorizing `identity:get_user(user_id=e789d9ff55d747689bda56b63669d6df)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:17.131388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d22640-1e9b-4055-aedd-8769b5154e97 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:17.133359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 133/280] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:16 2022] GET /identity/v3/users/e789d9ff55d747689bda56b63669d6df => generated 293 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:17.139367 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d22640-1e9b-4055-aedd-8769b5154e97 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:17.213788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf46d7c-3e5f-4997-9491-6caf3b245fb2 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:17.261510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d22640-1e9b-4055-aedd-8769b5154e97 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:17.265960 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a300c4-857e-47aa-8f1b-5b7f93c5661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:17.266967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a300c4-857e-47aa-8f1b-5b7f93c5661b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:17.267400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a300c4-857e-47aa-8f1b-5b7f93c5661b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:17.267676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a300c4-857e-47aa-8f1b-5b7f93c5661b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:17.281343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a300c4-857e-47aa-8f1b-5b7f93c5661b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-c0a300c4-857e-47aa-8f1b-5b7f93c5661b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:17.290337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:17.291433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:17.292219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 148/281] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:17.298465 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a300c4-857e-47aa-8f1b-5b7f93c5661b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:17.306242 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776679af-622e-42d3-806d-9e93f4668c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:17.309976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776679af-622e-42d3-806d-9e93f4668c99 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:17.309976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776679af-622e-42d3-806d-9e93f4668c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:17.309976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776679af-622e-42d3-806d-9e93f4668c99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:17.309976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776679af-622e-42d3-806d-9e93f4668c99 None admin] RBAC: Adding query filter params (role.id=9eb3c16b00c04e1c850bab61de15c44c, user.id=e789d9ff55d747689bda56b63669d6df, scope.system=all) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:17.309976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776679af-622e-42d3-806d-9e93f4668c99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:17.312780 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776679af-622e-42d3-806d-9e93f4668c99 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:17.320746 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 134/282] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jun 21 08:02:17 2022] GET /identity/v3/role_assignments?user.id=e789d9ff55d747689bda56b63669d6df&scope.system=all&role.id=9eb3c16b00c04e1c850bab61de15c44c => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:17.355976 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:17.428869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a300c4-857e-47aa-8f1b-5b7f93c5661b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:17.471902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08276829-cd89-43e7-8ace-7bdcc71ae155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:17.472961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08276829-cd89-43e7-8ace-7bdcc71ae155 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:17.473246 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08276829-cd89-43e7-8ace-7bdcc71ae155 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:17.473523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08276829-cd89-43e7-8ace-7bdcc71ae155 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:17.474291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08276829-cd89-43e7-8ace-7bdcc71ae155 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:17.474600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08276829-cd89-43e7-8ace-7bdcc71ae155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:17.476066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08276829-cd89-43e7-8ace-7bdcc71ae155 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:17.492064 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 149/283] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:17.497994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776679af-622e-42d3-806d-9e93f4668c99 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:17.546472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:17.608425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776679af-622e-42d3-806d-9e93f4668c99 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:17.650058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d4422-3d99-47ab-b2ed-2528859f035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:17.650958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d4422-3d99-47ab-b2ed-2528859f035b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:17.651238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d4422-3d99-47ab-b2ed-2528859f035b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:17.651507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d4422-3d99-47ab-b2ed-2528859f035b None admin] PATH_INFO: `/v3/users/d5c88e89325046328043124cabd3eca2` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:17.653339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d4422-3d99-47ab-b2ed-2528859f035b None admin] RBAC: Authorizing `identity:get_user(user_id=d5c88e89325046328043124cabd3eca2)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:17.654814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d4422-3d99-47ab-b2ed-2528859f035b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:17.656627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 135/284] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:17 2022] GET /identity/v3/users/d5c88e89325046328043124cabd3eca2 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:17.662015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08276829-cd89-43e7-8ace-7bdcc71ae155 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:17.826853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08276829-cd89-43e7-8ace-7bdcc71ae155 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:17.828340 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:17.872905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cb48c-aea5-400b-9c38-f4b25478e4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:17.873758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cb48c-aea5-400b-9c38-f4b25478e4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:17.874032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cb48c-aea5-400b-9c38-f4b25478e4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:17.874298 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cb48c-aea5-400b-9c38-f4b25478e4a3 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:17.875614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cb48c-aea5-400b-9c38-f4b25478e4a3 None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:17.877048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cb48c-aea5-400b-9c38-f4b25478e4a3 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:17.879109 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 150/285] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:17 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:17.887655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d4422-3d99-47ab-b2ed-2528859f035b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:17.994351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d4422-3d99-47ab-b2ed-2528859f035b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:18.006389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:18.032897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33850f6a-e017-47e0-9030-9110cf408a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:18.033786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33850f6a-e017-47e0-9030-9110cf408a70 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:18.034068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33850f6a-e017-47e0-9030-9110cf408a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:18.034345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33850f6a-e017-47e0-9030-9110cf408a70 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef/users/d5c88e89325046328043124cabd3eca2/roles/10b654dbef184b75888fa0bbd288b1c2` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:18.036359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33850f6a-e017-47e0-9030-9110cf408a70 None admin] RBAC: Authorizing `identity:create_grant(project_id=5270bea9dd60407aa2ea22723624bbef, user_id=d5c88e89325046328043124cabd3eca2, role_id=10b654dbef184b75888fa0bbd288b1c2)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:18.037819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33850f6a-e017-47e0-9030-9110cf408a70 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:18.052572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 136/286] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:02:17 2022] PUT /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef/users/d5c88e89325046328043124cabd3eca2/roles/10b654dbef184b75888fa0bbd288b1c2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:18.454150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480a21e-6f42-4dca-af86-e0a35b57e5c8 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:18.454651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480a21e-6f42-4dca-af86-e0a35b57e5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:18.455048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480a21e-6f42-4dca-af86-e0a35b57e5c8 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:18.456550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 151/287] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:18.463053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021a61b-e92f-4e4a-afe7-9b5694d40c40 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:18.463344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021a61b-e92f-4e4a-afe7-9b5694d40c40 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:18.463624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021a61b-e92f-4e4a-afe7-9b5694d40c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:18.482534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e021a61b-e92f-4e4a-afe7-9b5694d40c40 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:18.483753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e021a61b-e92f-4e4a-afe7-9b5694d40c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:18.560057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 137/288] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:18.584312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480a21e-6f42-4dca-af86-e0a35b57e5c8 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:18.748247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480a21e-6f42-4dca-af86-e0a35b57e5c8 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:18.795317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85458cc-34b6-4443-a2fc-f2049bb1a654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:18.796128 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85458cc-34b6-4443-a2fc-f2049bb1a654 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:18.796416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85458cc-34b6-4443-a2fc-f2049bb1a654 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:18.796694 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85458cc-34b6-4443-a2fc-f2049bb1a654 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:18.811184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85458cc-34b6-4443-a2fc-f2049bb1a654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-d85458cc-34b6-4443-a2fc-f2049bb1a654 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:18.819010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:18.819881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:18.820668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 152/289] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:18.827471 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021a61b-e92f-4e4a-afe7-9b5694d40c40 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:18.979031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:18.982105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021a61b-e92f-4e4a-afe7-9b5694d40c40 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:19.020861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ac51f-20ba-4d14-ba6f-0bc8df6ea023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:19.021439 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ac51f-20ba-4d14-ba6f-0bc8df6ea023 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:19.021720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ac51f-20ba-4d14-ba6f-0bc8df6ea023 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:19.021994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ac51f-20ba-4d14-ba6f-0bc8df6ea023 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:19.022767 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ac51f-20ba-4d14-ba6f-0bc8df6ea023 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:19.023130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ac51f-20ba-4d14-ba6f-0bc8df6ea023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:19.024511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ac51f-20ba-4d14-ba6f-0bc8df6ea023 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:19.034246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 138/290] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:19.039861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85458cc-34b6-4443-a2fc-f2049bb1a654 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:19.084644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:19.171039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85458cc-34b6-4443-a2fc-f2049bb1a654 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:19.206695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ec46d-2da8-4342-8bba-8acfa4544764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:19.207620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ec46d-2da8-4342-8bba-8acfa4544764 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:19.207908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ec46d-2da8-4342-8bba-8acfa4544764 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:19.208181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ec46d-2da8-4342-8bba-8acfa4544764 None admin] PATH_INFO: `/v3/users/f28a641debca48329c2bd98c44a7576a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:19.209388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ec46d-2da8-4342-8bba-8acfa4544764 None admin] RBAC: Authorizing `identity:get_user(user_id=f28a641debca48329c2bd98c44a7576a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:19.210863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ec46d-2da8-4342-8bba-8acfa4544764 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:19.217439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 153/291] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:19 2022] GET /identity/v3/users/f28a641debca48329c2bd98c44a7576a => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:19.219115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ac51f-20ba-4d14-ba6f-0bc8df6ea023 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:19.328187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ac51f-20ba-4d14-ba6f-0bc8df6ea023 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:19.367193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6df651-3004-4791-9bf0-d7897fa6ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:19.367843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6df651-3004-4791-9bf0-d7897fa6ebb2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:19.368124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6df651-3004-4791-9bf0-d7897fa6ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:19.368398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6df651-3004-4791-9bf0-d7897fa6ebb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:19.400263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:19.442421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6df651-3004-4791-9bf0-d7897fa6ebb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:19.443943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6df651-3004-4791-9bf0-d7897fa6ebb2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:19.549662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 139/292] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:19.555311 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ec46d-2da8-4342-8bba-8acfa4544764 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:19.660620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:19.664741 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ec46d-2da8-4342-8bba-8acfa4544764 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:19.704920 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1036d69-8c34-4ebb-8616-261de1d10671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:19.705776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1036d69-8c34-4ebb-8616-261de1d10671 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:19.706056 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1036d69-8c34-4ebb-8616-261de1d10671 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:19.706330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1036d69-8c34-4ebb-8616-261de1d10671 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:19.707564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1036d69-8c34-4ebb-8616-261de1d10671 None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:19.709002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1036d69-8c34-4ebb-8616-261de1d10671 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:19.710706 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 154/293] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:19 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:19.717274 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6df651-3004-4791-9bf0-d7897fa6ebb2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:19.780384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:19.820924 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6df651-3004-4791-9bf0-d7897fa6ebb2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:19.855584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1bbc6-f312-4275-8822-061b6012d982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:19.856320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1bbc6-f312-4275-8822-061b6012d982 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:19.856602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1bbc6-f312-4275-8822-061b6012d982 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:19.856875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1bbc6-f312-4275-8822-061b6012d982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:19.857705 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1bbc6-f312-4275-8822-061b6012d982 None admin] RBAC: Adding query filter params (role.id=9eb3c16b00c04e1c850bab61de15c44c, scope.project.id=5270bea9dd60407aa2ea22723624bbef, user.id=f28a641debca48329c2bd98c44a7576a) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:19.858010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1bbc6-f312-4275-8822-061b6012d982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:19.859491 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1bbc6-f312-4275-8822-061b6012d982 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:19.866158 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 140/294] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:19 2022] GET /identity/v3/role_assignments?user.id=f28a641debca48329c2bd98c44a7576a&scope.project.id=5270bea9dd60407aa2ea22723624bbef&role.id=9eb3c16b00c04e1c850bab61de15c44c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:19.872343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3c0c-a153-4676-976b-754b5a14c1a3 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:19.872967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3c0c-a153-4676-976b-754b5a14c1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:19.873438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3c0c-a153-4676-976b-754b5a14c1a3 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:19.875796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 155/295] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:19.888483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f26f0b-2045-4f25-8e6d-e4e5ff70e930 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:19.888842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f26f0b-2045-4f25-8e6d-e4e5ff70e930 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:19.889034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f26f0b-2045-4f25-8e6d-e4e5ff70e930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:19.911983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b3f26f0b-2045-4f25-8e6d-e4e5ff70e930 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:19.913127 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b3f26f0b-2045-4f25-8e6d-e4e5ff70e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:19.986530 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 141/296] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:20.010044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3c0c-a153-4676-976b-754b5a14c1a3 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:20.063023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac65077-9c08-4c63-ab69-1101abd48c0b None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.063698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac65077-9c08-4c63-ab69-1101abd48c0b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.064168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac65077-9c08-4c63-ab69-1101abd48c0b None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.066016 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 142/297] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:20.071374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9094aa-da28-4dac-b268-aa60a8c45ee1 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.072082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9094aa-da28-4dac-b268-aa60a8c45ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.072551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9094aa-da28-4dac-b268-aa60a8c45ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.102262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ee9094aa-da28-4dac-b268-aa60a8c45ee1 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:20.103815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ee9094aa-da28-4dac-b268-aa60a8c45ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:20.157539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3c0c-a153-4676-976b-754b5a14c1a3 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:20.176009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:20.201043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3625f9-d6c6-4645-89f4-5a1f148f8cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:20.201849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3625f9-d6c6-4645-89f4-5a1f148f8cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.202066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 143/298] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:20.202191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3625f9-d6c6-4645-89f4-5a1f148f8cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.202474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3625f9-d6c6-4645-89f4-5a1f148f8cb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.203766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3625f9-d6c6-4645-89f4-5a1f148f8cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:20.206458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3625f9-d6c6-4645-89f4-5a1f148f8cb8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:20.208629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 156/299] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:20.215689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9094aa-da28-4dac-b268-aa60a8c45ee1 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:20.231510 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3625f9-d6c6-4645-89f4-5a1f148f8cb8 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:20.280668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:20.351392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9094aa-da28-4dac-b268-aa60a8c45ee1 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:20.359210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3625f9-d6c6-4645-89f4-5a1f148f8cb8 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:20.388866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d9f32-36a1-472c-bc6e-063946e6f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:20.389538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d9f32-36a1-472c-bc6e-063946e6f217 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.389831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d9f32-36a1-472c-bc6e-063946e6f217 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.390113 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d9f32-36a1-472c-bc6e-063946e6f217 None admin] PATH_INFO: `/v3/groups` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.390832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d9f32-36a1-472c-bc6e-063946e6f217 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:20.392332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d9f32-36a1-472c-bc6e-063946e6f217 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:20.395926 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40297c-7960-43d6-8e07-63e0a823497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:20.396721 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40297c-7960-43d6-8e07-63e0a823497d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.396994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40297c-7960-43d6-8e07-63e0a823497d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.397273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40297c-7960-43d6-8e07-63e0a823497d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.407704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 144/300] 10.222.0.36 () {60 vars in 1134 bytes} [Tue Jun 21 08:02:20 2022] POST /identity/v3/groups => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:02:20.409703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40297c-7960-43d6-8e07-63e0a823497d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-3f40297c-7960-43d6-8e07-63e0a823497d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:20.417442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:20.418456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:20.419371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:20.419371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:20.419371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:20.419371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:20.419371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:20.419371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:20.419371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:20.419371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:20.419371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:20.419371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:20.419371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:20.419371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:20.419956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 157/301] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:20.422083 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2358480-d49a-41c2-bf1d-a1e8b43175ae None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.422569 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2358480-d49a-41c2-bf1d-a1e8b43175ae None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.423028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2358480-d49a-41c2-bf1d-a1e8b43175ae None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.428857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40297c-7960-43d6-8e07-63e0a823497d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:20.429453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 145/302] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:20 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:20.431170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ab679-10f2-4a99-bce2-1f18b181f7fb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.431616 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ab679-10f2-4a99-bce2-1f18b181f7fb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.432227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ab679-10f2-4a99-bce2-1f18b181f7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.457383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a75ab679-10f2-4a99-bce2-1f18b181f7fb None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:20.459239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a75ab679-10f2-4a99-bce2-1f18b181f7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:20.525173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:20.548564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:20.559135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40297c-7960-43d6-8e07-63e0a823497d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:20.576368 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 146/303] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:20.597873 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ab679-10f2-4a99-bce2-1f18b181f7fb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:20.605115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7ff84-7f29-4783-94aa-3eb1fda7f3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:20.605784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7ff84-7f29-4783-94aa-3eb1fda7f3bb None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.606065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7ff84-7f29-4783-94aa-3eb1fda7f3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.606339 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7ff84-7f29-4783-94aa-3eb1fda7f3bb None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.607126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7ff84-7f29-4783-94aa-3eb1fda7f3bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:20.607435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7ff84-7f29-4783-94aa-3eb1fda7f3bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:20.608811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7ff84-7f29-4783-94aa-3eb1fda7f3bb None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:20.619003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 158/304] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:20.625129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7ff84-7f29-4783-94aa-3eb1fda7f3bb None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:20.720324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ab679-10f2-4a99-bce2-1f18b181f7fb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:20.737380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7ff84-7f29-4783-94aa-3eb1fda7f3bb None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:20.758060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e30d3e-db55-4e8a-b83f-62d2189c52d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:20.759169 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e30d3e-db55-4e8a-b83f-62d2189c52d2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.759169 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e30d3e-db55-4e8a-b83f-62d2189c52d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.759419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e30d3e-db55-4e8a-b83f-62d2189c52d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.771138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e30d3e-db55-4e8a-b83f-62d2189c52d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:20.773334 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9132a-1d73-4dfe-b8bc-d4896b57ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:20.774200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9132a-1d73-4dfe-b8bc-d4896b57ac44 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.774477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9132a-1d73-4dfe-b8bc-d4896b57ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.774778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9132a-1d73-4dfe-b8bc-d4896b57ac44 None admin] PATH_INFO: `/v3/users/a25b2f8164e94f6080d1fcbc88e91806` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-15e30d3e-db55-4e8a-b83f-62d2189c52d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:20.781130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:20.782070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:20.782880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:20.782880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:20.782880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:20.782880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:20.782880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:20.782880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:20.782880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:20.782880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:20.782880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:20.782880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:20.782880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:20.782880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:20.784190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 147/305] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:20.785444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4c44a-a9fe-4011-ab75-6c5b56e0b316 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.785735 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4c44a-a9fe-4011-ab75-6c5b56e0b316 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.786014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4c44a-a9fe-4011-ab75-6c5b56e0b316 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.787475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 148/306] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:20.791553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4c44a-a9fe-4011-ab75-6c5b56e0b316 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:20.797344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9132a-1d73-4dfe-b8bc-d4896b57ac44 None admin] RBAC: Authorizing `identity:get_user(user_id=a25b2f8164e94f6080d1fcbc88e91806)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:20.798851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9132a-1d73-4dfe-b8bc-d4896b57ac44 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:20.800774 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 159/307] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:20 2022] GET /identity/v3/users/a25b2f8164e94f6080d1fcbc88e91806 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:20.803975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3bb27-581b-4100-8b9b-c661b701a08c None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.804474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3bb27-581b-4100-8b9b-c661b701a08c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.805208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3bb27-581b-4100-8b9b-c661b701a08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.822568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-72b3bb27-581b-4100-8b9b-c661b701a08c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:20.823802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-72b3bb27-581b-4100-8b9b-c661b701a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:20.832940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:20.833708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:20.902688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 160/308] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:20.902688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3bb27-581b-4100-8b9b-c661b701a08c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:20.910051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4c44a-a9fe-4011-ab75-6c5b56e0b316 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:20.953939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93467e-92d9-435f-94ee-66e284170809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:20.954610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93467e-92d9-435f-94ee-66e284170809 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:20.954922 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93467e-92d9-435f-94ee-66e284170809 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:20.955195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93467e-92d9-435f-94ee-66e284170809 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:20.955971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93467e-92d9-435f-94ee-66e284170809 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:20.956278 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93467e-92d9-435f-94ee-66e284170809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:20.957664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93467e-92d9-435f-94ee-66e284170809 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:20.966711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 149/309] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:20.971714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93467e-92d9-435f-94ee-66e284170809 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:21.013011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3bb27-581b-4100-8b9b-c661b701a08c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:21.050224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb43c53-2708-4a8e-bf44-6b4c350dadda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:21.050892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb43c53-2708-4a8e-bf44-6b4c350dadda None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:21.051179 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb43c53-2708-4a8e-bf44-6b4c350dadda None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:21.051444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb43c53-2708-4a8e-bf44-6b4c350dadda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:21.052257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb43c53-2708-4a8e-bf44-6b4c350dadda None admin] RBAC: Adding query filter params (role.id=10b654dbef184b75888fa0bbd288b1c2, user.id=a25b2f8164e94f6080d1fcbc88e91806, scope.system=all) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:21.052748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb43c53-2708-4a8e-bf44-6b4c350dadda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:21.053977 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb43c53-2708-4a8e-bf44-6b4c350dadda None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:21.059707 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 161/310] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jun 21 08:02:20 2022] GET /identity/v3/role_assignments?user.id=a25b2f8164e94f6080d1fcbc88e91806&scope.system=all&role.id=10b654dbef184b75888fa0bbd288b1c2 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:21.060385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb43c53-2708-4a8e-bf44-6b4c350dadda None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:21.072054 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:21.092911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:21.099276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93467e-92d9-435f-94ee-66e284170809 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:21.151213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f40e7-5d48-46eb-919c-538fd3f4f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:21.153095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f40e7-5d48-46eb-919c-538fd3f4f064 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:21.153578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f40e7-5d48-46eb-919c-538fd3f4f064 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:21.154029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f40e7-5d48-46eb-919c-538fd3f4f064 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:21.171201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f40e7-5d48-46eb-919c-538fd3f4f064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:21.179382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb43c53-2708-4a8e-bf44-6b4c350dadda None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-155f40e7-5d48-46eb-919c-538fd3f4f064 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:21.183474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:21.184418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:21.185229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:21.185229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:21.185229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:21.185229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:21.185229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:21.185229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:21.185229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:21.185229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:21.185229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:21.185229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:21.185229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:21.185229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:21.190312 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 150/311] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:21.195759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f40e7-5d48-46eb-919c-538fd3f4f064 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:21.223483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981604e-08f7-448c-9e09-c6b7efd5adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:21.224275 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981604e-08f7-448c-9e09-c6b7efd5adb4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:21.224765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981604e-08f7-448c-9e09-c6b7efd5adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:21.224881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981604e-08f7-448c-9e09-c6b7efd5adb4 None admin] PATH_INFO: `/v3/users/e789d9ff55d747689bda56b63669d6df` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:21.226109 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981604e-08f7-448c-9e09-c6b7efd5adb4 None admin] RBAC: Authorizing `identity:get_user(user_id=e789d9ff55d747689bda56b63669d6df)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:21.227716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981604e-08f7-448c-9e09-c6b7efd5adb4 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:21.229704 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 162/312] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:21 2022] GET /identity/v3/users/e789d9ff55d747689bda56b63669d6df => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:21.236526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981604e-08f7-448c-9e09-c6b7efd5adb4 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:21.325956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:21.330130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f40e7-5d48-46eb-919c-538fd3f4f064 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:21.349711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981604e-08f7-448c-9e09-c6b7efd5adb4 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:21.368621 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca2e65-c62f-492f-bb2f-ef4472f92106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:21.370057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca2e65-c62f-492f-bb2f-ef4472f92106 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:21.371221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca2e65-c62f-492f-bb2f-ef4472f92106 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:21.371766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca2e65-c62f-492f-bb2f-ef4472f92106 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:21.372715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca2e65-c62f-492f-bb2f-ef4472f92106 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:21.373243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca2e65-c62f-492f-bb2f-ef4472f92106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:21.375239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca2e65-c62f-492f-bb2f-ef4472f92106 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:21.387634 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 151/313] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:21.392392 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6b594-46aa-45de-8d03-373d874cd957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:21.393293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6b594-46aa-45de-8d03-373d874cd957 None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:21.393576 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6b594-46aa-45de-8d03-373d874cd957 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:21.393848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6b594-46aa-45de-8d03-373d874cd957 None admin] PATH_INFO: `/v3/system/users/e789d9ff55d747689bda56b63669d6df/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:21.395386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6b594-46aa-45de-8d03-373d874cd957 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e789d9ff55d747689bda56b63669d6df, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:21.395893 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca2e65-c62f-492f-bb2f-ef4472f92106 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:21.396766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6b594-46aa-45de-8d03-373d874cd957 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:21.414174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 163/314] 10.222.0.36 () {58 vars in 1334 bytes} [Tue Jun 21 08:02:21 2022] PUT /identity/v3/system/users/e789d9ff55d747689bda56b63669d6df/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:21.428431 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:21.524601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca2e65-c62f-492f-bb2f-ef4472f92106 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:21.566819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b990f2-2dec-4c6b-aa29-697057079772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:21.567705 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b990f2-2dec-4c6b-aa29-697057079772 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:21.567985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b990f2-2dec-4c6b-aa29-697057079772 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:21.568259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b990f2-2dec-4c6b-aa29-697057079772 None admin] PATH_INFO: `/v3/users/d5c88e89325046328043124cabd3eca2` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:21.569520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b990f2-2dec-4c6b-aa29-697057079772 None admin] RBAC: Authorizing `identity:get_user(user_id=d5c88e89325046328043124cabd3eca2)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:21.571009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b990f2-2dec-4c6b-aa29-697057079772 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:21.572869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 152/315] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:21 2022] GET /identity/v3/users/d5c88e89325046328043124cabd3eca2 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:21.579282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6b594-46aa-45de-8d03-373d874cd957 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:21.695435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6b594-46aa-45de-8d03-373d874cd957 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:21.733862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1418-7055-46aa-964d-73c6ae877abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:21.734891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1418-7055-46aa-964d-73c6ae877abf None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:21.735379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1418-7055-46aa-964d-73c6ae877abf None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:21.735828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1418-7055-46aa-964d-73c6ae877abf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:21.748200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:21.813665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be1418-7055-46aa-964d-73c6ae877abf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:21.815437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be1418-7055-46aa-964d-73c6ae877abf None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:21.925516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 164/316] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:21.931714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b990f2-2dec-4c6b-aa29-697057079772 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:22.033123 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:22.046361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b990f2-2dec-4c6b-aa29-697057079772 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:22.081088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349132f1-d60a-4054-b041-0172505bb31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:22.081869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349132f1-d60a-4054-b041-0172505bb31c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:22.082153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349132f1-d60a-4054-b041-0172505bb31c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:22.082429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349132f1-d60a-4054-b041-0172505bb31c None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:22.083648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349132f1-d60a-4054-b041-0172505bb31c None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:22.085085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349132f1-d60a-4054-b041-0172505bb31c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:22.086808 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 153/317] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:21 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:22.093442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1418-7055-46aa-964d-73c6ae877abf None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:22.143664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:22.202541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1418-7055-46aa-964d-73c6ae877abf None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:22.242605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb36cea-72a2-45e9-8631-7f2adb473cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:22.243627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb36cea-72a2-45e9-8631-7f2adb473cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:22.244147 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb36cea-72a2-45e9-8631-7f2adb473cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:22.244617 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb36cea-72a2-45e9-8631-7f2adb473cf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:22.246305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb36cea-72a2-45e9-8631-7f2adb473cf4 None admin] RBAC: Adding query filter params (role.id=10b654dbef184b75888fa0bbd288b1c2, scope.project.id=5270bea9dd60407aa2ea22723624bbef, user.id=d5c88e89325046328043124cabd3eca2) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:22.246977 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb36cea-72a2-45e9-8631-7f2adb473cf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:22.248632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb36cea-72a2-45e9-8631-7f2adb473cf4 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:22.255638 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 165/318] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:22 2022] GET /identity/v3/role_assignments?user.id=d5c88e89325046328043124cabd3eca2&scope.project.id=5270bea9dd60407aa2ea22723624bbef&role.id=10b654dbef184b75888fa0bbd288b1c2 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:22.591091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e42cd-2539-44c9-b5b9-5cee50cbe994 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:22.591420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e42cd-2539-44c9-b5b9-5cee50cbe994 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:22.591654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e42cd-2539-44c9-b5b9-5cee50cbe994 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:22.593283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 154/319] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:22.599047 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbb70b-ce15-4c0f-ad52-d17ff0de124c None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:22.599379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbb70b-ce15-4c0f-ad52-d17ff0de124c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:22.599615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbb70b-ce15-4c0f-ad52-d17ff0de124c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:22.617705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-6cfbb70b-ce15-4c0f-ad52-d17ff0de124c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:22.618921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6cfbb70b-ce15-4c0f-ad52-d17ff0de124c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:22.699154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 166/320] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:22.720674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e42cd-2539-44c9-b5b9-5cee50cbe994 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:22.824357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e42cd-2539-44c9-b5b9-5cee50cbe994 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:22.856562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6216bff-2065-4034-a1f6-020115ba78d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:22.857343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6216bff-2065-4034-a1f6-020115ba78d6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:22.857623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6216bff-2065-4034-a1f6-020115ba78d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:22.857896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6216bff-2065-4034-a1f6-020115ba78d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:22.859077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6216bff-2065-4034-a1f6-020115ba78d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:22.860519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6216bff-2065-4034-a1f6-020115ba78d6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:22.862279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 155/321] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:22.867973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbb70b-ce15-4c0f-ad52-d17ff0de124c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:22.903808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:22.974905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbb70b-ce15-4c0f-ad52-d17ff0de124c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:23.010197 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0556da1-b136-4235-b6c5-b4e0744638a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:23.010891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0556da1-b136-4235-b6c5-b4e0744638a1 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:23.011232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0556da1-b136-4235-b6c5-b4e0744638a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:23.012000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0556da1-b136-4235-b6c5-b4e0744638a1 None admin] PATH_INFO: `/v3/groups` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:23.012703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0556da1-b136-4235-b6c5-b4e0744638a1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:23.014174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0556da1-b136-4235-b6c5-b4e0744638a1 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:23.035013 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 167/322] 10.222.0.36 () {60 vars in 1134 bytes} [Tue Jun 21 08:02:22 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:02:23.197243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a04a-278f-40d2-8f7e-b4e85007a155 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:23.197729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a04a-278f-40d2-8f7e-b4e85007a155 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:23.197729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a04a-278f-40d2-8f7e-b4e85007a155 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:23.199418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 156/323] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:23.204912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f2796-f37c-4753-aaca-be82297e2952 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:23.205358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f2796-f37c-4753-aaca-be82297e2952 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:23.205477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f2796-f37c-4753-aaca-be82297e2952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:23.223186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-b33f2796-f37c-4753-aaca-be82297e2952 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:23.224322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b33f2796-f37c-4753-aaca-be82297e2952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:23.303909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 168/324] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:23.325338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a04a-278f-40d2-8f7e-b4e85007a155 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:23.354575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:23.444489 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a04a-278f-40d2-8f7e-b4e85007a155 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:23.488498 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2105e-0c7b-4d7e-9afd-3167d961a550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:23.489298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2105e-0c7b-4d7e-9afd-3167d961a550 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:23.489575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2105e-0c7b-4d7e-9afd-3167d961a550 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:23.489847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2105e-0c7b-4d7e-9afd-3167d961a550 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:23.502138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2105e-0c7b-4d7e-9afd-3167d961a550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-d5d2105e-0c7b-4d7e-9afd-3167d961a550 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:23.510047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:23.511021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:23.511884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 157/325] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:23.518680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f2796-f37c-4753-aaca-be82297e2952 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:23.553517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:23.588797 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07142bc8-9e82-431f-a686-51aec46b34f6 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:23.589105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07142bc8-9e82-431f-a686-51aec46b34f6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:23.589873 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07142bc8-9e82-431f-a686-51aec46b34f6 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:23.591346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 158/326] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:02:23.597727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dc051-8fe3-47bb-9ddd-a073e2205dde None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:23.598388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dc051-8fe3-47bb-9ddd-a073e2205dde None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:23.598906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dc051-8fe3-47bb-9ddd-a073e2205dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:23.617930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-469dc051-8fe3-47bb-9ddd-a073e2205dde None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:23.619497 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-469dc051-8fe3-47bb-9ddd-a073e2205dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:23.668875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f2796-f37c-4753-aaca-be82297e2952 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:23.708641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 159/327] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:23.714127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8212a2-d57b-429b-80e1-b99bca953b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:23.715406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8212a2-d57b-429b-80e1-b99bca953b5c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:23.715692 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8212a2-d57b-429b-80e1-b99bca953b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:23.715968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8212a2-d57b-429b-80e1-b99bca953b5c None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:23.716736 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8212a2-d57b-429b-80e1-b99bca953b5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:23.717045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8212a2-d57b-429b-80e1-b99bca953b5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:23.718438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8212a2-d57b-429b-80e1-b99bca953b5c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:23.730838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 169/328] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:23.738043 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dc051-8fe3-47bb-9ddd-a073e2205dde None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:23.738177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8212a2-d57b-429b-80e1-b99bca953b5c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:23.759607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:23.859275 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:23.872190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dc051-8fe3-47bb-9ddd-a073e2205dde None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:23.880566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8212a2-d57b-429b-80e1-b99bca953b5c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:23.921598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb9f78-d180-45ca-86ad-5da2383d40de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:23.922849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb9f78-d180-45ca-86ad-5da2383d40de None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:23.923885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb9f78-d180-45ca-86ad-5da2383d40de None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:23.924509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb9f78-d180-45ca-86ad-5da2383d40de None admin] PATH_INFO: `/v3/users/a25b2f8164e94f6080d1fcbc88e91806` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:23.926706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb9f78-d180-45ca-86ad-5da2383d40de None admin] RBAC: Authorizing `identity:get_user(user_id=a25b2f8164e94f6080d1fcbc88e91806)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:23.931440 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb9f78-d180-45ca-86ad-5da2383d40de None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:23.933756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 160/329] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:23 2022] GET /identity/v3/users/a25b2f8164e94f6080d1fcbc88e91806 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:23.935282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe79603-3015-4bce-8dfe-c58ab95d4102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:23.936889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe79603-3015-4bce-8dfe-c58ab95d4102 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:23.937552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe79603-3015-4bce-8dfe-c58ab95d4102 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:23.938216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe79603-3015-4bce-8dfe-c58ab95d4102 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:23.939427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb9f78-d180-45ca-86ad-5da2383d40de None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:23.962322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe79603-3015-4bce-8dfe-c58ab95d4102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-dbe79603-3015-4bce-8dfe-c58ab95d4102 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:23.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:23.973282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:23.974079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:23.974079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:23.974079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:23.974079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:23.974079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:23.974079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:23.974079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:23.974079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:23.974079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:23.974079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:23.974079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:23.974079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:23.981026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 170/330] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:23.989910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe79603-3015-4bce-8dfe-c58ab95d4102 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:24.119419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:24.161094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb9f78-d180-45ca-86ad-5da2383d40de None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:24.178407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe79603-3015-4bce-8dfe-c58ab95d4102 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:24.220622 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068a33b-abd1-4cfa-a5c2-a93146b87193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:24.221267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068a33b-abd1-4cfa-a5c2-a93146b87193 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:24.221548 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068a33b-abd1-4cfa-a5c2-a93146b87193 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:24.221822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068a33b-abd1-4cfa-a5c2-a93146b87193 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:24.222570 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068a33b-abd1-4cfa-a5c2-a93146b87193 None admin] RBAC: Adding query filter params (name=member) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:24.222922 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068a33b-abd1-4cfa-a5c2-a93146b87193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:24.224472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068a33b-abd1-4cfa-a5c2-a93146b87193 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:24.237927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e1e8e-5084-484b-924b-363060e4cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:24.238912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e1e8e-5084-484b-924b-363060e4cb1b None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:24.239267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e1e8e-5084-484b-924b-363060e4cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:24.239542 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e1e8e-5084-484b-924b-363060e4cb1b None admin] PATH_INFO: `/v3/system/users/a25b2f8164e94f6080d1fcbc88e91806/roles/10b654dbef184b75888fa0bbd288b1c2` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:24.241329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 171/331] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:24.247886 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e1e8e-5084-484b-924b-363060e4cb1b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a25b2f8164e94f6080d1fcbc88e91806, role_id=10b654dbef184b75888fa0bbd288b1c2)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:24.249315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e1e8e-5084-484b-924b-363060e4cb1b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:24.252695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068a33b-abd1-4cfa-a5c2-a93146b87193 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:24.273284 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 161/332] 10.222.0.36 () {58 vars in 1334 bytes} [Tue Jun 21 08:02:23 2022] PUT /identity/v3/system/users/a25b2f8164e94f6080d1fcbc88e91806/roles/10b654dbef184b75888fa0bbd288b1c2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:24.274995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:24.391278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068a33b-abd1-4cfa-a5c2-a93146b87193 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:24.433975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba92b0f-44f6-4580-a072-85ed80fcf28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:24.434953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba92b0f-44f6-4580-a072-85ed80fcf28d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:24.435240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba92b0f-44f6-4580-a072-85ed80fcf28d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:24.435520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba92b0f-44f6-4580-a072-85ed80fcf28d None admin] PATH_INFO: `/v3/users/e789d9ff55d747689bda56b63669d6df` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:24.438693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba92b0f-44f6-4580-a072-85ed80fcf28d None admin] RBAC: Authorizing `identity:get_user(user_id=e789d9ff55d747689bda56b63669d6df)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:24.440202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba92b0f-44f6-4580-a072-85ed80fcf28d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:24.442130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 172/333] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:24 2022] GET /identity/v3/users/e789d9ff55d747689bda56b63669d6df => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:24.447692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e1e8e-5084-484b-924b-363060e4cb1b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:24.670250 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e1e8e-5084-484b-924b-363060e4cb1b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:24.723795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe6e66-c1e6-49a6-b19b-9bc8203edd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:24.724455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe6e66-c1e6-49a6-b19b-9bc8203edd63 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:24.724736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe6e66-c1e6-49a6-b19b-9bc8203edd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:24.725007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe6e66-c1e6-49a6-b19b-9bc8203edd63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:24.725846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe6e66-c1e6-49a6-b19b-9bc8203edd63 None admin] RBAC: Adding query filter params (role.id=9eb3c16b00c04e1c850bab61de15c44c, user.id=e789d9ff55d747689bda56b63669d6df, scope.system=all) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:24.726153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe6e66-c1e6-49a6-b19b-9bc8203edd63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:24.727664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe6e66-c1e6-49a6-b19b-9bc8203edd63 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:24.741524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 162/334] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jun 21 08:02:24 2022] GET /identity/v3/role_assignments?user.id=e789d9ff55d747689bda56b63669d6df&scope.system=all&role.id=9eb3c16b00c04e1c850bab61de15c44c => generated 510 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:26.010454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cce85-5703-4610-9c30-7a9ce8db9d2b None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:26.011715 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cce85-5703-4610-9c30-7a9ce8db9d2b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:26.012233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cce85-5703-4610-9c30-7a9ce8db9d2b None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:26.013811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 173/335] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:26.020030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe55f6-5eca-4a39-9497-c59610aa74ad None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:26.020451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe55f6-5eca-4a39-9497-c59610aa74ad None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:26.020638 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe55f6-5eca-4a39-9497-c59610aa74ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:26.027346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:26.039289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-67fe55f6-5eca-4a39-9497-c59610aa74ad None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:26.040749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-67fe55f6-5eca-4a39-9497-c59610aa74ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:26.132871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 163/336] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:26.174369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cce85-5703-4610-9c30-7a9ce8db9d2b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:26.271330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:26.300036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cce85-5703-4610-9c30-7a9ce8db9d2b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:26.338078 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24005-45f8-45d8-8090-c4cb6daedfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:26.339455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24005-45f8-45d8-8090-c4cb6daedfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:26.339944 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24005-45f8-45d8-8090-c4cb6daedfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:26.340421 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e24005-45f8-45d8-8090-c4cb6daedfd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:26.351645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e24005-45f8-45d8-8090-c4cb6daedfd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:26.361916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f705d-b477-4c24-a11b-7799483a4430 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:26.362446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f705d-b477-4c24-a11b-7799483a4430 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:26.362938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f705d-b477-4c24-a11b-7799483a4430 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:26.364505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 164/337] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-26e24005-45f8-45d8-8090-c4cb6daedfd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:26.365489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:26.366332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:26.367168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:26.367168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:26.367168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:26.367168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:26.367168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:26.367168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:26.367168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:26.367168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:26.367168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:26.367168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:26.367168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:26.367168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:26.369720 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 174/338] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:02:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:26.369821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daed22-1583-4e3d-928d-23a8363e4f13 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:26.374704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daed22-1583-4e3d-928d-23a8363e4f13 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:26.374704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daed22-1583-4e3d-928d-23a8363e4f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:26.375943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24005-45f8-45d8-8090-c4cb6daedfd1 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:26.405287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-60daed22-1583-4e3d-928d-23a8363e4f13 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:26.406545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-60daed22-1583-4e3d-928d-23a8363e4f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:26.502361 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e24005-45f8-45d8-8090-c4cb6daedfd1 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:26.510450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 165/339] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:26.533753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daed22-1583-4e3d-928d-23a8363e4f13 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:26.547374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a65fe4-8c16-42ed-8367-12bad1dd20f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:26.548401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a65fe4-8c16-42ed-8367-12bad1dd20f2 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:26.548882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a65fe4-8c16-42ed-8367-12bad1dd20f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:26.549378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a65fe4-8c16-42ed-8367-12bad1dd20f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:26.550323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a65fe4-8c16-42ed-8367-12bad1dd20f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:26.550927 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a65fe4-8c16-42ed-8367-12bad1dd20f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:26.552590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a65fe4-8c16-42ed-8367-12bad1dd20f2 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:26.555368 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:26.574744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 175/340] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:26.583883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a65fe4-8c16-42ed-8367-12bad1dd20f2 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:26.643802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:26.719108 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daed22-1583-4e3d-928d-23a8363e4f13 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:26.741947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a65fe4-8c16-42ed-8367-12bad1dd20f2 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:26.793335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e281b9d-e97b-4ac4-91ed-57c976e2e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:26.793908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e281b9d-e97b-4ac4-91ed-57c976e2e15c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:26.794187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e281b9d-e97b-4ac4-91ed-57c976e2e15c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:26.794454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e281b9d-e97b-4ac4-91ed-57c976e2e15c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:26.797504 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bbc45-0818-4252-90db-c909bf8376f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:26.798483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bbc45-0818-4252-90db-c909bf8376f5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:26.798827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bbc45-0818-4252-90db-c909bf8376f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:26.799102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bbc45-0818-4252-90db-c909bf8376f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:26.825552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bbc45-0818-4252-90db-c909bf8376f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-162bbc45-0818-4252-90db-c909bf8376f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:26.833375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:26.834222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:26.835052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 166/341] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:26.836151 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce61cf-a346-4e1f-8f06-687cfbfe9842 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:26.836429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce61cf-a346-4e1f-8f06-687cfbfe9842 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:26.836708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce61cf-a346-4e1f-8f06-687cfbfe9842 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:26.843008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 167/342] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:26.848334 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72469dd5-36a8-4d59-8c11-79b96e038efc None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:26.848624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72469dd5-36a8-4d59-8c11-79b96e038efc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:26.848900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72469dd5-36a8-4d59-8c11-79b96e038efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:26.876110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-72469dd5-36a8-4d59-8c11-79b96e038efc None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:26.877318 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-72469dd5-36a8-4d59-8c11-79b96e038efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:26.878375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:26.883314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e281b9d-e97b-4ac4-91ed-57c976e2e15c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:26.885154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e281b9d-e97b-4ac4-91ed-57c976e2e15c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:27.006853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 176/343] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 08:02:27.008436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e281b9d-e97b-4ac4-91ed-57c976e2e15c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:27.051945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 168/344] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:27.052785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72469dd5-36a8-4d59-8c11-79b96e038efc None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:27.132021 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:27.138689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e281b9d-e97b-4ac4-91ed-57c976e2e15c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:27.179601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:27.183906 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff28d-5cf7-4935-b3dc-03e6b7f6caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:27.185187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff28d-5cf7-4935-b3dc-03e6b7f6caa8 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:27.186258 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff28d-5cf7-4935-b3dc-03e6b7f6caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:27.186925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff28d-5cf7-4935-b3dc-03e6b7f6caa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:27.187869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbff28d-5cf7-4935-b3dc-03e6b7f6caa8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:27.188363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbff28d-5cf7-4935-b3dc-03e6b7f6caa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:27.190137 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbff28d-5cf7-4935-b3dc-03e6b7f6caa8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:27.201225 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 177/345] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:27.202477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff28d-5cf7-4935-b3dc-03e6b7f6caa8 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:27.261811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72469dd5-36a8-4d59-8c11-79b96e038efc None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:27.314708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff28d-5cf7-4935-b3dc-03e6b7f6caa8 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:27.332141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1c646-21d9-4eed-a548-3ffd7ffcfca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:27.333069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1c646-21d9-4eed-a548-3ffd7ffcfca4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:27.333357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1c646-21d9-4eed-a548-3ffd7ffcfca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:27.333634 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1c646-21d9-4eed-a548-3ffd7ffcfca4 None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:27.340084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1c646-21d9-4eed-a548-3ffd7ffcfca4 None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:27.341613 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1c646-21d9-4eed-a548-3ffd7ffcfca4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:27.343725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 169/346] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:27 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:27.344260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1c646-21d9-4eed-a548-3ffd7ffcfca4 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:27.354001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd1820-7365-4f34-9c7f-0ccc1b9f68a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:27.355328 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd1820-7365-4f34-9c7f-0ccc1b9f68a5 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:27.355981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd1820-7365-4f34-9c7f-0ccc1b9f68a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:27.356452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd1820-7365-4f34-9c7f-0ccc1b9f68a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:27.394136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd1820-7365-4f34-9c7f-0ccc1b9f68a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-39bd1820-7365-4f34-9c7f-0ccc1b9f68a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:27.416910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:27.418469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:27.419301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:27.419301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:27.419301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:27.419301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:27.419301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:27.419301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:27.419301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:27.419301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:27.419301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:27.419301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:27.419301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:27.419301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:27.426412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 178/347] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:27.431272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd1820-7365-4f34-9c7f-0ccc1b9f68a5 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:27.472277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:27.520049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1c646-21d9-4eed-a548-3ffd7ffcfca4 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:27.547653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:27.571494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f5cf9-2584-4978-807d-987b8975c586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:27.572177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f5cf9-2584-4978-807d-987b8975c586 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:27.572460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f5cf9-2584-4978-807d-987b8975c586 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:27.572751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f5cf9-2584-4978-807d-987b8975c586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:27.611999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd1820-7365-4f34-9c7f-0ccc1b9f68a5 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:27.653228 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac122b-07e5-4032-b28d-e267ed5331b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:27.653859 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac122b-07e5-4032-b28d-e267ed5331b3 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:27.654144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac122b-07e5-4032-b28d-e267ed5331b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:27.654423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac122b-07e5-4032-b28d-e267ed5331b3 None admin] PATH_INFO: `/v3/groups/ec7ba607636146f9bde231c5771de2e7` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:27.661908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac122b-07e5-4032-b28d-e267ed5331b3 None admin] RBAC: Authorizing `identity:get_group(group_id=ec7ba607636146f9bde231c5771de2e7)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:27.663526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac122b-07e5-4032-b28d-e267ed5331b3 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:27.665366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 179/348] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:27 2022] GET /identity/v3/groups/ec7ba607636146f9bde231c5771de2e7 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:27.669613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac122b-07e5-4032-b28d-e267ed5331b3 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:27.678803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f5cf9-2584-4978-807d-987b8975c586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:27.680685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f5cf9-2584-4978-807d-987b8975c586 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:27.775185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:27.795795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac122b-07e5-4032-b28d-e267ed5331b3 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:27.820397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 170/349] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:27.821778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0c50-8b47-4510-ac8d-8ac2b26dffe3 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:27.822065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0c50-8b47-4510-ac8d-8ac2b26dffe3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:27.822340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0c50-8b47-4510-ac8d-8ac2b26dffe3 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:27.824183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 171/350] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:27.826813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd8422-a1aa-4065-88f1-7042d6dd7a7c None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:27.827094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd8422-a1aa-4065-88f1-7042d6dd7a7c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:27.827371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd8422-a1aa-4065-88f1-7042d6dd7a7c None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:27.829162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 172/351] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:27.830198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd8422-a1aa-4065-88f1-7042d6dd7a7c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:27.850879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9393eb5-a573-46b1-b07f-b587f1e5ad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:27.851667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9393eb5-a573-46b1-b07f-b587f1e5ad74 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:27.851955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9393eb5-a573-46b1-b07f-b587f1e5ad74 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:27.852237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9393eb5-a573-46b1-b07f-b587f1e5ad74 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:27.853011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9393eb5-a573-46b1-b07f-b587f1e5ad74 None admin] RBAC: Adding query filter params (name=member) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:27.853323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9393eb5-a573-46b1-b07f-b587f1e5ad74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:27.855009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9393eb5-a573-46b1-b07f-b587f1e5ad74 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:27.861610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:27.866793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 180/352] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:27.867841 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9393eb5-a573-46b1-b07f-b587f1e5ad74 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:27.970684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd8422-a1aa-4065-88f1-7042d6dd7a7c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:27.987408 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9393eb5-a573-46b1-b07f-b587f1e5ad74 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:28.023714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be42df-aa04-4b78-b1eb-f88812c40419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:28.024366 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be42df-aa04-4b78-b1eb-f88812c40419 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:28.024639 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be42df-aa04-4b78-b1eb-f88812c40419 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:28.024943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be42df-aa04-4b78-b1eb-f88812c40419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:28.025733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be42df-aa04-4b78-b1eb-f88812c40419 None admin] RBAC: Adding query filter params (group.id=ec7ba607636146f9bde231c5771de2e7, role.id=8d803b40a63540ba80e3039f16774d46, scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:28.026037 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be42df-aa04-4b78-b1eb-f88812c40419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:28.028264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be42df-aa04-4b78-b1eb-f88812c40419 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:28.035800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 173/353] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 08:02:27 2022] GET /identity/v3/role_assignments?group.id=ec7ba607636146f9bde231c5771de2e7&scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6&role.id=8d803b40a63540ba80e3039f16774d46 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:28.039423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ecf9b-ff7a-4a19-9956-a248014db798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:28.040186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ecf9b-ff7a-4a19-9956-a248014db798 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:28.040472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ecf9b-ff7a-4a19-9956-a248014db798 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:28.040750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ecf9b-ff7a-4a19-9956-a248014db798 None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:28.044155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ecf9b-ff7a-4a19-9956-a248014db798 None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:28.044311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f059e16-b31f-486f-9ee6-884f7aaf19d9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:28.044311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f059e16-b31f-486f-9ee6-884f7aaf19d9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:28.044589 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f059e16-b31f-486f-9ee6-884f7aaf19d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:28.044684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ecf9b-ff7a-4a19-9956-a248014db798 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:28.046458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 181/354] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:27 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:28.047701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21987c-ee2b-47e8-8381-e2edd13ce5ab None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:28.047990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21987c-ee2b-47e8-8381-e2edd13ce5ab None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:28.048269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21987c-ee2b-47e8-8381-e2edd13ce5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:28.069519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-6c21987c-ee2b-47e8-8381-e2edd13ce5ab None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:28.070835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6c21987c-ee2b-47e8-8381-e2edd13ce5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:28.078236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0f059e16-b31f-486f-9ee6-884f7aaf19d9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:28.081009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0f059e16-b31f-486f-9ee6-884f7aaf19d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:28.084440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:28.163201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 182/355] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:28.165201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21987c-ee2b-47e8-8381-e2edd13ce5ab None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:28.177258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 174/356] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:28.178037 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f059e16-b31f-486f-9ee6-884f7aaf19d9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:28.203712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:28.311574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21987c-ee2b-47e8-8381-e2edd13ce5ab None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:28.328821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f059e16-b31f-486f-9ee6-884f7aaf19d9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:28.356710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223343d-c231-465d-987a-8b785c1ba026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:28.357707 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223343d-c231-465d-987a-8b785c1ba026 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:28.358169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223343d-c231-465d-987a-8b785c1ba026 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:28.358685 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223343d-c231-465d-987a-8b785c1ba026 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:28.375195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e0f20-fcf5-420b-9b2c-194cfc2a646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:28.375910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:28.377646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e0f20-fcf5-420b-9b2c-194cfc2a646e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:28.378116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e0f20-fcf5-420b-9b2c-194cfc2a646e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:28.378582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e0f20-fcf5-420b-9b2c-194cfc2a646e None admin] PATH_INFO: `/v3/groups/ec7ba607636146f9bde231c5771de2e7` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:28.380037 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e0f20-fcf5-420b-9b2c-194cfc2a646e None admin] RBAC: Authorizing `identity:get_group(group_id=ec7ba607636146f9bde231c5771de2e7)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:28.381696 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e0f20-fcf5-420b-9b2c-194cfc2a646e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:28.383659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 175/357] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:28 2022] GET /identity/v3/groups/ec7ba607636146f9bde231c5771de2e7 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:28.387078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57015b6-f3f2-4864-b6e1-8711cd415f55 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:28.387403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57015b6-f3f2-4864-b6e1-8711cd415f55 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:28.390292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57015b6-f3f2-4864-b6e1-8711cd415f55 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:28.390292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 176/358] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:28.390292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57015b6-f3f2-4864-b6e1-8711cd415f55 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:28.442232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223343d-c231-465d-987a-8b785c1ba026 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:28.444305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223343d-c231-465d-987a-8b785c1ba026 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:28.515635 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:28.530655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57015b6-f3f2-4864-b6e1-8711cd415f55 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:28.574068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 183/359] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:28.575782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223343d-c231-465d-987a-8b785c1ba026 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:28.585739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6adeaf-0cad-4f2c-9ebe-3c8408971027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:28.586853 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6adeaf-0cad-4f2c-9ebe-3c8408971027 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:28.586853 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6adeaf-0cad-4f2c-9ebe-3c8408971027 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:28.587140 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6adeaf-0cad-4f2c-9ebe-3c8408971027 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:28.600985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6adeaf-0cad-4f2c-9ebe-3c8408971027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ab6adeaf-0cad-4f2c-9ebe-3c8408971027 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:28.609357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:28.610272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:28.611152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:28.611152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:28.611152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:28.611152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:28.611152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:28.611152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:28.611152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:28.611152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:28.611152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:28.611152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:28.611152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:28.611152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:28.615189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 177/360] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:02:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:28.616647 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023354cc-ac6c-40a0-9875-5430b42f298e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:28.616940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023354cc-ac6c-40a0-9875-5430b42f298e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:28.617219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023354cc-ac6c-40a0-9875-5430b42f298e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:28.633750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:28.638163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-023354cc-ac6c-40a0-9875-5430b42f298e None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:28.639398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-023354cc-ac6c-40a0-9875-5430b42f298e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:28.716076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223343d-c231-465d-987a-8b785c1ba026 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:28.721126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 178/361] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:28.724495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023354cc-ac6c-40a0-9875-5430b42f298e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:28.761251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb9d67-48b5-4a31-8290-624c4d3d56b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:28.762279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb9d67-48b5-4a31-8290-624c4d3d56b5 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:28.762638 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb9d67-48b5-4a31-8290-624c4d3d56b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:28.762921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb9d67-48b5-4a31-8290-624c4d3d56b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:28.777037 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb9d67-48b5-4a31-8290-624c4d3d56b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-2deb9d67-48b5-4a31-8290-624c4d3d56b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:28.785891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:28.786830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:28.787618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 184/362] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:28.788285 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb9d67-48b5-4a31-8290-624c4d3d56b5 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:28.825101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:28.858663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023354cc-ac6c-40a0-9875-5430b42f298e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:28.905001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62025afa-f0c3-43d2-a232-4d09610a5d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:28.905663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62025afa-f0c3-43d2-a232-4d09610a5d23 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:28.905950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62025afa-f0c3-43d2-a232-4d09610a5d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:28.906225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62025afa-f0c3-43d2-a232-4d09610a5d23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:28.907153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62025afa-f0c3-43d2-a232-4d09610a5d23 None admin] RBAC: Adding query filter params (group.id=ec7ba607636146f9bde231c5771de2e7, role.id=9eb3c16b00c04e1c850bab61de15c44c, scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:28.907465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62025afa-f0c3-43d2-a232-4d09610a5d23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:28.909657 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62025afa-f0c3-43d2-a232-4d09610a5d23 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:28.917071 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 179/363] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 08:02:28 2022] GET /identity/v3/role_assignments?group.id=ec7ba607636146f9bde231c5771de2e7&scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6&role.id=9eb3c16b00c04e1c850bab61de15c44c => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:28.918520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62025afa-f0c3-43d2-a232-4d09610a5d23 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:28.930359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb9d67-48b5-4a31-8290-624c4d3d56b5 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:28.934305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:28.978545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39718bbb-5ac1-4cdc-8a66-bf70d17bebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:28.980289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718bbb-5ac1-4cdc-8a66-bf70d17bebfe None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:28.980799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718bbb-5ac1-4cdc-8a66-bf70d17bebfe None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:28.981300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718bbb-5ac1-4cdc-8a66-bf70d17bebfe None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:28.983665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39718bbb-5ac1-4cdc-8a66-bf70d17bebfe None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:28.986093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39718bbb-5ac1-4cdc-8a66-bf70d17bebfe None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:28.989029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 185/364] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:28 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:28.990758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39718bbb-5ac1-4cdc-8a66-bf70d17bebfe None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:29.067301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62025afa-f0c3-43d2-a232-4d09610a5d23 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:29.119527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc59e3b-c0c6-48ad-bedb-60078c42f38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:29.120650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc59e3b-c0c6-48ad-bedb-60078c42f38f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:29.120872 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc59e3b-c0c6-48ad-bedb-60078c42f38f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:29.121153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc59e3b-c0c6-48ad-bedb-60078c42f38f None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:29.121901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc59e3b-c0c6-48ad-bedb-60078c42f38f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:29.122233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc59e3b-c0c6-48ad-bedb-60078c42f38f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:29.123741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc59e3b-c0c6-48ad-bedb-60078c42f38f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:29.129996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:29.132589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39718bbb-5ac1-4cdc-8a66-bf70d17bebfe None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:29.135156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 180/365] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:29.136964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc59e3b-c0c6-48ad-bedb-60078c42f38f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:29.183397 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7938d5-4ca8-4101-ab86-c521eed83357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:29.184204 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7938d5-4ca8-4101-ab86-c521eed83357 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:29.184495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7938d5-4ca8-4101-ab86-c521eed83357 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:29.184775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7938d5-4ca8-4101-ab86-c521eed83357 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:29.200107 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7938d5-4ca8-4101-ab86-c521eed83357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-8f7938d5-4ca8-4101-ab86-c521eed83357 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:29.210148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:29.211079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:29.212395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 186/366] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:02:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:29.213076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7938d5-4ca8-4101-ab86-c521eed83357 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:29.265400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:29.291863 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc59e3b-c0c6-48ad-bedb-60078c42f38f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:29.344496 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f03e6-64ef-445d-a37d-4b1de766ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:29.345171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f03e6-64ef-445d-a37d-4b1de766ef1b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:29.345457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f03e6-64ef-445d-a37d-4b1de766ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:29.345737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f03e6-64ef-445d-a37d-4b1de766ef1b None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:29.346490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f03e6-64ef-445d-a37d-4b1de766ef1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:29.346833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f03e6-64ef-445d-a37d-4b1de766ef1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:29.348485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f03e6-64ef-445d-a37d-4b1de766ef1b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:29.358046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 181/367] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:29.359434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f03e6-64ef-445d-a37d-4b1de766ef1b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:29.375336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7938d5-4ca8-4101-ab86-c521eed83357 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:29.423264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6bbaa-92b1-4963-bcec-482c68b0f332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:29.424125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6bbaa-92b1-4963-bcec-482c68b0f332 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:29.424410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6bbaa-92b1-4963-bcec-482c68b0f332 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:29.424689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6bbaa-92b1-4963-bcec-482c68b0f332 None admin] PATH_INFO: `/v3/groups/ec7ba607636146f9bde231c5771de2e7` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:29.425941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6bbaa-92b1-4963-bcec-482c68b0f332 None admin] RBAC: Authorizing `identity:get_group(group_id=ec7ba607636146f9bde231c5771de2e7)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:29.427476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6bbaa-92b1-4963-bcec-482c68b0f332 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:29.430368 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 187/368] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:29 2022] GET /identity/v3/groups/ec7ba607636146f9bde231c5771de2e7 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:29.431338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6bbaa-92b1-4963-bcec-482c68b0f332 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:29.443684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:29.494380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f03e6-64ef-445d-a37d-4b1de766ef1b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:29.535646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9584baa-2493-42d7-a6b2-1ed4078f32ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:29.536677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9584baa-2493-42d7-a6b2-1ed4078f32ad None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:29.537168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9584baa-2493-42d7-a6b2-1ed4078f32ad None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:29.537645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9584baa-2493-42d7-a6b2-1ed4078f32ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:29.539558 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:29.543595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6bbaa-92b1-4963-bcec-482c68b0f332 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:29.581436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb272a2-071c-4c3d-ae58-02f1068d23b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:29.582118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb272a2-071c-4c3d-ae58-02f1068d23b4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:29.582451 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb272a2-071c-4c3d-ae58-02f1068d23b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:29.582768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb272a2-071c-4c3d-ae58-02f1068d23b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:29.583525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb272a2-071c-4c3d-ae58-02f1068d23b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:29.583879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb272a2-071c-4c3d-ae58-02f1068d23b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:29.587002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb272a2-071c-4c3d-ae58-02f1068d23b4 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:29.597874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 188/369] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:29.598792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb272a2-071c-4c3d-ae58-02f1068d23b4 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:29.617076 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9584baa-2493-42d7-a6b2-1ed4078f32ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:29.618722 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9584baa-2493-42d7-a6b2-1ed4078f32ad None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:29.691136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:29.710458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb272a2-071c-4c3d-ae58-02f1068d23b4 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:29.729147 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 182/370] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:29.734978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9584baa-2493-42d7-a6b2-1ed4078f32ad None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:29.774554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de3e0d-2ac6-45ea-be52-de05f302b793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:29.777291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de3e0d-2ac6-45ea-be52-de05f302b793 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:29.777771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de3e0d-2ac6-45ea-be52-de05f302b793 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:29.778169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de3e0d-2ac6-45ea-be52-de05f302b793 None admin] PATH_INFO: `/v3/users/a25b2f8164e94f6080d1fcbc88e91806` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:29.779604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de3e0d-2ac6-45ea-be52-de05f302b793 None admin] RBAC: Authorizing `identity:get_user(user_id=a25b2f8164e94f6080d1fcbc88e91806)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:29.781225 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de3e0d-2ac6-45ea-be52-de05f302b793 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:29.783749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 189/371] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:02:29 2022] GET /identity/v3/users/a25b2f8164e94f6080d1fcbc88e91806 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:29.784697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de3e0d-2ac6-45ea-be52-de05f302b793 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:29.829938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:29.856198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9584baa-2493-42d7-a6b2-1ed4078f32ad None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:29.899179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554931e-113c-437d-ae2c-c209a34c843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:29.900291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554931e-113c-437d-ae2c-c209a34c843b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:29.900789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554931e-113c-437d-ae2c-c209a34c843b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:29.901340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554931e-113c-437d-ae2c-c209a34c843b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:29.902367 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554931e-113c-437d-ae2c-c209a34c843b None admin] RBAC: Adding query filter params (group.id=ec7ba607636146f9bde231c5771de2e7, role.id=9eb3c16b00c04e1c850bab61de15c44c, scope.project.id=5270bea9dd60407aa2ea22723624bbef) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:29.902972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554931e-113c-437d-ae2c-c209a34c843b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:29.904769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554931e-113c-437d-ae2c-c209a34c843b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:29.919224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 183/372] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 08:02:29 2022] GET /identity/v3/role_assignments?group.id=ec7ba607636146f9bde231c5771de2e7&scope.project.id=5270bea9dd60407aa2ea22723624bbef&role.id=9eb3c16b00c04e1c850bab61de15c44c => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:29.920669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554931e-113c-437d-ae2c-c209a34c843b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:29.923120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de3e0d-2ac6-45ea-be52-de05f302b793 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:29.967627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cea8f-81bb-44a6-9554-61b46e0ecbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:29.968291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cea8f-81bb-44a6-9554-61b46e0ecbcc None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:29.968576 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cea8f-81bb-44a6-9554-61b46e0ecbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:29.968854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cea8f-81bb-44a6-9554-61b46e0ecbcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:29.975378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:30.058722 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cea8f-81bb-44a6-9554-61b46e0ecbcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:30.060224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cea8f-81bb-44a6-9554-61b46e0ecbcc None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:30.097557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:30.117869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554931e-113c-437d-ae2c-c209a34c843b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:30.188090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 190/373] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:30.189039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cea8f-81bb-44a6-9554-61b46e0ecbcc None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:30.191144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3c56a-b8b6-4ab9-8f2f-63ac0f10a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:30.192751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3c56a-b8b6-4ab9-8f2f-63ac0f10a463 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:30.193239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3c56a-b8b6-4ab9-8f2f-63ac0f10a463 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:30.193705 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3c56a-b8b6-4ab9-8f2f-63ac0f10a463 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:30.199252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3c56a-b8b6-4ab9-8f2f-63ac0f10a463 None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:30.201102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3c56a-b8b6-4ab9-8f2f-63ac0f10a463 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:30.203457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 184/374] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:29 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:30.204494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3c56a-b8b6-4ab9-8f2f-63ac0f10a463 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:30.328270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cea8f-81bb-44a6-9554-61b46e0ecbcc None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:30.373155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:30.379890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f548a-e9d7-4edf-b048-0ed193fb13d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:30.381093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f548a-e9d7-4edf-b048-0ed193fb13d3 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:30.381381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f548a-e9d7-4edf-b048-0ed193fb13d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:30.381663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f548a-e9d7-4edf-b048-0ed193fb13d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:30.382832 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f548a-e9d7-4edf-b048-0ed193fb13d3 None admin] RBAC: Adding query filter params (role.id=10b654dbef184b75888fa0bbd288b1c2, user.id=a25b2f8164e94f6080d1fcbc88e91806, scope.system=all) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:30.383155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f548a-e9d7-4edf-b048-0ed193fb13d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:30.384776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f548a-e9d7-4edf-b048-0ed193fb13d3 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:30.388414 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:30.405066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3c56a-b8b6-4ab9-8f2f-63ac0f10a463 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:30.410233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 191/375] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jun 21 08:02:30 2022] GET /identity/v3/role_assignments?user.id=a25b2f8164e94f6080d1fcbc88e91806&scope.system=all&role.id=10b654dbef184b75888fa0bbd288b1c2 => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:30.411177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f548a-e9d7-4edf-b048-0ed193fb13d3 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:30.462583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cddb0-2374-40af-9a1f-7fb0fdb15943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:30.463517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cddb0-2374-40af-9a1f-7fb0fdb15943 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:30.464346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cddb0-2374-40af-9a1f-7fb0fdb15943 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:30.465324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cddb0-2374-40af-9a1f-7fb0fdb15943 None admin] PATH_INFO: `/v3/projects/48e195a21c654d5fa117864a568a0c62` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:30.466749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cddb0-2374-40af-9a1f-7fb0fdb15943 None admin] RBAC: Authorizing `identity:get_project(project_id=48e195a21c654d5fa117864a568a0c62)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:30.470509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cddb0-2374-40af-9a1f-7fb0fdb15943 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:30.474801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 185/376] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:30 2022] GET /identity/v3/projects/48e195a21c654d5fa117864a568a0c62 => generated 344 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:30.477417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff2143-56da-4c87-b852-d8931ad03c2e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:30.477417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff2143-56da-4c87-b852-d8931ad03c2e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:30.477417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff2143-56da-4c87-b852-d8931ad03c2e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:30.483908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 186/377] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:30.483908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff2143-56da-4c87-b852-d8931ad03c2e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:30.549911 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f548a-e9d7-4edf-b048-0ed193fb13d3 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:30.586672 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4869693-7c83-4a1d-8232-c393dc66e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:30.587626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4869693-7c83-4a1d-8232-c393dc66e1ba None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:30.588005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4869693-7c83-4a1d-8232-c393dc66e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:30.588374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4869693-7c83-4a1d-8232-c393dc66e1ba None admin] PATH_INFO: `/v3/groups/ec7ba607636146f9bde231c5771de2e7` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:30.590352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4869693-7c83-4a1d-8232-c393dc66e1ba None admin] RBAC: Authorizing `identity:get_group(group_id=ec7ba607636146f9bde231c5771de2e7)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:30.591944 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4869693-7c83-4a1d-8232-c393dc66e1ba None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:30.594042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 192/378] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:30 2022] GET /identity/v3/groups/ec7ba607636146f9bde231c5771de2e7 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:30.596490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f12558-1b01-4074-8283-a5ad4830b8fd None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:30.596875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f12558-1b01-4074-8283-a5ad4830b8fd None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:30.597260 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f12558-1b01-4074-8283-a5ad4830b8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:30.624130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f0f12558-1b01-4074-8283-a5ad4830b8fd None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:30.625375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f0f12558-1b01-4074-8283-a5ad4830b8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:30.694199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff2143-56da-4c87-b852-d8931ad03c2e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:30.726265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:30.737005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45a4a9-51e4-48ec-b3d1-de06c242b6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:30.738216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45a4a9-51e4-48ec-b3d1-de06c242b6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:30.738765 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45a4a9-51e4-48ec-b3d1-de06c242b6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:30.739282 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45a4a9-51e4-48ec-b3d1-de06c242b6f6 None admin] PATH_INFO: `/v3/groups/b529a412a6d44d6690fb591ea403937c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:30.751353 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45a4a9-51e4-48ec-b3d1-de06c242b6f6 None admin] RBAC: Authorizing `identity:get_group(group_id=b529a412a6d44d6690fb591ea403937c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:30.754016 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45a4a9-51e4-48ec-b3d1-de06c242b6f6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:30.754489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 193/379] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:30.755449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f12558-1b01-4074-8283-a5ad4830b8fd None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:30.766674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 187/380] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:30 2022] GET /identity/v3/groups/b529a412a6d44d6690fb591ea403937c => generated 229 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:30.768323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45a4a9-51e4-48ec-b3d1-de06c242b6f6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:30.806235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:30.887572 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f12558-1b01-4074-8283-a5ad4830b8fd None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:30.903679 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45a4a9-51e4-48ec-b3d1-de06c242b6f6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:30.934150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144367-4277-4a4d-b461-7962361b16d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:30.934987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144367-4277-4a4d-b461-7962361b16d3 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:30.935332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144367-4277-4a4d-b461-7962361b16d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:30.935611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144367-4277-4a4d-b461-7962361b16d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:30.936991 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144367-4277-4a4d-b461-7962361b16d3 None admin] RBAC: Adding query filter params (group.id=ec7ba607636146f9bde231c5771de2e7, role.id=8d803b40a63540ba80e3039f16774d46, scope.project.id=5270bea9dd60407aa2ea22723624bbef) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:30.937438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144367-4277-4a4d-b461-7962361b16d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:30.939170 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144367-4277-4a4d-b461-7962361b16d3 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:30.946112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 194/381] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 08:02:30 2022] GET /identity/v3/role_assignments?group.id=ec7ba607636146f9bde231c5771de2e7&scope.project.id=5270bea9dd60407aa2ea22723624bbef&role.id=8d803b40a63540ba80e3039f16774d46 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:30.946966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144367-4277-4a4d-b461-7962361b16d3 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:30.948892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78108e18-eaf6-40ed-8e39-93caa1d09899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:30.950196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78108e18-eaf6-40ed-8e39-93caa1d09899 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:30.950736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78108e18-eaf6-40ed-8e39-93caa1d09899 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:30.952125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78108e18-eaf6-40ed-8e39-93caa1d09899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:30.953249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78108e18-eaf6-40ed-8e39-93caa1d09899 None admin] RBAC: Adding query filter params (group.id=b529a412a6d44d6690fb591ea403937c, role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=48e195a21c654d5fa117864a568a0c62) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:30.953798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78108e18-eaf6-40ed-8e39-93caa1d09899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:30.955548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78108e18-eaf6-40ed-8e39-93caa1d09899 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:30.970888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 188/382] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 08:02:30 2022] GET /identity/v3/role_assignments?group.id=b529a412a6d44d6690fb591ea403937c&scope.project.id=48e195a21c654d5fa117864a568a0c62&role.id=6fcc322b483a475399974562c1e5bd43 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:31.035172 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:31.104117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144367-4277-4a4d-b461-7962361b16d3 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:31.143248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30ac4d-d485-4962-94c5-a235f048a180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:31.144401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30ac4d-d485-4962-94c5-a235f048a180 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:31.144878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30ac4d-d485-4962-94c5-a235f048a180 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:31.145344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30ac4d-d485-4962-94c5-a235f048a180 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:31.158251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30ac4d-d485-4962-94c5-a235f048a180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-0e30ac4d-d485-4962-94c5-a235f048a180 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:31.167158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:31.168182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:31.168961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:31.168961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:31.168961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:31.168961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:31.168961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:31.168961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:31.168961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:31.168961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:31.168961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:31.168961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:31.168961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:31.168961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:31.171504 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 195/383] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:02:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:31.177829 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78108e18-eaf6-40ed-8e39-93caa1d09899 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:31.325978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:31.335776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78108e18-eaf6-40ed-8e39-93caa1d09899 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:31.384245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8df6bc-9d47-4f6c-9522-ad3755909b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:31.384929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df6bc-9d47-4f6c-9522-ad3755909b74 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:31.385217 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df6bc-9d47-4f6c-9522-ad3755909b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:31.385498 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df6bc-9d47-4f6c-9522-ad3755909b74 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:31.386300 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8df6bc-9d47-4f6c-9522-ad3755909b74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:31.386819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8df6bc-9d47-4f6c-9522-ad3755909b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:31.388225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8df6bc-9d47-4f6c-9522-ad3755909b74 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:31.403236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 189/384] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:31.409990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30ac4d-d485-4962-94c5-a235f048a180 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:31.432266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716abc3-be10-44c9-99d9-d35a6949fcbe None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:31.432665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716abc3-be10-44c9-99d9-d35a6949fcbe None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:31.432848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716abc3-be10-44c9-99d9-d35a6949fcbe None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:31.434304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 190/385] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:02:31.444548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4d2b-a961-42bf-8490-88cd5f47112a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:31.444833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4d2b-a961-42bf-8490-88cd5f47112a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:31.445384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4d2b-a961-42bf-8490-88cd5f47112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:31.472444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-10ac4d2b-a961-42bf-8490-88cd5f47112a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:31.473798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-10ac4d2b-a961-42bf-8490-88cd5f47112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:31.536392 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30ac4d-d485-4962-94c5-a235f048a180 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:31.551749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:31.585019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e5f0-0074-4b53-920b-e995e93af9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:31.586231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e5f0-0074-4b53-920b-e995e93af9ad None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:31.586738 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e5f0-0074-4b53-920b-e995e93af9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:31.587220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e5f0-0074-4b53-920b-e995e93af9ad None admin] PATH_INFO: `/v3/groups/ec7ba607636146f9bde231c5771de2e7` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:31.588638 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0e5f0-0074-4b53-920b-e995e93af9ad None admin] RBAC: Authorizing `identity:get_group(group_id=ec7ba607636146f9bde231c5771de2e7)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:31.590579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0e5f0-0074-4b53-920b-e995e93af9ad None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:31.592481 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 196/386] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:31 2022] GET /identity/v3/groups/ec7ba607636146f9bde231c5771de2e7 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:31.599817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e5f0-0074-4b53-920b-e995e93af9ad None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:31.636928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 191/387] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:31.675932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4d2b-a961-42bf-8490-88cd5f47112a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:31.767304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e5f0-0074-4b53-920b-e995e93af9ad None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:31.813547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:31.839746 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4d2b-a961-42bf-8490-88cd5f47112a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:31.843304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaef885-e1b2-403c-bad0-548af2329423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:31.844425 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaef885-e1b2-403c-bad0-548af2329423 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:31.844904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaef885-e1b2-403c-bad0-548af2329423 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:31.845394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaef885-e1b2-403c-bad0-548af2329423 None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:31.846850 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaef885-e1b2-403c-bad0-548af2329423 None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:31.848587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaef885-e1b2-403c-bad0-548af2329423 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:31.855149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 197/388] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:31 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:31.859642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaef885-e1b2-403c-bad0-548af2329423 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:31.888946 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242d4c4-483b-4e8e-a8cd-3d08085c4695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:31.889753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242d4c4-483b-4e8e-a8cd-3d08085c4695 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:31.890039 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242d4c4-483b-4e8e-a8cd-3d08085c4695 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:31.890324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242d4c4-483b-4e8e-a8cd-3d08085c4695 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:31.917882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242d4c4-483b-4e8e-a8cd-3d08085c4695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-3242d4c4-483b-4e8e-a8cd-3d08085c4695 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:31.927201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:31.928058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:31.928846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 192/389] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:31.936350 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242d4c4-483b-4e8e-a8cd-3d08085c4695 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:31.944069 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:32.004567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaef885-e1b2-403c-bad0-548af2329423 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:32.045863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876d7e2-377b-421c-baae-5b15c624a412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:32.046773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876d7e2-377b-421c-baae-5b15c624a412 None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:32.047052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876d7e2-377b-421c-baae-5b15c624a412 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:32.047325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876d7e2-377b-421c-baae-5b15c624a412 None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6/groups/ec7ba607636146f9bde231c5771de2e7/roles/8d803b40a63540ba80e3039f16774d46` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:32.052424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876d7e2-377b-421c-baae-5b15c624a412 None admin] RBAC: Authorizing `identity:create_grant(project_id=989c7a7c2f7f49e5be8e751b4ec32db6, group_id=ec7ba607636146f9bde231c5771de2e7, role_id=8d803b40a63540ba80e3039f16774d46)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:32.053878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876d7e2-377b-421c-baae-5b15c624a412 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:32.075904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242d4c4-483b-4e8e-a8cd-3d08085c4695 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:32.085513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 198/390] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 21 08:02:31 2022] PUT /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6/groups/ec7ba607636146f9bde231c5771de2e7/roles/8d803b40a63540ba80e3039f16774d46 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:02:32.117844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62933b8c-6770-4714-902f-89a4aabacfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:32.118661 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62933b8c-6770-4714-902f-89a4aabacfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:32.118954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62933b8c-6770-4714-902f-89a4aabacfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:32.119231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62933b8c-6770-4714-902f-89a4aabacfe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:32.120534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62933b8c-6770-4714-902f-89a4aabacfe7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:32.120849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62933b8c-6770-4714-902f-89a4aabacfe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:32.122243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62933b8c-6770-4714-902f-89a4aabacfe7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:32.132506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 193/391] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:32.139612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876d7e2-377b-421c-baae-5b15c624a412 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:32.278519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876d7e2-377b-421c-baae-5b15c624a412 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:32.286316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:32.319104 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304a015-91d2-4429-8d12-7d8461f89fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:32.319973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304a015-91d2-4429-8d12-7d8461f89fdb None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:32.320256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304a015-91d2-4429-8d12-7d8461f89fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:32.320535 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304a015-91d2-4429-8d12-7d8461f89fdb None admin] PATH_INFO: `/v3/groups/ec7ba607636146f9bde231c5771de2e7` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:32.321724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304a015-91d2-4429-8d12-7d8461f89fdb None admin] RBAC: Authorizing `identity:get_group(group_id=ec7ba607636146f9bde231c5771de2e7)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:32.323790 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304a015-91d2-4429-8d12-7d8461f89fdb None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:32.325791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 199/392] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:32 2022] GET /identity/v3/groups/ec7ba607636146f9bde231c5771de2e7 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:32.331065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62933b8c-6770-4714-902f-89a4aabacfe7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:32.335069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:32.443467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62933b8c-6770-4714-902f-89a4aabacfe7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:32.477808 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639705e-a45c-47df-a3b3-8cf5c86e1f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:32.478761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639705e-a45c-47df-a3b3-8cf5c86e1f55 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:32.479052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639705e-a45c-47df-a3b3-8cf5c86e1f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:32.479969 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639705e-a45c-47df-a3b3-8cf5c86e1f55 None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:32.481231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639705e-a45c-47df-a3b3-8cf5c86e1f55 None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:32.482701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639705e-a45c-47df-a3b3-8cf5c86e1f55 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:32.484775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 194/393] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:32 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:32.492595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304a015-91d2-4429-8d12-7d8461f89fdb None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:32.642388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304a015-91d2-4429-8d12-7d8461f89fdb None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:32.684771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb70b40-e99f-45c6-81d2-d5fb194844c6 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:32.685063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb70b40-e99f-45c6-81d2-d5fb194844c6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:32.685324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb70b40-e99f-45c6-81d2-d5fb194844c6 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:32.686000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2fbff-a4fc-4d30-8a01-8e8fc9eb0cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:32.686903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2fbff-a4fc-4d30-8a01-8e8fc9eb0cdf None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:32.687015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 195/394] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:02:32.687193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2fbff-a4fc-4d30-8a01-8e8fc9eb0cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:32.687445 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2fbff-a4fc-4d30-8a01-8e8fc9eb0cdf None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6/groups/ec7ba607636146f9bde231c5771de2e7/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:32.691969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2fbff-a4fc-4d30-8a01-8e8fc9eb0cdf None admin] RBAC: Authorizing `identity:create_grant(project_id=989c7a7c2f7f49e5be8e751b4ec32db6, group_id=ec7ba607636146f9bde231c5771de2e7, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:32.692123 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe974118-6c3e-44c1-8eaa-e486da51d3df None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:32.692370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe974118-6c3e-44c1-8eaa-e486da51d3df None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:32.692651 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe974118-6c3e-44c1-8eaa-e486da51d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:32.693423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2fbff-a4fc-4d30-8a01-8e8fc9eb0cdf None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:32.716789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-fe974118-6c3e-44c1-8eaa-e486da51d3df None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:32.718525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fe974118-6c3e-44c1-8eaa-e486da51d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:32.733947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 200/395] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 21 08:02:32 2022] PUT /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6/groups/ec7ba607636146f9bde231c5771de2e7/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:32.834029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 196/396] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:32.859528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2fbff-a4fc-4d30-8a01-8e8fc9eb0cdf None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:32.912141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:33.001524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2fbff-a4fc-4d30-8a01-8e8fc9eb0cdf None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:33.037731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455d134-894f-4478-abab-8a59f4707a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:33.038962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455d134-894f-4478-abab-8a59f4707a86 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:33.039291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455d134-894f-4478-abab-8a59f4707a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:33.039567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455d134-894f-4478-abab-8a59f4707a86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:33.051309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455d134-894f-4478-abab-8a59f4707a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-e455d134-894f-4478-abab-8a59f4707a86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:33.059288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:33.060168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:33.061620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 201/397] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:33.066479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe974118-6c3e-44c1-8eaa-e486da51d3df None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:33.083095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:33.211831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe974118-6c3e-44c1-8eaa-e486da51d3df None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:33.249470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50e4a9-ca72-4996-a538-24046795b6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:33.250139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e4a9-ca72-4996-a538-24046795b6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:33.250420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e4a9-ca72-4996-a538-24046795b6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:33.250726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e4a9-ca72-4996-a538-24046795b6e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:33.251481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50e4a9-ca72-4996-a538-24046795b6e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:33.251790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50e4a9-ca72-4996-a538-24046795b6e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:33.253169 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50e4a9-ca72-4996-a538-24046795b6e1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:33.262728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 197/398] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:33.267889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455d134-894f-4478-abab-8a59f4707a86 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:33.432960 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:33.441474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455d134-894f-4478-abab-8a59f4707a86 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:33.501842 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84980778-b83b-4fed-baf2-dee41652bcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:33.502642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84980778-b83b-4fed-baf2-dee41652bcba None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:33.502938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84980778-b83b-4fed-baf2-dee41652bcba None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:33.503217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84980778-b83b-4fed-baf2-dee41652bcba None admin] PATH_INFO: `/v3/groups/ec7ba607636146f9bde231c5771de2e7` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:33.507334 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84980778-b83b-4fed-baf2-dee41652bcba None admin] RBAC: Authorizing `identity:get_group(group_id=ec7ba607636146f9bde231c5771de2e7)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:33.510124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84980778-b83b-4fed-baf2-dee41652bcba None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:33.513300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 202/399] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:33 2022] GET /identity/v3/groups/ec7ba607636146f9bde231c5771de2e7 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:33.518551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50e4a9-ca72-4996-a538-24046795b6e1 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:33.623114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:33.679033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50e4a9-ca72-4996-a538-24046795b6e1 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:33.726191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8d0ae-e4d0-40d4-945c-c79d91cd756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:33.727464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8d0ae-e4d0-40d4-945c-c79d91cd756b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:33.728111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8d0ae-e4d0-40d4-945c-c79d91cd756b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:33.728586 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8d0ae-e4d0-40d4-945c-c79d91cd756b None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:33.735521 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8d0ae-e4d0-40d4-945c-c79d91cd756b None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:33.737238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8d0ae-e4d0-40d4-945c-c79d91cd756b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:33.739218 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 198/400] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:33 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:33.745918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84980778-b83b-4fed-baf2-dee41652bcba None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:33.790035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1477a3-6b28-483d-9713-9672dc1486d0 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:33.790660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1477a3-6b28-483d-9713-9672dc1486d0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:33.791294 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1477a3-6b28-483d-9713-9672dc1486d0 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:33.794871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 199/401] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:33.800167 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388d385-faad-44a8-aece-9c842c39e1d9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:33.800746 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388d385-faad-44a8-aece-9c842c39e1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:33.801237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388d385-faad-44a8-aece-9c842c39e1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:33.828968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b388d385-faad-44a8-aece-9c842c39e1d9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:33.830753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b388d385-faad-44a8-aece-9c842c39e1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:33.874201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84980778-b83b-4fed-baf2-dee41652bcba None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:33.913066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd019c-5dce-4e36-91e5-b5489e8eb21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:33.914291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd019c-5dce-4e36-91e5-b5489e8eb21e None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:33.914829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd019c-5dce-4e36-91e5-b5489e8eb21e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:33.915316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd019c-5dce-4e36-91e5-b5489e8eb21e None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef/groups/ec7ba607636146f9bde231c5771de2e7/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:33.918757 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd019c-5dce-4e36-91e5-b5489e8eb21e None admin] RBAC: Authorizing `identity:create_grant(project_id=5270bea9dd60407aa2ea22723624bbef, group_id=ec7ba607636146f9bde231c5771de2e7, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:33.921075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd019c-5dce-4e36-91e5-b5489e8eb21e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:33.938500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 203/402] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 21 08:02:33 2022] PUT /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef/groups/ec7ba607636146f9bde231c5771de2e7/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:33.949680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 200/403] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:33.971117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd019c-5dce-4e36-91e5-b5489e8eb21e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:34.014133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:34.040018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87496e0-7427-4e29-abc4-1ecb5154d0fd None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:34.041390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87496e0-7427-4e29-abc4-1ecb5154d0fd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:34.042711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87496e0-7427-4e29-abc4-1ecb5154d0fd None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:34.048337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 201/404] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:34.050224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24551f2a-0aa0-4ae6-996a-71c9a455e986 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:34.050752 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24551f2a-0aa0-4ae6-996a-71c9a455e986 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:34.051233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24551f2a-0aa0-4ae6-996a-71c9a455e986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:34.077055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-24551f2a-0aa0-4ae6-996a-71c9a455e986 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:34.078776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-24551f2a-0aa0-4ae6-996a-71c9a455e986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:34.117673 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd019c-5dce-4e36-91e5-b5489e8eb21e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:34.157005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:34.164208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7900f3-3e7b-4517-a187-6770e01b872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:34.165005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7900f3-3e7b-4517-a187-6770e01b872f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:34.165297 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7900f3-3e7b-4517-a187-6770e01b872f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:34.165566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7900f3-3e7b-4517-a187-6770e01b872f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:34.172756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 202/405] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:34.178129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7900f3-3e7b-4517-a187-6770e01b872f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-ef7900f3-3e7b-4517-a187-6770e01b872f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:34.187019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:34.187919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:34.188891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 204/406] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:02:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:34.193944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24551f2a-0aa0-4ae6-996a-71c9a455e986 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:34.205386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7900f3-3e7b-4517-a187-6770e01b872f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:34.310202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24551f2a-0aa0-4ae6-996a-71c9a455e986 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:34.347915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc7334-65fc-4721-a60e-e24b0e043f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:34.348589 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc7334-65fc-4721-a60e-e24b0e043f0e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:34.348871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc7334-65fc-4721-a60e-e24b0e043f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:34.349146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc7334-65fc-4721-a60e-e24b0e043f0e None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:34.349895 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc7334-65fc-4721-a60e-e24b0e043f0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:34.350205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc7334-65fc-4721-a60e-e24b0e043f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:34.351611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc7334-65fc-4721-a60e-e24b0e043f0e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:34.361941 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 203/407] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:34.367149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc7334-65fc-4721-a60e-e24b0e043f0e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:34.410977 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:34.439040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:34.486390 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7900f3-3e7b-4517-a187-6770e01b872f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:34.490223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc7334-65fc-4721-a60e-e24b0e043f0e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:34.562724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22ec63-3976-485f-b671-915261610855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:34.563475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22ec63-3976-485f-b671-915261610855 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:34.563757 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22ec63-3976-485f-b671-915261610855 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:34.564034 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22ec63-3976-485f-b671-915261610855 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:34.567353 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22daf25-a6fb-4622-98bd-0e136a6561c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:34.568573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22daf25-a6fb-4622-98bd-0e136a6561c9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:34.568866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22daf25-a6fb-4622-98bd-0e136a6561c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:34.569138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22daf25-a6fb-4622-98bd-0e136a6561c9 None admin] PATH_INFO: `/v3/groups/b529a412a6d44d6690fb591ea403937c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:34.577229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22daf25-a6fb-4622-98bd-0e136a6561c9 None admin] RBAC: Authorizing `identity:get_group(group_id=b529a412a6d44d6690fb591ea403937c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:34.577229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22daf25-a6fb-4622-98bd-0e136a6561c9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:34.577229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 204/408] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:34 2022] GET /identity/v3/groups/b529a412a6d44d6690fb591ea403937c => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:34.580540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22daf25-a6fb-4622-98bd-0e136a6561c9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:34.599379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22ec63-3976-485f-b671-915261610855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-8e22ec63-3976-485f-b671-915261610855 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:34.608327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:34.609226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:34.609998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:34.609998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:34.609998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:34.609998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:34.609998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:34.609998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:34.609998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:34.609998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:34.609998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:34.609998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:34.609998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:34.609998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:34.620462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 205/409] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:02:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:34.626355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22ec63-3976-485f-b671-915261610855 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:34.708112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22daf25-a6fb-4622-98bd-0e136a6561c9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:34.733243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:34.749587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8afd6-c8cc-4680-87aa-0cd1d85267f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:34.750897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8afd6-c8cc-4680-87aa-0cd1d85267f4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:34.751430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8afd6-c8cc-4680-87aa-0cd1d85267f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:34.751985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8afd6-c8cc-4680-87aa-0cd1d85267f4 None admin] PATH_INFO: `/v3/projects/48e195a21c654d5fa117864a568a0c62` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:34.753392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8afd6-c8cc-4680-87aa-0cd1d85267f4 None admin] RBAC: Authorizing `identity:get_project(project_id=48e195a21c654d5fa117864a568a0c62)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:34.754345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22ec63-3976-485f-b671-915261610855 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:34.755297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8afd6-c8cc-4680-87aa-0cd1d85267f4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:34.757844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 205/410] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:34 2022] GET /identity/v3/projects/48e195a21c654d5fa117864a568a0c62 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:34.759393 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42016066-700a-44b1-8a72-bd3767ebef50 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:34.759976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42016066-700a-44b1-8a72-bd3767ebef50 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:34.760507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42016066-700a-44b1-8a72-bd3767ebef50 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:34.763428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 206/411] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:34.764445 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42016066-700a-44b1-8a72-bd3767ebef50 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:34.801275 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043d37d-ce01-41e1-94bf-0b9096d1bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:34.802100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043d37d-ce01-41e1-94bf-0b9096d1bf59 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:34.802384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043d37d-ce01-41e1-94bf-0b9096d1bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:34.802685 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043d37d-ce01-41e1-94bf-0b9096d1bf59 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:34.803752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043d37d-ce01-41e1-94bf-0b9096d1bf59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:34.804063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043d37d-ce01-41e1-94bf-0b9096d1bf59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:34.805731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043d37d-ce01-41e1-94bf-0b9096d1bf59 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:34.816465 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 206/412] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:34.818070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ad113-4fb1-491a-84ee-b5de83500255 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:34.818361 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ad113-4fb1-491a-84ee-b5de83500255 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:34.818659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ad113-4fb1-491a-84ee-b5de83500255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:34.825796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:34.840640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-114ad113-4fb1-491a-84ee-b5de83500255 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:34.842038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-114ad113-4fb1-491a-84ee-b5de83500255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:34.886868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42016066-700a-44b1-8a72-bd3767ebef50 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:34.924374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2e5af-fc80-4e9d-934b-82db6bf9d08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:34.924595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 207/413] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:34.924980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ad113-4fb1-491a-84ee-b5de83500255 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:34.926039 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2e5af-fc80-4e9d-934b-82db6bf9d08c None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:34.926572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2e5af-fc80-4e9d-934b-82db6bf9d08c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:34.927196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2e5af-fc80-4e9d-934b-82db6bf9d08c None admin] PATH_INFO: `/v3/projects/48e195a21c654d5fa117864a568a0c62/groups/b529a412a6d44d6690fb591ea403937c/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:34.929573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2e5af-fc80-4e9d-934b-82db6bf9d08c None admin] RBAC: Authorizing `identity:create_grant(project_id=48e195a21c654d5fa117864a568a0c62, group_id=b529a412a6d44d6690fb591ea403937c, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:34.931344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2e5af-fc80-4e9d-934b-82db6bf9d08c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:34.950056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 207/414] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 21 08:02:34 2022] PUT /identity/v3/projects/48e195a21c654d5fa117864a568a0c62/groups/b529a412a6d44d6690fb591ea403937c/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:34.957077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2e5af-fc80-4e9d-934b-82db6bf9d08c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:35.026834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:35.094842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2e5af-fc80-4e9d-934b-82db6bf9d08c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:35.118460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ad113-4fb1-491a-84ee-b5de83500255 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:35.138462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c400-f698-48b8-b19e-a7d7bd80b8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:35.139683 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c400-f698-48b8-b19e-a7d7bd80b8ba None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:35.140246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c400-f698-48b8-b19e-a7d7bd80b8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:35.140719 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c400-f698-48b8-b19e-a7d7bd80b8ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:35.155755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9c400-f698-48b8-b19e-a7d7bd80b8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-80f9c400-f698-48b8-b19e-a7d7bd80b8ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:35.165311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:35.166247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:35.167296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:35.167296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:35.167296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:35.167296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:35.167296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:35.167296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:35.167296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:35.167296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:35.167296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:35.167296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:35.167296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:35.167296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:35.175359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 208/415] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:02:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:35.177665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c400-f698-48b8-b19e-a7d7bd80b8ba None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:35.215279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a345b6e-5dd6-4178-ba2c-8d41d49e50c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:35.216148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345b6e-5dd6-4178-ba2c-8d41d49e50c7 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:35.216424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345b6e-5dd6-4178-ba2c-8d41d49e50c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:35.216721 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345b6e-5dd6-4178-ba2c-8d41d49e50c7 None admin] PATH_INFO: `/v3/groups/ec7ba607636146f9bde231c5771de2e7` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:35.217899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a345b6e-5dd6-4178-ba2c-8d41d49e50c7 None admin] RBAC: Authorizing `identity:get_group(group_id=ec7ba607636146f9bde231c5771de2e7)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:35.219653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a345b6e-5dd6-4178-ba2c-8d41d49e50c7 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:35.221633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 208/416] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:34 2022] GET /identity/v3/groups/ec7ba607636146f9bde231c5771de2e7 => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:35.227707 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a345b6e-5dd6-4178-ba2c-8d41d49e50c7 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:35.234402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:35.314493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c400-f698-48b8-b19e-a7d7bd80b8ba None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:35.327390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:35.366687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34022b73-5976-421f-a233-888e0deec8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:35.367684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34022b73-5976-421f-a233-888e0deec8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:35.368169 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34022b73-5976-421f-a233-888e0deec8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:35.368745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34022b73-5976-421f-a233-888e0deec8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:35.374641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a345b6e-5dd6-4178-ba2c-8d41d49e50c7 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:35.375706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34022b73-5976-421f-a233-888e0deec8f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:35.376251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34022b73-5976-421f-a233-888e0deec8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:35.377856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34022b73-5976-421f-a233-888e0deec8f3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:35.402674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 209/417] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:35.405949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34022b73-5976-421f-a233-888e0deec8f3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:35.415388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0941a29-62b5-42f6-861a-49cdf951b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:35.416247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0941a29-62b5-42f6-861a-49cdf951b324 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:35.416525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0941a29-62b5-42f6-861a-49cdf951b324 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:35.417661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0941a29-62b5-42f6-861a-49cdf951b324 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:35.419047 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0941a29-62b5-42f6-861a-49cdf951b324 None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:35.421043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0941a29-62b5-42f6-861a-49cdf951b324 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:35.423855 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 209/418] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:35 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:35.425355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e220de-b96d-4921-8b4f-5a859827b00a None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:35.425639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e220de-b96d-4921-8b4f-5a859827b00a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:35.425912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e220de-b96d-4921-8b4f-5a859827b00a None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:35.431035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 210/419] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:35.431035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e220de-b96d-4921-8b4f-5a859827b00a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:35.517908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:35.523757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34022b73-5976-421f-a233-888e0deec8f3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:35.553049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e220de-b96d-4921-8b4f-5a859827b00a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:35.562176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabb738-3460-4653-b2cc-d0a6a5192824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:35.562858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabb738-3460-4653-b2cc-d0a6a5192824 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:35.563139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabb738-3460-4653-b2cc-d0a6a5192824 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:35.563415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabb738-3460-4653-b2cc-d0a6a5192824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:35.595702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a57102-1a7c-46aa-9bf3-f79547fcdd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:35.597288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a57102-1a7c-46aa-9bf3-f79547fcdd78 None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:35.597805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a57102-1a7c-46aa-9bf3-f79547fcdd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:35.598293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a57102-1a7c-46aa-9bf3-f79547fcdd78 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef/groups/ec7ba607636146f9bde231c5771de2e7/roles/8d803b40a63540ba80e3039f16774d46` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:35.600852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a57102-1a7c-46aa-9bf3-f79547fcdd78 None admin] RBAC: Authorizing `identity:create_grant(project_id=5270bea9dd60407aa2ea22723624bbef, group_id=ec7ba607636146f9bde231c5771de2e7, role_id=8d803b40a63540ba80e3039f16774d46)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:35.602546 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a57102-1a7c-46aa-9bf3-f79547fcdd78 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:35.610052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:35.625726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 211/420] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 21 08:02:35 2022] PUT /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef/groups/ec7ba607636146f9bde231c5771de2e7/roles/8d803b40a63540ba80e3039f16774d46 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:35.627903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e13d8-e592-4e07-a53d-452ba96c1471 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:35.628920 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e13d8-e592-4e07-a53d-452ba96c1471 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:35.629561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e13d8-e592-4e07-a53d-452ba96c1471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:35.643641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabb738-3460-4653-b2cc-d0a6a5192824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:35.645119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabb738-3460-4653-b2cc-d0a6a5192824 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:35.653604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-869e13d8-e592-4e07-a53d-452ba96c1471 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:35.656039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-869e13d8-e592-4e07-a53d-452ba96c1471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:35.773162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 210/421] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:35.775555 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabb738-3460-4653-b2cc-d0a6a5192824 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:35.800051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 212/422] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:35.842518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e13d8-e592-4e07-a53d-452ba96c1471 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:35.886438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:35.921539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:35.921873 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabb738-3460-4653-b2cc-d0a6a5192824 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:35.976371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94defc-d60c-4b3b-9594-fdf47599eb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:35.977608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94defc-d60c-4b3b-9594-fdf47599eb2b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:35.978092 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94defc-d60c-4b3b-9594-fdf47599eb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:35.978564 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94defc-d60c-4b3b-9594-fdf47599eb2b None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:35.981539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94defc-d60c-4b3b-9594-fdf47599eb2b None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:35.983279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94defc-d60c-4b3b-9594-fdf47599eb2b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:35.984383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e13d8-e592-4e07-a53d-452ba96c1471 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:35.985428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 211/423] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:35 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:35.991354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94defc-d60c-4b3b-9594-fdf47599eb2b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:36.029398 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2626ec-0fde-46a5-9b2b-ebf221edd628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:36.030193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2626ec-0fde-46a5-9b2b-ebf221edd628 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:36.030472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2626ec-0fde-46a5-9b2b-ebf221edd628 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:36.030773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2626ec-0fde-46a5-9b2b-ebf221edd628 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:36.046649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2626ec-0fde-46a5-9b2b-ebf221edd628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-db2626ec-0fde-46a5-9b2b-ebf221edd628 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:36.052890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:36.053764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:36.055032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 213/424] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:36.060721 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2626ec-0fde-46a5-9b2b-ebf221edd628 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:36.116692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94defc-d60c-4b3b-9594-fdf47599eb2b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:36.154181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f5094-cc58-4fc4-8cde-23fcbfec6dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:36.155469 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f5094-cc58-4fc4-8cde-23fcbfec6dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:36.155955 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f5094-cc58-4fc4-8cde-23fcbfec6dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:36.156428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f5094-cc58-4fc4-8cde-23fcbfec6dd7 None admin] PATH_INFO: `/v3/groups/ec7ba607636146f9bde231c5771de2e7` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:36.163773 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f5094-cc58-4fc4-8cde-23fcbfec6dd7 None admin] RBAC: Authorizing `identity:get_group(group_id=ec7ba607636146f9bde231c5771de2e7)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:36.166295 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f5094-cc58-4fc4-8cde-23fcbfec6dd7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:36.170114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 212/425] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:35 2022] GET /identity/v3/groups/ec7ba607636146f9bde231c5771de2e7 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:36.175875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f5094-cc58-4fc4-8cde-23fcbfec6dd7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:36.204970 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:36.226009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2626ec-0fde-46a5-9b2b-ebf221edd628 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:36.251572 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:36.270041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6102b-1f02-4d48-b62e-d18ff339d41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:36.270560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6102b-1f02-4d48-b62e-d18ff339d41a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:36.270876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6102b-1f02-4d48-b62e-d18ff339d41a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:36.271152 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6102b-1f02-4d48-b62e-d18ff339d41a None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:36.271904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6102b-1f02-4d48-b62e-d18ff339d41a None admin] RBAC: Adding query filter params (name=member) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:36.272213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6102b-1f02-4d48-b62e-d18ff339d41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:36.273603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6102b-1f02-4d48-b62e-d18ff339d41a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:36.283721 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 214/426] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:36.285223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121216a-8224-48df-aa40-de5c91433a0f None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:36.285516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121216a-8224-48df-aa40-de5c91433a0f None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:36.285793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121216a-8224-48df-aa40-de5c91433a0f None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:36.290717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 215/427] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:36.292153 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121216a-8224-48df-aa40-de5c91433a0f None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:36.356375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f5094-cc58-4fc4-8cde-23fcbfec6dd7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:36.401897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6372bc6-76d1-4fb3-9c34-11041e453a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:36.403154 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6372bc6-76d1-4fb3-9c34-11041e453a2b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:36.403737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6372bc6-76d1-4fb3-9c34-11041e453a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:36.404011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6372bc6-76d1-4fb3-9c34-11041e453a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:36.405537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6372bc6-76d1-4fb3-9c34-11041e453a2b None admin] RBAC: Adding query filter params (group.id=ec7ba607636146f9bde231c5771de2e7, role.id=8d803b40a63540ba80e3039f16774d46, scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:36.405803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6372bc6-76d1-4fb3-9c34-11041e453a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:36.408063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6372bc6-76d1-4fb3-9c34-11041e453a2b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:36.411129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121216a-8224-48df-aa40-de5c91433a0f None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:36.415989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 213/428] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 08:02:36 2022] GET /identity/v3/role_assignments?group.id=ec7ba607636146f9bde231c5771de2e7&scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6&role.id=8d803b40a63540ba80e3039f16774d46 => generated 611 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:36.417597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58604c-1cb2-4019-956a-143537579cd4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:36.417944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58604c-1cb2-4019-956a-143537579cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:36.418196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58604c-1cb2-4019-956a-143537579cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:36.437328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ad58604c-1cb2-4019-956a-143537579cd4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:36.438910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ad58604c-1cb2-4019-956a-143537579cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:36.504165 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0104536-80ba-4591-9459-368e52ff1506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:36.504839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0104536-80ba-4591-9459-368e52ff1506 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:36.505126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0104536-80ba-4591-9459-368e52ff1506 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:36.505403 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0104536-80ba-4591-9459-368e52ff1506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:36.519947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 214/429] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:36.578729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58604c-1cb2-4019-956a-143537579cd4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:36.581885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:36.616338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:36.654291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0104536-80ba-4591-9459-368e52ff1506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:36.655966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0104536-80ba-4591-9459-368e52ff1506 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:36.727050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58604c-1cb2-4019-956a-143537579cd4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:36.765164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3b8f2-c757-4858-bc02-ba7b3b21e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:36.765956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3b8f2-c757-4858-bc02-ba7b3b21e5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:36.766242 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3b8f2-c757-4858-bc02-ba7b3b21e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:36.766520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3b8f2-c757-4858-bc02-ba7b3b21e5c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:36.769230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 216/430] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:36.774754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0104536-80ba-4591-9459-368e52ff1506 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:36.777989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3b8f2-c757-4858-bc02-ba7b3b21e5c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-28e3b8f2-c757-4858-bc02-ba7b3b21e5c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:36.786595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:36.787480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:36.788268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 215/431] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:36.795056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3b8f2-c757-4858-bc02-ba7b3b21e5c2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:36.876188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:36.877641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:36.897867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0104536-80ba-4591-9459-368e52ff1506 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:36.923074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3b8f2-c757-4858-bc02-ba7b3b21e5c2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:36.949565 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb6a58-e31d-4331-b971-5b5254b0e343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:36.950592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb6a58-e31d-4331-b971-5b5254b0e343 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:36.951214 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb6a58-e31d-4331-b971-5b5254b0e343 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:36.951497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb6a58-e31d-4331-b971-5b5254b0e343 None admin] PATH_INFO: `/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:36.952922 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb6a58-e31d-4331-b971-5b5254b0e343 None admin] RBAC: Authorizing `identity:get_project(project_id=989c7a7c2f7f49e5be8e751b4ec32db6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:36.954375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb6a58-e31d-4331-b971-5b5254b0e343 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:36.956417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 217/432] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:36 2022] GET /identity/v3/projects/989c7a7c2f7f49e5be8e751b4ec32db6 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:36.961699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb6a58-e31d-4331-b971-5b5254b0e343 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:36.966084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d14ed6-d167-4d20-894a-bfdfd9907a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:36.966793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d14ed6-d167-4d20-894a-bfdfd9907a8c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:36.967080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d14ed6-d167-4d20-894a-bfdfd9907a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:36.967363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d14ed6-d167-4d20-894a-bfdfd9907a8c None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:36.968118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d14ed6-d167-4d20-894a-bfdfd9907a8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:36.968431 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d14ed6-d167-4d20-894a-bfdfd9907a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:36.969822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d14ed6-d167-4d20-894a-bfdfd9907a8c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:36.979781 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 216/433] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:02:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:36.986328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d14ed6-d167-4d20-894a-bfdfd9907a8c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:37.079042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb6a58-e31d-4331-b971-5b5254b0e343 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:37.097296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d14ed6-d167-4d20-894a-bfdfd9907a8c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:37.117854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718904f-0b42-4881-a54f-6efc26ab6cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:37.119106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718904f-0b42-4881-a54f-6efc26ab6cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:37.120126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718904f-0b42-4881-a54f-6efc26ab6cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:37.120796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718904f-0b42-4881-a54f-6efc26ab6cb2 None admin] PATH_INFO: `/v3/groups/ec7ba607636146f9bde231c5771de2e7` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:37.122401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718904f-0b42-4881-a54f-6efc26ab6cb2 None admin] RBAC: Authorizing `identity:get_group(group_id=ec7ba607636146f9bde231c5771de2e7)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:37.124126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718904f-0b42-4881-a54f-6efc26ab6cb2 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:37.126251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 218/434] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:36 2022] GET /identity/v3/groups/ec7ba607636146f9bde231c5771de2e7 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:37.126811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:37.133042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718904f-0b42-4881-a54f-6efc26ab6cb2 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:37.143116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8846f04-8853-449d-b31a-29723a6674be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:37.143925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8846f04-8853-449d-b31a-29723a6674be None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:37.144225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8846f04-8853-449d-b31a-29723a6674be None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:37.144501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8846f04-8853-449d-b31a-29723a6674be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:37.157909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:37.235720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8846f04-8853-449d-b31a-29723a6674be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:37.237511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8846f04-8853-449d-b31a-29723a6674be None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:37.267234 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718904f-0b42-4881-a54f-6efc26ab6cb2 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:37.316402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d1123-8048-4a9e-8bcd-0eea36f8a005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:37.317647 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d1123-8048-4a9e-8bcd-0eea36f8a005 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:37.318551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d1123-8048-4a9e-8bcd-0eea36f8a005 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:37.319354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d1123-8048-4a9e-8bcd-0eea36f8a005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:37.320409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d1123-8048-4a9e-8bcd-0eea36f8a005 None admin] RBAC: Adding query filter params (group.id=ec7ba607636146f9bde231c5771de2e7, role.id=9eb3c16b00c04e1c850bab61de15c44c, scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:37.320932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d1123-8048-4a9e-8bcd-0eea36f8a005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:37.323680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d1123-8048-4a9e-8bcd-0eea36f8a005 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:37.338185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 219/435] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 08:02:37 2022] GET /identity/v3/role_assignments?group.id=ec7ba607636146f9bde231c5771de2e7&scope.project.id=989c7a7c2f7f49e5be8e751b4ec32db6&role.id=9eb3c16b00c04e1c850bab61de15c44c => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:37.355973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7321422-3b7f-492e-aadd-26f7e658c659 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:37.356456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7321422-3b7f-492e-aadd-26f7e658c659 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:37.356733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7321422-3b7f-492e-aadd-26f7e658c659 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:37.362802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 220/436] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:37.364936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db2a46-748c-45f6-8999-1eb21f350fa5 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:37.365226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db2a46-748c-45f6-8999-1eb21f350fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:37.365504 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db2a46-748c-45f6-8999-1eb21f350fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:37.375581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 217/437] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 08:02:37.382930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8846f04-8853-449d-b31a-29723a6674be None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:37.385452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d8db2a46-748c-45f6-8999-1eb21f350fa5 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:37.388254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d8db2a46-748c-45f6-8999-1eb21f350fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:37.412023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:37.490728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 221/438] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:37.503822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8846f04-8853-449d-b31a-29723a6674be None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:37.508849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db2a46-748c-45f6-8999-1eb21f350fa5 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:37.532503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:37.553972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f3bb9-7bec-4778-a2a5-f15ba8133368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:37.554981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f3bb9-7bec-4778-a2a5-f15ba8133368 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:37.555159 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f3bb9-7bec-4778-a2a5-f15ba8133368 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:37.555436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f3bb9-7bec-4778-a2a5-f15ba8133368 None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:37.556683 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f3bb9-7bec-4778-a2a5-f15ba8133368 None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:37.558871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f3bb9-7bec-4778-a2a5-f15ba8133368 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:37.560606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 218/439] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:37 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:37.572560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f3bb9-7bec-4778-a2a5-f15ba8133368 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:37.663048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db2a46-748c-45f6-8999-1eb21f350fa5 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:37.686352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:37.700466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f3bb9-7bec-4778-a2a5-f15ba8133368 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:37.712348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79383f5-e7af-474c-a9c5-9a7ba2edbc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:37.713146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79383f5-e7af-474c-a9c5-9a7ba2edbc05 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:37.713464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79383f5-e7af-474c-a9c5-9a7ba2edbc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:37.713741 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79383f5-e7af-474c-a9c5-9a7ba2edbc05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:37.727619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79383f5-e7af-474c-a9c5-9a7ba2edbc05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-d79383f5-e7af-474c-a9c5-9a7ba2edbc05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:37.736938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:37.738070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:37.738999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 222/440] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:02:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:37.744648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79383f5-e7af-474c-a9c5-9a7ba2edbc05 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:37.754885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3142d3c-53aa-4c4c-8037-e9e519faf99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:37.756331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142d3c-53aa-4c4c-8037-e9e519faf99e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:37.756772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142d3c-53aa-4c4c-8037-e9e519faf99e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:37.757694 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142d3c-53aa-4c4c-8037-e9e519faf99e None admin] PATH_INFO: `/v3/groups/ec7ba607636146f9bde231c5771de2e7` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:37.759165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3142d3c-53aa-4c4c-8037-e9e519faf99e None admin] RBAC: Authorizing `identity:get_group(group_id=ec7ba607636146f9bde231c5771de2e7)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:37.761359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3142d3c-53aa-4c4c-8037-e9e519faf99e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:37.763530 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 219/441] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:37 2022] GET /identity/v3/groups/ec7ba607636146f9bde231c5771de2e7 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:37.769264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3142d3c-53aa-4c4c-8037-e9e519faf99e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:37.835279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:37.880471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79383f5-e7af-474c-a9c5-9a7ba2edbc05 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:37.915244 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3142d3c-53aa-4c4c-8037-e9e519faf99e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:37.938313 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d4f5e-1778-467b-99d3-83cc2b29b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:37.939045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d4f5e-1778-467b-99d3-83cc2b29b99e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:37.939331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d4f5e-1778-467b-99d3-83cc2b29b99e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:37.939609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d4f5e-1778-467b-99d3-83cc2b29b99e None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:37.940726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d4f5e-1778-467b-99d3-83cc2b29b99e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:37.940899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d4f5e-1778-467b-99d3-83cc2b29b99e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:37.942310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d4f5e-1778-467b-99d3-83cc2b29b99e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:37.953130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 223/442] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:37.958788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d4f5e-1778-467b-99d3-83cc2b29b99e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:37.973796 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa548a-6b66-419a-b2b8-2564390fa505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:37.974462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa548a-6b66-419a-b2b8-2564390fa505 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:37.974887 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa548a-6b66-419a-b2b8-2564390fa505 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:37.975207 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa548a-6b66-419a-b2b8-2564390fa505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:37.976994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa548a-6b66-419a-b2b8-2564390fa505 None admin] RBAC: Adding query filter params (group.id=ec7ba607636146f9bde231c5771de2e7, role.id=9eb3c16b00c04e1c850bab61de15c44c, scope.project.id=5270bea9dd60407aa2ea22723624bbef) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:37.976994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa548a-6b66-419a-b2b8-2564390fa505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:37.977846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa548a-6b66-419a-b2b8-2564390fa505 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:37.989297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 220/443] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 08:02:37 2022] GET /identity/v3/role_assignments?group.id=ec7ba607636146f9bde231c5771de2e7&scope.project.id=5270bea9dd60407aa2ea22723624bbef&role.id=9eb3c16b00c04e1c850bab61de15c44c => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:38.084147 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d4f5e-1778-467b-99d3-83cc2b29b99e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:38.090040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb37d-412f-43d3-a824-8760c6fbe6e8 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:38.090350 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb37d-412f-43d3-a824-8760c6fbe6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:38.090602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb37d-412f-43d3-a824-8760c6fbe6e8 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:38.093451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 221/444] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:38.098198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919440a4-d336-4219-bda8-908cf75b9927 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:38.098484 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919440a4-d336-4219-bda8-908cf75b9927 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:38.098792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919440a4-d336-4219-bda8-908cf75b9927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:38.118568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-919440a4-d336-4219-bda8-908cf75b9927 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:38.120494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-919440a4-d336-4219-bda8-908cf75b9927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:38.123377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ae907-6240-443e-8265-ea29099b13f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:38.124970 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ae907-6240-443e-8265-ea29099b13f2 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:38.125256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ae907-6240-443e-8265-ea29099b13f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:38.125532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ae907-6240-443e-8265-ea29099b13f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:38.128680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:38.141899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:38.206790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 222/445] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:38.221556 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ae907-6240-443e-8265-ea29099b13f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:38.227232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ae907-6240-443e-8265-ea29099b13f2 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:38.228693 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919440a4-d336-4219-bda8-908cf75b9927 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:38.349926 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 224/446] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 08:02:38.356632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ae907-6240-443e-8265-ea29099b13f2 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:38.359269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919440a4-d336-4219-bda8-908cf75b9927 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:38.395009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:38.399035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4233dd-793b-44ca-9802-817417dac5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:38.399841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4233dd-793b-44ca-9802-817417dac5fa None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:38.400372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4233dd-793b-44ca-9802-817417dac5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:38.400629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4233dd-793b-44ca-9802-817417dac5fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:38.411158 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4233dd-793b-44ca-9802-817417dac5fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-da4233dd-793b-44ca-9802-817417dac5fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:38.420046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:38.421107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:38.422099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 223/447] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:02:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:38.426795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4233dd-793b-44ca-9802-817417dac5fa None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:38.443139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:38.463178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ae907-6240-443e-8265-ea29099b13f2 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:38.497780 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da242a77-dc1c-4ce2-a019-c387442ff7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:38.498640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242a77-dc1c-4ce2-a019-c387442ff7aa None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:38.498946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242a77-dc1c-4ce2-a019-c387442ff7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:38.499225 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242a77-dc1c-4ce2-a019-c387442ff7aa None admin] PATH_INFO: `/v3/projects/48e195a21c654d5fa117864a568a0c62` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:38.500403 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da242a77-dc1c-4ce2-a019-c387442ff7aa None admin] RBAC: Authorizing `identity:get_project(project_id=48e195a21c654d5fa117864a568a0c62)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:38.502120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da242a77-dc1c-4ce2-a019-c387442ff7aa None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:38.503911 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 225/448] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:38 2022] GET /identity/v3/projects/48e195a21c654d5fa117864a568a0c62 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:38.509204 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da242a77-dc1c-4ce2-a019-c387442ff7aa None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:38.529419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4233dd-793b-44ca-9802-817417dac5fa None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:38.570677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7c7e3-d6b4-4ab2-afc4-c8e1b2f242f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:38.571352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7c7e3-d6b4-4ab2-afc4-c8e1b2f242f9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:38.571686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7c7e3-d6b4-4ab2-afc4-c8e1b2f242f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:38.572342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7c7e3-d6b4-4ab2-afc4-c8e1b2f242f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:38.572815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7c7e3-d6b4-4ab2-afc4-c8e1b2f242f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:38.573527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7c7e3-d6b4-4ab2-afc4-c8e1b2f242f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:38.574759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7c7e3-d6b4-4ab2-afc4-c8e1b2f242f9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:38.583101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 224/449] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:38.589128 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7c7e3-d6b4-4ab2-afc4-c8e1b2f242f9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:38.628542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da242a77-dc1c-4ce2-a019-c387442ff7aa None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:38.630015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:38.665671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca033d9-40f3-45a3-bc94-88e336b375f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:38.667254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca033d9-40f3-45a3-bc94-88e336b375f3 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:38.667593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca033d9-40f3-45a3-bc94-88e336b375f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:38.667869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca033d9-40f3-45a3-bc94-88e336b375f3 None admin] PATH_INFO: `/v3/groups/b529a412a6d44d6690fb591ea403937c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:38.669053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca033d9-40f3-45a3-bc94-88e336b375f3 None admin] RBAC: Authorizing `identity:get_group(group_id=b529a412a6d44d6690fb591ea403937c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:38.670497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca033d9-40f3-45a3-bc94-88e336b375f3 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:38.672143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 226/450] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:38 2022] GET /identity/v3/groups/b529a412a6d44d6690fb591ea403937c => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:38.675077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:38.677979 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca033d9-40f3-45a3-bc94-88e336b375f3 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:38.698373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7c7e3-d6b4-4ab2-afc4-c8e1b2f242f9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:38.731680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f756a80-be7e-4c56-bd27-a6782cda4849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:38.732320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f756a80-be7e-4c56-bd27-a6782cda4849 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:38.732595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f756a80-be7e-4c56-bd27-a6782cda4849 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:38.732877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f756a80-be7e-4c56-bd27-a6782cda4849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:38.775695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca033d9-40f3-45a3-bc94-88e336b375f3 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:38.798965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f756a80-be7e-4c56-bd27-a6782cda4849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:38.800430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f756a80-be7e-4c56-bd27-a6782cda4849 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:38.809616 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dbdc8-6068-4333-b109-46decde28c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:38.810254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dbdc8-6068-4333-b109-46decde28c95 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:38.810534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dbdc8-6068-4333-b109-46decde28c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:38.810833 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dbdc8-6068-4333-b109-46decde28c95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:38.811651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dbdc8-6068-4333-b109-46decde28c95 None admin] RBAC: Adding query filter params (group.id=b529a412a6d44d6690fb591ea403937c, role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=48e195a21c654d5fa117864a568a0c62) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:38.811958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dbdc8-6068-4333-b109-46decde28c95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:38.813356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dbdc8-6068-4333-b109-46decde28c95 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:38.819015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 227/451] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 08:02:38 2022] GET /identity/v3/role_assignments?group.id=b529a412a6d44d6690fb591ea403937c&scope.project.id=48e195a21c654d5fa117864a568a0c62&role.id=6fcc322b483a475399974562c1e5bd43 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:38.881875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:38.909119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 225/452] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 08:02:38.914996 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dbdc8-6068-4333-b109-46decde28c95 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:38.953510 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:39.021886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dbdc8-6068-4333-b109-46decde28c95 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:39.054789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdecda-dcdc-4bfe-8274-1c116ee784fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:39.055637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdecda-dcdc-4bfe-8274-1c116ee784fc None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:39.055917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdecda-dcdc-4bfe-8274-1c116ee784fc None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:39.056190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdecda-dcdc-4bfe-8274-1c116ee784fc None admin] PATH_INFO: `/v3/projects/5270bea9dd60407aa2ea22723624bbef` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:39.057375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdecda-dcdc-4bfe-8274-1c116ee784fc None admin] RBAC: Authorizing `identity:get_project(project_id=5270bea9dd60407aa2ea22723624bbef)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:39.058827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdecda-dcdc-4bfe-8274-1c116ee784fc None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:39.060498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 228/453] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:02:38 2022] GET /identity/v3/projects/5270bea9dd60407aa2ea22723624bbef => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:39.066000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f756a80-be7e-4c56-bd27-a6782cda4849 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:39.162875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f756a80-be7e-4c56-bd27-a6782cda4849 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:39.194976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b7209-324c-49a3-818e-a951911817b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:39.195816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b7209-324c-49a3-818e-a951911817b8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:39.196099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b7209-324c-49a3-818e-a951911817b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:39.196370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b7209-324c-49a3-818e-a951911817b8 None admin] PATH_INFO: `/v3/groups/ec7ba607636146f9bde231c5771de2e7` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:39.197531 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b7209-324c-49a3-818e-a951911817b8 None admin] RBAC: Authorizing `identity:get_group(group_id=ec7ba607636146f9bde231c5771de2e7)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:39.199909 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b7209-324c-49a3-818e-a951911817b8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:39.201504 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 226/454] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 08:02:39 2022] GET /identity/v3/groups/ec7ba607636146f9bde231c5771de2e7 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:39.207221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdecda-dcdc-4bfe-8274-1c116ee784fc None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:39.304784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdecda-dcdc-4bfe-8274-1c116ee784fc None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:39.306265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:39.339338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe80f5-1327-485a-a583-ec8cdfed5103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:39.339969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe80f5-1327-485a-a583-ec8cdfed5103 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:39.340253 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe80f5-1327-485a-a583-ec8cdfed5103 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:39.340534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe80f5-1327-485a-a583-ec8cdfed5103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:39.341354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe80f5-1327-485a-a583-ec8cdfed5103 None admin] RBAC: Adding query filter params (group.id=ec7ba607636146f9bde231c5771de2e7, role.id=8d803b40a63540ba80e3039f16774d46, scope.project.id=5270bea9dd60407aa2ea22723624bbef) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:39.341664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe80f5-1327-485a-a583-ec8cdfed5103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:39.343122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe80f5-1327-485a-a583-ec8cdfed5103 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:39.348744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 229/455] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 08:02:39 2022] GET /identity/v3/role_assignments?group.id=ec7ba607636146f9bde231c5771de2e7&scope.project.id=5270bea9dd60407aa2ea22723624bbef&role.id=8d803b40a63540ba80e3039f16774d46 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:42.111395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da722d-369b-4e87-941f-c23fe18742e5 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:42.111914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da722d-369b-4e87-941f-c23fe18742e5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:42.111990 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da722d-369b-4e87-941f-c23fe18742e5 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:42.113560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 227/456] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:42.119219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747594f-7e2b-4e11-b0b8-9bb7f487ea2b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:42.120254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747594f-7e2b-4e11-b0b8-9bb7f487ea2b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:42.120798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747594f-7e2b-4e11-b0b8-9bb7f487ea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:42.148027 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-7747594f-7e2b-4e11-b0b8-9bb7f487ea2b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:42.149559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-7747594f-7e2b-4e11-b0b8-9bb7f487ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:42.240023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 230/457] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:42.271249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da722d-369b-4e87-941f-c23fe18742e5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:42.317152 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772e80-87a6-48e5-840c-9e32d7acb08d None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:42.317778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772e80-87a6-48e5-840c-9e32d7acb08d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:42.318257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772e80-87a6-48e5-840c-9e32d7acb08d None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:42.320104 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 231/458] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:42.325538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11715dfa-0c69-43ee-927d-e4aefd96ad26 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:42.326058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11715dfa-0c69-43ee-927d-e4aefd96ad26 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:42.326538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11715dfa-0c69-43ee-927d-e4aefd96ad26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:42.350964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:42.358765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-11715dfa-0c69-43ee-927d-e4aefd96ad26 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:42.361724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-11715dfa-0c69-43ee-927d-e4aefd96ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:42.434560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da722d-369b-4e87-941f-c23fe18742e5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:42.472611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aebc1b-0add-45c9-bc41-120a170edc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:42.476599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aebc1b-0add-45c9-bc41-120a170edc04 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:42.477217 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aebc1b-0add-45c9-bc41-120a170edc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:42.477710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aebc1b-0add-45c9-bc41-120a170edc04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:42.495857 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aebc1b-0add-45c9-bc41-120a170edc04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:42.498270 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aebc1b-0add-45c9-bc41-120a170edc04 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:42.512643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 232/459] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:42.521269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e90cd-e60a-4cc6-b614-5b3a59fbd05b None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:42.521589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e90cd-e60a-4cc6-b614-5b3a59fbd05b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:42.521877 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e90cd-e60a-4cc6-b614-5b3a59fbd05b None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:42.523494 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 233/460] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:02:42.531826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468a567-44c9-4eb6-b8cd-4c2304c3e666 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:42.532117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468a567-44c9-4eb6-b8cd-4c2304c3e666 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:42.532397 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468a567-44c9-4eb6-b8cd-4c2304c3e666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-c8aebc1b-0add-45c9-bc41-120a170edc04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:42.538305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:42.539202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:42.540032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:42.540032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:42.540032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:42.540032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:42.540032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 228/461] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:42.546638 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aebc1b-0add-45c9-bc41-120a170edc04 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:42.562384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f468a567-44c9-4eb6-b8cd-4c2304c3e666 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:42.564487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f468a567-44c9-4eb6-b8cd-4c2304c3e666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:42.592700 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:42.651131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 234/462] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:42.651131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468a567-44c9-4eb6-b8cd-4c2304c3e666 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:42.704001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:42.715643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aebc1b-0add-45c9-bc41-120a170edc04 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:42.749519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468a567-44c9-4eb6-b8cd-4c2304c3e666 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:42.757984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dc116-1fd7-42a8-9583-c2f0e5ebef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:42.758678 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dc116-1fd7-42a8-9583-c2f0e5ebef48 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:42.758965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dc116-1fd7-42a8-9583-c2f0e5ebef48 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:42.759239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dc116-1fd7-42a8-9583-c2f0e5ebef48 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:42.760854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dc116-1fd7-42a8-9583-c2f0e5ebef48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:42.761176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dc116-1fd7-42a8-9583-c2f0e5ebef48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:42.762891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dc116-1fd7-42a8-9583-c2f0e5ebef48 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:42.782786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 229/463] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:42.782786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dc116-1fd7-42a8-9583-c2f0e5ebef48 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:42.803464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29587edc-ad36-44fc-bcbb-9d838aa73579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:42.805101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29587edc-ad36-44fc-bcbb-9d838aa73579 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:42.805593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29587edc-ad36-44fc-bcbb-9d838aa73579 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:42.806049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29587edc-ad36-44fc-bcbb-9d838aa73579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:42.820378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29587edc-ad36-44fc-bcbb-9d838aa73579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:42.821857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29587edc-ad36-44fc-bcbb-9d838aa73579 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-29587edc-ad36-44fc-bcbb-9d838aa73579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:42.840994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:42.841834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:42.843077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:42.843077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:42.843077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:42.843077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:42.843077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 235/464] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:42.843077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29587edc-ad36-44fc-bcbb-9d838aa73579 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:42.856728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:42.900543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dc116-1fd7-42a8-9583-c2f0e5ebef48 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:42.939039 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63059bc-d556-4cb3-9340-bbd05aefe232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:42.939820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63059bc-d556-4cb3-9340-bbd05aefe232 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:42.940117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63059bc-d556-4cb3-9340-bbd05aefe232 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:42.940397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63059bc-d556-4cb3-9340-bbd05aefe232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:42.951988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29587edc-ad36-44fc-bcbb-9d838aa73579 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:42.953664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63059bc-d556-4cb3-9340-bbd05aefe232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:42.955198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63059bc-d556-4cb3-9340-bbd05aefe232 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-a63059bc-d556-4cb3-9340-bbd05aefe232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:42.973304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:42.974205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:42.975776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:42.975776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:42.975776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:42.975776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:42.975776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 230/465] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:42.976176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3103d29-3e9d-46f7-8f68-109899970a39 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:42.976443 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3103d29-3e9d-46f7-8f68-109899970a39 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:42.976724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3103d29-3e9d-46f7-8f68-109899970a39 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:42.978141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 231/466] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:42.982713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3103d29-3e9d-46f7-8f68-109899970a39 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:42.994175 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:42.997386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac7759-9ff1-4f96-9f41-14707947c15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:42.998341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac7759-9ff1-4f96-9f41-14707947c15d None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:42.998698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac7759-9ff1-4f96-9f41-14707947c15d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:42.999005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac7759-9ff1-4f96-9f41-14707947c15d None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:42.999757 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac7759-9ff1-4f96-9f41-14707947c15d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:43.001162 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac7759-9ff1-4f96-9f41-14707947c15d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:43.023223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 236/467] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:02:42 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:02:43.024143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac7759-9ff1-4f96-9f41-14707947c15d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:43.097082 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:43.137901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3103d29-3e9d-46f7-8f68-109899970a39 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:43.149671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac7759-9ff1-4f96-9f41-14707947c15d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:43.192943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ce5a8-046c-4c34-b0fd-d27e576d0624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:43.192943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ce5a8-046c-4c34-b0fd-d27e576d0624 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:43.192943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ce5a8-046c-4c34-b0fd-d27e576d0624 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:43.192943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ce5a8-046c-4c34-b0fd-d27e576d0624 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:43.193319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ce5a8-046c-4c34-b0fd-d27e576d0624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:43.193319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ce5a8-046c-4c34-b0fd-d27e576d0624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:43.194562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ce5a8-046c-4c34-b0fd-d27e576d0624 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:43.194896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2277353-3756-4ebe-8ea0-9e31c5877c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:43.195571 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2277353-3756-4ebe-8ea0-9e31c5877c40 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:43.195859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2277353-3756-4ebe-8ea0-9e31c5877c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:43.196183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2277353-3756-4ebe-8ea0-9e31c5877c40 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:43.196937 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2277353-3756-4ebe-8ea0-9e31c5877c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:43.197251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2277353-3756-4ebe-8ea0-9e31c5877c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:43.198953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2277353-3756-4ebe-8ea0-9e31c5877c40 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:43.208905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 237/468] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:43.210159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abceaa4-9b5d-44ec-a0d4-ad4db5e60314 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:43.210470 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abceaa4-9b5d-44ec-a0d4-ad4db5e60314 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:43.210750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abceaa4-9b5d-44ec-a0d4-ad4db5e60314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:43.213660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 232/469] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:43.215028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2277353-3756-4ebe-8ea0-9e31c5877c40 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:43.236089 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-9abceaa4-9b5d-44ec-a0d4-ad4db5e60314 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:43.237475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9abceaa4-9b5d-44ec-a0d4-ad4db5e60314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:43.300625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:43.327690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 238/470] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:43.328813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abceaa4-9b5d-44ec-a0d4-ad4db5e60314 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:43.351547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2277353-3756-4ebe-8ea0-9e31c5877c40 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:43.393472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06d5db-14cb-4fad-997f-e42c0cd9cfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:43.394506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06d5db-14cb-4fad-997f-e42c0cd9cfd5 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:43.395015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06d5db-14cb-4fad-997f-e42c0cd9cfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:43.395488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06d5db-14cb-4fad-997f-e42c0cd9cfd5 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:43.396415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06d5db-14cb-4fad-997f-e42c0cd9cfd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:43.398069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06d5db-14cb-4fad-997f-e42c0cd9cfd5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:43.410956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:43.425821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 233/471] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:02:43 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:02:43.434824 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06d5db-14cb-4fad-997f-e42c0cd9cfd5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:43.510800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abceaa4-9b5d-44ec-a0d4-ad4db5e60314 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:43.587564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850cb57-6e56-4f47-b5b9-e6396043957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:43.589409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850cb57-6e56-4f47-b5b9-e6396043957e None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:43.590194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850cb57-6e56-4f47-b5b9-e6396043957e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:43.590714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850cb57-6e56-4f47-b5b9-e6396043957e None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:43.591933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850cb57-6e56-4f47-b5b9-e6396043957e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:43.594593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850cb57-6e56-4f47-b5b9-e6396043957e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:43.626132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 239/472] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:02:43 2022] POST /identity/v3/users => generated 248 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:02:43.630639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cda77e-e679-49fd-a8b8-d71a89cdfda4 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:43.630639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cda77e-e679-49fd-a8b8-d71a89cdfda4 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:43.630639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cda77e-e679-49fd-a8b8-d71a89cdfda4 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:43.630639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 240/473] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:43.635099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a2707-992e-4beb-a93c-97f1b4cf0bc4 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:43.635905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a2707-992e-4beb-a93c-97f1b4cf0bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:43.636193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a2707-992e-4beb-a93c-97f1b4cf0bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:43.639838 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06d5db-14cb-4fad-997f-e42c0cd9cfd5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:43.663897 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f23a2707-992e-4beb-a93c-97f1b4cf0bc4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:43.665125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f23a2707-992e-4beb-a93c-97f1b4cf0bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:43.672550 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:43.688912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da5e91-d659-4a4b-9656-560ca77f77c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:43.689710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da5e91-d659-4a4b-9656-560ca77f77c8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:43.689993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da5e91-d659-4a4b-9656-560ca77f77c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:43.690270 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da5e91-d659-4a4b-9656-560ca77f77c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:43.703692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da5e91-d659-4a4b-9656-560ca77f77c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:43.705197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da5e91-d659-4a4b-9656-560ca77f77c8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-09da5e91-d659-4a4b-9656-560ca77f77c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:43.724953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:43.725858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:43.726736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:43.726736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:43.726736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:43.726736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:43.726736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 234/474] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:43.733173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da5e91-d659-4a4b-9656-560ca77f77c8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:43.759816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 241/475] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:43.786220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a2707-992e-4beb-a93c-97f1b4cf0bc4 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:43.841434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:43.882884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da5e91-d659-4a4b-9656-560ca77f77c8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:43.908963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a2707-992e-4beb-a93c-97f1b4cf0bc4 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:43.919115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ef2c1-8afb-4ed3-ae41-85aad9c62fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:43.919829 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ef2c1-8afb-4ed3-ae41-85aad9c62fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:43.920112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ef2c1-8afb-4ed3-ae41-85aad9c62fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:43.920384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ef2c1-8afb-4ed3-ae41-85aad9c62fa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:43.921135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ef2c1-8afb-4ed3-ae41-85aad9c62fa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:43.921418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ef2c1-8afb-4ed3-ae41-85aad9c62fa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:43.922830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ef2c1-8afb-4ed3-ae41-85aad9c62fa5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:43.936533 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 235/476] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:43.942676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ef2c1-8afb-4ed3-ae41-85aad9c62fa5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:43.948155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb64a4-193a-4a2e-b404-05bb8756e557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:43.949110 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb64a4-193a-4a2e-b404-05bb8756e557 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:43.949597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb64a4-193a-4a2e-b404-05bb8756e557 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:43.950065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb64a4-193a-4a2e-b404-05bb8756e557 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:43.951043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb64a4-193a-4a2e-b404-05bb8756e557 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:43.952739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb64a4-193a-4a2e-b404-05bb8756e557 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:43.962729 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.sql.core [None req-e9eb64a4-193a-4a2e-b404-05bb8756e557 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 08:02:43.962729 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 08:02:43.962729 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [parameters: {'id': 'f46890b096d244b0bb503248782cde96', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 08:02:43.962729 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80269) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 08:02:43.981437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-e9eb64a4-193a-4a2e-b404-05bb8756e557 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application conn.query(q) Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application result.read() Jun 21 08:02:43.984294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return ref.to_dict() Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 08:02:43.985108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application next(self.gen) Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application yield resource Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application next(self.gen) Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise self.value Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application session.commit() Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 08:02:43.986000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self.session.flush() Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application compat.raise_( Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 08:02:43.986907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 08:02:43.987768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application conn.query(q) Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application result.read() Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 08:02:43.990026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [parameters: {'id': 'f46890b096d244b0bb503248782cde96', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:43.992001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 08:02:43.994039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:43.999463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 242/477] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 21 08:02:43 2022] POST /identity/v3/roles => generated 144 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:44.004908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb64a4-193a-4a2e-b404-05bb8756e557 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:44.058669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ef2c1-8afb-4ed3-ae41-85aad9c62fa5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:44.102238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f1c3-ee1b-4953-8c26-5c51357c6c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:44.103023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f1c3-ee1b-4953-8c26-5c51357c6c08 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:44.103309 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f1c3-ee1b-4953-8c26-5c51357c6c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:44.103718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f1c3-ee1b-4953-8c26-5c51357c6c08 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:44.104425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043f1c3-ee1b-4953-8c26-5c51357c6c08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:44.106299 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043f1c3-ee1b-4953-8c26-5c51357c6c08 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:44.137798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 236/478] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:02:43 2022] POST /identity/v3/users => generated 249 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:02:44.186405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb64a4-193a-4a2e-b404-05bb8756e557 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:44.189850 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:44.228363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb808c-34fd-4817-9895-0bb38c8b75f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:44.230113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb808c-34fd-4817-9895-0bb38c8b75f4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:44.230605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb808c-34fd-4817-9895-0bb38c8b75f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:44.231184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb808c-34fd-4817-9895-0bb38c8b75f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:44.245572 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb808c-34fd-4817-9895-0bb38c8b75f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-11eb808c-34fd-4817-9895-0bb38c8b75f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:44.254444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:44.255417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:44.256192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:44.256192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:44.256192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:44.256192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:44.256192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:44.256192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:44.256192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:44.256192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:44.256192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:44.256192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:44.256192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 08:02:44.256192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:44.258679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 243/479] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:02:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:44.265385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f1c3-ee1b-4953-8c26-5c51357c6c08 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:44.383855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:44.392871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f1c3-ee1b-4953-8c26-5c51357c6c08 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:44.434057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516d4a2-3170-4f1a-a7a8-506a06c86fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:44.434752 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516d4a2-3170-4f1a-a7a8-506a06c86fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:44.435036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516d4a2-3170-4f1a-a7a8-506a06c86fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:44.435310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516d4a2-3170-4f1a-a7a8-506a06c86fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:44.436061 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516d4a2-3170-4f1a-a7a8-506a06c86fc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:44.436365 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516d4a2-3170-4f1a-a7a8-506a06c86fc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:44.437731 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516d4a2-3170-4f1a-a7a8-506a06c86fc3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:44.450773 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 237/480] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:45.355402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99366208-9697-46c4-b2c3-6a3c9a83aee2 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:45.356398 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99366208-9697-46c4-b2c3-6a3c9a83aee2 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:45.356879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99366208-9697-46c4-b2c3-6a3c9a83aee2 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:45.358690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 244/481] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:45.364145 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87afb-9c13-4214-841a-83bda17f9244 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:45.364806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87afb-9c13-4214-841a-83bda17f9244 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:45.364968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87afb-9c13-4214-841a-83bda17f9244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:45.387565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c3a87afb-9c13-4214-841a-83bda17f9244 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:45.388760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c3a87afb-9c13-4214-841a-83bda17f9244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:45.472280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 238/482] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:45.507892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99366208-9697-46c4-b2c3-6a3c9a83aee2 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:45.632702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99366208-9697-46c4-b2c3-6a3c9a83aee2 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:45.667040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f434-7076-4127-b9b7-9b0a10f1ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:45.667829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f434-7076-4127-b9b7-9b0a10f1ddae None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:45.668107 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f434-7076-4127-b9b7-9b0a10f1ddae None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:45.668378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f434-7076-4127-b9b7-9b0a10f1ddae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:45.678917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585f434-7076-4127-b9b7-9b0a10f1ddae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-0585f434-7076-4127-b9b7-9b0a10f1ddae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:45.686449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:45.687342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:45.688148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 245/483] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:45.693501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a87afb-9c13-4214-841a-83bda17f9244 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:45.787041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:45.799611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a87afb-9c13-4214-841a-83bda17f9244 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:45.835464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04e5a5-7942-42d4-b5c6-c140233c7ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:45.836126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04e5a5-7942-42d4-b5c6-c140233c7ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:45.836406 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04e5a5-7942-42d4-b5c6-c140233c7ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:45.836679 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04e5a5-7942-42d4-b5c6-c140233c7ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:45.837427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04e5a5-7942-42d4-b5c6-c140233c7ab0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:45.837730 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04e5a5-7942-42d4-b5c6-c140233c7ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:45.839220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04e5a5-7942-42d4-b5c6-c140233c7ab0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:45.852221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 239/484] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:02:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:45.854082 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f434-7076-4127-b9b7-9b0a10f1ddae None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:45.885577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:45.972838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f434-7076-4127-b9b7-9b0a10f1ddae None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:46.028687 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7de448-c2c5-4630-9f2c-f26c9e13551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:46.029482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7de448-c2c5-4630-9f2c-f26c9e13551d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:46.029763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7de448-c2c5-4630-9f2c-f26c9e13551d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:46.030035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7de448-c2c5-4630-9f2c-f26c9e13551d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:46.048729 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7de448-c2c5-4630-9f2c-f26c9e13551d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:46.050196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7de448-c2c5-4630-9f2c-f26c9e13551d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-2d7de448-c2c5-4630-9f2c-f26c9e13551d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:46.076432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:46.077306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:46.078132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:46.078132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:46.078132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:46.078132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:46.078132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 246/485] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:46.083209 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04e5a5-7942-42d4-b5c6-c140233c7ab0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:46.207525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04e5a5-7942-42d4-b5c6-c140233c7ab0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:46.232904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bce6e0-93e4-4ab8-8e3a-f3b8260cd81b None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:46.233208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bce6e0-93e4-4ab8-8e3a-f3b8260cd81b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:46.233467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bce6e0-93e4-4ab8-8e3a-f3b8260cd81b None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:46.235016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 247/486] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:46.240566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7290e0-09df-419f-b081-49ba8830de4f None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:46.240854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7290e0-09df-419f-b081-49ba8830de4f None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:46.241133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7290e0-09df-419f-b081-49ba8830de4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:46.246128 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af5af3-a2e3-4def-857b-f8afb9bad8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:46.246817 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af5af3-a2e3-4def-857b-f8afb9bad8eb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:46.247099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af5af3-a2e3-4def-857b-f8afb9bad8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:46.247374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af5af3-a2e3-4def-857b-f8afb9bad8eb None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:46.248097 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af5af3-a2e3-4def-857b-f8afb9bad8eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:46.248403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af5af3-a2e3-4def-857b-f8afb9bad8eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:46.249868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af5af3-a2e3-4def-857b-f8afb9bad8eb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:46.266732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 240/487] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:46.268741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af5af3-a2e3-4def-857b-f8afb9bad8eb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:46.276261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-3b7290e0-09df-419f-b081-49ba8830de4f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:46.277536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-3b7290e0-09df-419f-b081-49ba8830de4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:46.278075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:46.383831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af5af3-a2e3-4def-857b-f8afb9bad8eb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:46.420041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75fb04-b057-4764-a899-9a92ec6d652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:46.420822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75fb04-b057-4764-a899-9a92ec6d652a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:46.421100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75fb04-b057-4764-a899-9a92ec6d652a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:46.421401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75fb04-b057-4764-a899-9a92ec6d652a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:46.428972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75fb04-b057-4764-a899-9a92ec6d652a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:46.430411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75fb04-b057-4764-a899-9a92ec6d652a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:46.440304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 248/488] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-2e75fb04-b057-4764-a899-9a92ec6d652a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:02:46.446389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:46.448009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:46.449001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:46.449001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:46.449001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:02:46.449001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:02:46.449001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:02:46.449001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:02:46.449001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:02:46.449001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:02:46.449001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:02:46.449001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:46.452777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 241/489] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 08:02:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:46.455634 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7290e0-09df-419f-b081-49ba8830de4f None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:46.464467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:46.477411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75fb04-b057-4764-a899-9a92ec6d652a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:46.550647 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:46.589241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75fb04-b057-4764-a899-9a92ec6d652a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:46.592138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7290e0-09df-419f-b081-49ba8830de4f None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:46.632434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33312ae9-02aa-45f6-a1f4-1fdba172a72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:46.632861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092ffc9-6ae5-4a1e-86e7-2d48895f9221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:46.633542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092ffc9-6ae5-4a1e-86e7-2d48895f9221 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:46.633821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092ffc9-6ae5-4a1e-86e7-2d48895f9221 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:46.634091 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092ffc9-6ae5-4a1e-86e7-2d48895f9221 None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:46.634272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33312ae9-02aa-45f6-a1f4-1fdba172a72a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:46.634799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33312ae9-02aa-45f6-a1f4-1fdba172a72a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:46.635011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092ffc9-6ae5-4a1e-86e7-2d48895f9221 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:46.635323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092ffc9-6ae5-4a1e-86e7-2d48895f9221 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:46.635751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33312ae9-02aa-45f6-a1f4-1fdba172a72a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:46.636950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092ffc9-6ae5-4a1e-86e7-2d48895f9221 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:46.646842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33312ae9-02aa-45f6-a1f4-1fdba172a72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-33312ae9-02aa-45f6-a1f4-1fdba172a72a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:46.655050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:46.655929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:46.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:46.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:46.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:46.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:46.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:46.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:46.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:46.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:46.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:46.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:46.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:46.656718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:46.659269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 242/490] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:46.660780 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d558b35-ad64-461c-b069-b57e0975879a None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:46.661253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d558b35-ad64-461c-b069-b57e0975879a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:46.661732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d558b35-ad64-461c-b069-b57e0975879a None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:46.663448 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 243/491] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:46.675223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d713a3-2173-4b22-89eb-1dd9ada4351f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:46.675508 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d713a3-2173-4b22-89eb-1dd9ada4351f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:46.675783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d713a3-2173-4b22-89eb-1dd9ada4351f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:46.678332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 249/492] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 08:02:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:46.679297 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092ffc9-6ae5-4a1e-86e7-2d48895f9221 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:46.698738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-72d713a3-2173-4b22-89eb-1dd9ada4351f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:46.700035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-72d713a3-2173-4b22-89eb-1dd9ada4351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:46.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:46.783159 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 244/493] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:46.784515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d713a3-2173-4b22-89eb-1dd9ada4351f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:46.804192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092ffc9-6ae5-4a1e-86e7-2d48895f9221 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:46.848301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015af14-9ac1-4c07-8de1-ab6cb6ea5344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:46.849205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015af14-9ac1-4c07-8de1-ab6cb6ea5344 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:46.849693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015af14-9ac1-4c07-8de1-ab6cb6ea5344 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:46.850043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015af14-9ac1-4c07-8de1-ab6cb6ea5344 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:46.850903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015af14-9ac1-4c07-8de1-ab6cb6ea5344 None admin] RBAC: Adding query filter params (name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:46.851502 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015af14-9ac1-4c07-8de1-ab6cb6ea5344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:46.853538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015af14-9ac1-4c07-8de1-ab6cb6ea5344 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:46.864187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 250/494] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:02:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:46.866208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015af14-9ac1-4c07-8de1-ab6cb6ea5344 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:46.870756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:46.925226 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d713a3-2173-4b22-89eb-1dd9ada4351f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:46.966025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142d690-60b1-4af1-b4d3-eec0fe3feb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:46.966702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142d690-60b1-4af1-b4d3-eec0fe3feb4c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:46.966987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142d690-60b1-4af1-b4d3-eec0fe3feb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:46.967261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142d690-60b1-4af1-b4d3-eec0fe3feb4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:46.990457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015af14-9ac1-4c07-8de1-ab6cb6ea5344 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:47.018318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:47.027898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf9cc8-c23c-40dd-b239-9263e71cd0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:47.028698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf9cc8-c23c-40dd-b239-9263e71cd0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.028981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf9cc8-c23c-40dd-b239-9263e71cd0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.029248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf9cc8-c23c-40dd-b239-9263e71cd0b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.040546 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf9cc8-c23c-40dd-b239-9263e71cd0b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:47.043056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142d690-60b1-4af1-b4d3-eec0fe3feb4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:47.044546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142d690-60b1-4af1-b4d3-eec0fe3feb4c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-6bcf9cc8-c23c-40dd-b239-9263e71cd0b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:47.048117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:47.048990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:47.049784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 251/495] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:47.051120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf9cc8-c23c-40dd-b239-9263e71cd0b8 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:47.110007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:47.155645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 245/496] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:47.156969 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28360f71-fa5b-415b-9b0d-483f9e4fc032 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.157262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28360f71-fa5b-415b-9b0d-483f9e4fc032 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.157542 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28360f71-fa5b-415b-9b0d-483f9e4fc032 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.162730 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 246/497] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:47.162730 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28360f71-fa5b-415b-9b0d-483f9e4fc032 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:47.170460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf9cc8-c23c-40dd-b239-9263e71cd0b8 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:47.205224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a276561-5690-48d3-8c27-ab41f04aa268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:47.206111 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a276561-5690-48d3-8c27-ab41f04aa268 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.206455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a276561-5690-48d3-8c27-ab41f04aa268 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.206768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a276561-5690-48d3-8c27-ab41f04aa268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.217630 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a276561-5690-48d3-8c27-ab41f04aa268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:47.219102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a276561-5690-48d3-8c27-ab41f04aa268 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-3a276561-5690-48d3-8c27-ab41f04aa268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:47.235934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:47.236984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:47.238191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:47.238191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:47.238191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:47.238191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:47.238191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 252/498] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:47.238191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a276561-5690-48d3-8c27-ab41f04aa268 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:47.270263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28360f71-fa5b-415b-9b0d-483f9e4fc032 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:47.279327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:47.305544 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b435498-63ee-4286-9f96-fdf334ec3a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:47.306196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b435498-63ee-4286-9f96-fdf334ec3a8b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.306535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b435498-63ee-4286-9f96-fdf334ec3a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.307012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b435498-63ee-4286-9f96-fdf334ec3a8b None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.307759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b435498-63ee-4286-9f96-fdf334ec3a8b None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:47.308070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b435498-63ee-4286-9f96-fdf334ec3a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:47.309443 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b435498-63ee-4286-9f96-fdf334ec3a8b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:47.317312 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 247/499] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:02:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:47.318584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce24173-fee7-4485-8d37-031d0e7cf385 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.318823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce24173-fee7-4485-8d37-031d0e7cf385 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.319084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce24173-fee7-4485-8d37-031d0e7cf385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.335260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7ce24173-fee7-4485-8d37-031d0e7cf385 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:47.336457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7ce24173-fee7-4485-8d37-031d0e7cf385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:47.340096 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a276561-5690-48d3-8c27-ab41f04aa268 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:47.349943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:47.374500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83708d77-c1a8-4e5b-bed7-5a921044ce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:47.375425 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83708d77-c1a8-4e5b-bed7-5a921044ce52 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.375800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83708d77-c1a8-4e5b-bed7-5a921044ce52 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.376166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83708d77-c1a8-4e5b-bed7-5a921044ce52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.386695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83708d77-c1a8-4e5b-bed7-5a921044ce52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:47.388128 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83708d77-c1a8-4e5b-bed7-5a921044ce52 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:47.403369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 248/500] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-83708d77-c1a8-4e5b-bed7-5a921044ce52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:47.405740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:47.406784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:47.407667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:47.407667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:47.407667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:47.407667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:47.407667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 253/501] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:47.408019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83708d77-c1a8-4e5b-bed7-5a921044ce52 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:47.408115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c4517-56a2-45c8-b82a-502bd947e4a5 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.408523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c4517-56a2-45c8-b82a-502bd947e4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.408809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c4517-56a2-45c8-b82a-502bd947e4a5 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.410274 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 249/502] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:47.411967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c4517-56a2-45c8-b82a-502bd947e4a5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:47.501939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:47.512762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c4517-56a2-45c8-b82a-502bd947e4a5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:47.514199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83708d77-c1a8-4e5b-bed7-5a921044ce52 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:47.547774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84873a-0449-429e-bc3b-e40b7700528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:47.547952 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec9baa-20d0-4ca5-aed1-14a649579fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:47.548475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84873a-0449-429e-bc3b-e40b7700528a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.548579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec9baa-20d0-4ca5-aed1-14a649579fcd None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.548756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84873a-0449-429e-bc3b-e40b7700528a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.548851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec9baa-20d0-4ca5-aed1-14a649579fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.549027 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84873a-0449-429e-bc3b-e40b7700528a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.549115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec9baa-20d0-4ca5-aed1-14a649579fcd None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.549783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec9baa-20d0-4ca5-aed1-14a649579fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:47.550090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec9baa-20d0-4ca5-aed1-14a649579fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:47.551747 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec9baa-20d0-4ca5-aed1-14a649579fcd None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:47.559591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84873a-0449-429e-bc3b-e40b7700528a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:47.561034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84873a-0449-429e-bc3b-e40b7700528a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:47.563241 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 254/503] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:47.564174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec9baa-20d0-4ca5-aed1-14a649579fcd None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:47.577851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-2a84873a-0449-429e-bc3b-e40b7700528a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:47.588672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:47.589908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:47.591060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:47.591060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:47.591060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:47.591060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:47.591871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 250/504] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:47.593421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ab9a1-d59b-467c-8ea7-cb40ba431c94 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.593708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ab9a1-d59b-467c-8ea7-cb40ba431c94 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.593986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ab9a1-d59b-467c-8ea7-cb40ba431c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.610638 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c24ab9a1-d59b-467c-8ea7-cb40ba431c94 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:47.611839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c24ab9a1-d59b-467c-8ea7-cb40ba431c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:47.671491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec9baa-20d0-4ca5-aed1-14a649579fcd None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:47.677275 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 251/505] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:47.677920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ab9a1-d59b-467c-8ea7-cb40ba431c94 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:47.706585 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3228769-776b-4b36-9212-f81fa3a8e40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:47.707266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3228769-776b-4b36-9212-f81fa3a8e40f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.707547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3228769-776b-4b36-9212-f81fa3a8e40f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.707822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3228769-776b-4b36-9212-f81fa3a8e40f None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.708547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3228769-776b-4b36-9212-f81fa3a8e40f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:47.708848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3228769-776b-4b36-9212-f81fa3a8e40f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:47.710224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3228769-776b-4b36-9212-f81fa3a8e40f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:47.721803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 255/506] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:47.722761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3228769-776b-4b36-9212-f81fa3a8e40f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:47.734391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:47.792437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ab9a1-d59b-467c-8ea7-cb40ba431c94 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:47.821475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3228769-776b-4b36-9212-f81fa3a8e40f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:47.821789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:47.829272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c3e59-f029-40a2-af45-9e7a7461cd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:47.830060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c3e59-f029-40a2-af45-9e7a7461cd48 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.830349 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c3e59-f029-40a2-af45-9e7a7461cd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.830652 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c3e59-f029-40a2-af45-9e7a7461cd48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.840788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c3e59-f029-40a2-af45-9e7a7461cd48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-a68c3e59-f029-40a2-af45-9e7a7461cd48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:47.848488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:47.849360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:47.850327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 252/507] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:47.851316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c3e59-f029-40a2-af45-9e7a7461cd48 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:47.860478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa91282-87c7-47d3-a732-00ffc14cf9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:47.861277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa91282-87c7-47d3-a732-00ffc14cf9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.861616 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa91282-87c7-47d3-a732-00ffc14cf9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.861896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa91282-87c7-47d3-a732-00ffc14cf9a4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.869818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa91282-87c7-47d3-a732-00ffc14cf9a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:47.871448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa91282-87c7-47d3-a732-00ffc14cf9a4 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-dfa91282-87c7-47d3-a732-00ffc14cf9a4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:02:47.887645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:47.888524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:47.889447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:47.889447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:47.889447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:02:47.889447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:02:47.889447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:02:47.889447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:02:47.889447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:02:47.889447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:02:47.889447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 08:02:47.889447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:47.889447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 256/508] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:47.890003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa91282-87c7-47d3-a732-00ffc14cf9a4 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:47.954291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c3e59-f029-40a2-af45-9e7a7461cd48 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:47.958884 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:47.988113 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf2c2-88a4-4aeb-88c8-08b63b2e8d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:47.988766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf2c2-88a4-4aeb-88c8-08b63b2e8d07 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:47.989045 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf2c2-88a4-4aeb-88c8-08b63b2e8d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:47.989318 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf2c2-88a4-4aeb-88c8-08b63b2e8d07 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:47.990282 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bf2c2-88a4-4aeb-88c8-08b63b2e8d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:47.990579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bf2c2-88a4-4aeb-88c8-08b63b2e8d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:47.991978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bf2c2-88a4-4aeb-88c8-08b63b2e8d07 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:47.993370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa91282-87c7-47d3-a732-00ffc14cf9a4 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:48.003905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 253/509] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:48.004704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf2c2-88a4-4aeb-88c8-08b63b2e8d07 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:48.032829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762d1f-b9f5-4756-bbce-2ee15377bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:48.033609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762d1f-b9f5-4756-bbce-2ee15377bf52 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:48.033885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762d1f-b9f5-4756-bbce-2ee15377bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:48.034157 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762d1f-b9f5-4756-bbce-2ee15377bf52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:48.044002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b762d1f-b9f5-4756-bbce-2ee15377bf52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:48.045432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b762d1f-b9f5-4756-bbce-2ee15377bf52 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:48.054736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-8b762d1f-b9f5-4756-bbce-2ee15377bf52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:48.063202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:48.064185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:48.065074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:48.065074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:48.065074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:48.065074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:48.065074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 257/510] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:48.065456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762d1f-b9f5-4756-bbce-2ee15377bf52 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:48.110433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf2c2-88a4-4aeb-88c8-08b63b2e8d07 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:48.143709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c38b61-0e1c-4695-9ae0-89e65d22cee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:48.144488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c38b61-0e1c-4695-9ae0-89e65d22cee5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:48.144775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c38b61-0e1c-4695-9ae0-89e65d22cee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:48.145052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c38b61-0e1c-4695-9ae0-89e65d22cee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:48.151843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c38b61-0e1c-4695-9ae0-89e65d22cee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:48.153288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c38b61-0e1c-4695-9ae0-89e65d22cee5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:48.163438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762d1f-b9f5-4756-bbce-2ee15377bf52 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e6c38b61-0e1c-4695-9ae0-89e65d22cee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:02:48.168142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:48.169129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:48.170020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:02:48.170020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:02:48.170020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:02:48.170020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:02:48.170020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:02:48.170020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:02:48.170020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:48.170020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:48.170020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 254/511] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:48.170485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c38b61-0e1c-4695-9ae0-89e65d22cee5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:48.187090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:48.199356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5df15-e9e1-437d-93ce-8034374687b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:48.200012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5df15-e9e1-437d-93ce-8034374687b8 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:48.200289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5df15-e9e1-437d-93ce-8034374687b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:48.200557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5df15-e9e1-437d-93ce-8034374687b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:48.201295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5df15-e9e1-437d-93ce-8034374687b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:48.201595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5df15-e9e1-437d-93ce-8034374687b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:48.202981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5df15-e9e1-437d-93ce-8034374687b8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:48.210576 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 258/512] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:02:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:48.211368 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5df15-e9e1-437d-93ce-8034374687b8 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:48.275201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c38b61-0e1c-4695-9ae0-89e65d22cee5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:48.286064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:48.310811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c42a-93eb-4390-a3c7-9d1b80890b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:48.311478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c42a-93eb-4390-a3c7-9d1b80890b86 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:48.311764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c42a-93eb-4390-a3c7-9d1b80890b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:48.312037 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c42a-93eb-4390-a3c7-9d1b80890b86 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:48.312865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86c42a-93eb-4390-a3c7-9d1b80890b86 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:48.313171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86c42a-93eb-4390-a3c7-9d1b80890b86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:48.314185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5df15-e9e1-437d-93ce-8034374687b8 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:48.314603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86c42a-93eb-4390-a3c7-9d1b80890b86 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:48.346817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc8d6-2a56-43da-bd1b-023a576e6295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:48.347599 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc8d6-2a56-43da-bd1b-023a576e6295 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:48.347881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc8d6-2a56-43da-bd1b-023a576e6295 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:48.348155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fc8d6-2a56-43da-bd1b-023a576e6295 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:48.352630 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 255/513] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 21 08:02:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:48.353991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c42a-93eb-4390-a3c7-9d1b80890b86 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:48.356448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fc8d6-2a56-43da-bd1b-023a576e6295 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:48.357907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fc8d6-2a56-43da-bd1b-023a576e6295 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-ed9fc8d6-2a56-43da-bd1b-023a576e6295 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:02:48.373022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:48.374051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:48.375190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:48.375190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:48.375190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:02:48.375190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:02:48.375190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:02:48.375190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:02:48.375190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:02:48.375190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:02:48.375190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 08:02:48.375190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:48.375190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 259/514] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:48.375190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc8d6-2a56-43da-bd1b-023a576e6295 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:48.424254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:48.455700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c42a-93eb-4390-a3c7-9d1b80890b86 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:48.477773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fc8d6-2a56-43da-bd1b-023a576e6295 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:48.490787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5320f1-7286-4068-b088-a9c753dd71b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:48.491434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5320f1-7286-4068-b088-a9c753dd71b3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:48.491711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5320f1-7286-4068-b088-a9c753dd71b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:48.491985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5320f1-7286-4068-b088-a9c753dd71b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:48.492695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5320f1-7286-4068-b088-a9c753dd71b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:48.492994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5320f1-7286-4068-b088-a9c753dd71b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:48.494409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5320f1-7286-4068-b088-a9c753dd71b3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:48.505344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 256/515] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:48.506109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5320f1-7286-4068-b088-a9c753dd71b3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:48.513993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9bab-10d9-4c2f-b3d9-0f85880e0e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:48.514674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9bab-10d9-4c2f-b3d9-0f85880e0e59 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:48.514965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9bab-10d9-4c2f-b3d9-0f85880e0e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:48.515243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9bab-10d9-4c2f-b3d9-0f85880e0e59 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:48.516443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e9bab-10d9-4c2f-b3d9-0f85880e0e59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:48.516763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e9bab-10d9-4c2f-b3d9-0f85880e0e59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:48.518596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e9bab-10d9-4c2f-b3d9-0f85880e0e59 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:48.535563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:48.537788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 260/516] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:48.538593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9bab-10d9-4c2f-b3d9-0f85880e0e59 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:48.615462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5320f1-7286-4068-b088-a9c753dd71b3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:48.650825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd365529-00e1-43dc-8f9e-a48d6e646f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:48.651286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd365529-00e1-43dc-8f9e-a48d6e646f0d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:48.651572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd365529-00e1-43dc-8f9e-a48d6e646f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:48.651860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd365529-00e1-43dc-8f9e-a48d6e646f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:48.662403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd365529-00e1-43dc-8f9e-a48d6e646f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:48.663746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9bab-10d9-4c2f-b3d9-0f85880e0e59 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:48.663923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd365529-00e1-43dc-8f9e-a48d6e646f0d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:48.669300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-dd365529-00e1-43dc-8f9e-a48d6e646f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:48.683138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:48.684162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:48.685386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:48.685386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:48.685386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:48.685386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:48.685386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 257/517] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:48.685386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd365529-00e1-43dc-8f9e-a48d6e646f0d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:48.705359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc71c51-dc35-43cb-9295-6687f03e663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:48.705997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc71c51-dc35-43cb-9295-6687f03e663f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:48.706276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc71c51-dc35-43cb-9295-6687f03e663f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:48.706552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc71c51-dc35-43cb-9295-6687f03e663f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:48.767150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:48.775956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc71c51-dc35-43cb-9295-6687f03e663f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:48.777598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc71c51-dc35-43cb-9295-6687f03e663f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:48.786028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd365529-00e1-43dc-8f9e-a48d6e646f0d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:48.819740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b7cb7-5cc4-4d17-bd21-ef6a7a87bf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:48.820397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b7cb7-5cc4-4d17-bd21-ef6a7a87bf27 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:48.820681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b7cb7-5cc4-4d17-bd21-ef6a7a87bf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:48.820960 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b7cb7-5cc4-4d17-bd21-ef6a7a87bf27 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:48.821798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b7cb7-5cc4-4d17-bd21-ef6a7a87bf27 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:48.823278 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b7cb7-5cc4-4d17-bd21-ef6a7a87bf27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:48.824733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b7cb7-5cc4-4d17-bd21-ef6a7a87bf27 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:48.842535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 258/518] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 21 08:02:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:48.843512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b7cb7-5cc4-4d17-bd21-ef6a7a87bf27 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:48.881303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 261/519] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:48.882397 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc71c51-dc35-43cb-9295-6687f03e663f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:48.887006 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:48.941471 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b7cb7-5cc4-4d17-bd21-ef6a7a87bf27 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:48.982782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a000ae3-3c5d-43d3-89bc-f377e7cc8cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:48.983459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a000ae3-3c5d-43d3-89bc-f377e7cc8cbd None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:48.983743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a000ae3-3c5d-43d3-89bc-f377e7cc8cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:48.984017 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a000ae3-3c5d-43d3-89bc-f377e7cc8cbd None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:48.984724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a000ae3-3c5d-43d3-89bc-f377e7cc8cbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:48.985191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc71c51-dc35-43cb-9295-6687f03e663f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:48.986176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a000ae3-3c5d-43d3-89bc-f377e7cc8cbd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:48.995458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:49.007736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 259/520] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:02:48 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:02:49.008540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a000ae3-3c5d-43d3-89bc-f377e7cc8cbd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:49.022546 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106848e3-4f41-4ede-b7c4-c364594ee0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:49.023256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106848e3-4f41-4ede-b7c4-c364594ee0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:49.023542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106848e3-4f41-4ede-b7c4-c364594ee0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:49.023816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106848e3-4f41-4ede-b7c4-c364594ee0e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:49.024665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106848e3-4f41-4ede-b7c4-c364594ee0e2 None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=c0956402a9bb4a9384111b36d5251749) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:49.024977 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106848e3-4f41-4ede-b7c4-c364594ee0e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:49.027633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106848e3-4f41-4ede-b7c4-c364594ee0e2 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:49.034083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 262/521] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:48 2022] GET /identity/v3/role_assignments?user.id=c0956402a9bb4a9384111b36d5251749&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:49.034992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106848e3-4f41-4ede-b7c4-c364594ee0e2 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:49.140857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:49.176436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a000ae3-3c5d-43d3-89bc-f377e7cc8cbd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:49.198509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106848e3-4f41-4ede-b7c4-c364594ee0e2 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:49.221789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b8a2d-ead1-41c0-940e-74a062f0b278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:49.222458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b8a2d-ead1-41c0-940e-74a062f0b278 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:49.222889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b8a2d-ead1-41c0-940e-74a062f0b278 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:49.223166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b8a2d-ead1-41c0-940e-74a062f0b278 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:49.223897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b8a2d-ead1-41c0-940e-74a062f0b278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:49.224203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b8a2d-ead1-41c0-940e-74a062f0b278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:49.225584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b8a2d-ead1-41c0-940e-74a062f0b278 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:49.241018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 260/522] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:49.241733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b8a2d-ead1-41c0-940e-74a062f0b278 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:49.246647 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26937fe9-b1eb-4977-a2ad-e84131f0a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:49.247564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26937fe9-b1eb-4977-a2ad-e84131f0a273 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:49.248008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26937fe9-b1eb-4977-a2ad-e84131f0a273 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:49.248765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26937fe9-b1eb-4977-a2ad-e84131f0a273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:49.315851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:49.333782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26937fe9-b1eb-4977-a2ad-e84131f0a273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:49.335312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26937fe9-b1eb-4977-a2ad-e84131f0a273 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:49.367414 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b8a2d-ead1-41c0-940e-74a062f0b278 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:49.410571 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d6e55-2487-480d-b034-8c26a7a9731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:49.411425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6e55-2487-480d-b034-8c26a7a9731a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:49.411752 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6e55-2487-480d-b034-8c26a7a9731a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:49.412035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6e55-2487-480d-b034-8c26a7a9731a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:49.421741 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:49.423854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d6e55-2487-480d-b034-8c26a7a9731a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:49.425382 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d6e55-2487-480d-b034-8c26a7a9731a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-496d6e55-2487-480d-b034-8c26a7a9731a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:49.445462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:49.446364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:49.447786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:49.447786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:49.447786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:49.447786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:49.447786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 261/523] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:49.449463 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d6e55-2487-480d-b034-8c26a7a9731a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:49.465194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 263/524] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:49.466540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26937fe9-b1eb-4977-a2ad-e84131f0a273 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:49.561959 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d6e55-2487-480d-b034-8c26a7a9731a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:49.586992 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:49.605757 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26937fe9-b1eb-4977-a2ad-e84131f0a273 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:49.617288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688d02e-27ec-41af-9562-f1de6519e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:49.618331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688d02e-27ec-41af-9562-f1de6519e807 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:49.621614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688d02e-27ec-41af-9562-f1de6519e807 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:49.622002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688d02e-27ec-41af-9562-f1de6519e807 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:49.632322 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688d02e-27ec-41af-9562-f1de6519e807 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:49.634183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688d02e-27ec-41af-9562-f1de6519e807 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:49.647006 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c695735-04f9-495e-8904-31d00c88d2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:49.647863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c695735-04f9-495e-8904-31d00c88d2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:49.648327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c695735-04f9-495e-8904-31d00c88d2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:49.648744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c695735-04f9-495e-8904-31d00c88d2f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:49.649656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c695735-04f9-495e-8904-31d00c88d2f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:49.650154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c695735-04f9-495e-8904-31d00c88d2f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:49.652226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c695735-04f9-495e-8904-31d00c88d2f0 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-a688d02e-27ec-41af-9562-f1de6519e807 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:02:49.653905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:49.654914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:49.655880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:49.655880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:49.655880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:02:49.655880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:02:49.655880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:02:49.655880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:02:49.655880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:02:49.655880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:02:49.655880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 08:02:49.655880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:49.656372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 262/525] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:49.657226 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688d02e-27ec-41af-9562-f1de6519e807 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:49.669600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 264/526] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:49.670693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c695735-04f9-495e-8904-31d00c88d2f0 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:49.703391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:49.801504 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c695735-04f9-495e-8904-31d00c88d2f0 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:49.809643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688d02e-27ec-41af-9562-f1de6519e807 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:49.848214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4859135-577d-4343-b33b-8313e5c17fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:49.849332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4859135-577d-4343-b33b-8313e5c17fce None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:49.849763 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4859135-577d-4343-b33b-8313e5c17fce None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:49.850145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de971c6c-3f78-4c74-b512-b941c8e3111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:49.850354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4859135-577d-4343-b33b-8313e5c17fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:49.850985 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de971c6c-3f78-4c74-b512-b941c8e3111c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:49.851525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de971c6c-3f78-4c74-b512-b941c8e3111c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:49.851879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de971c6c-3f78-4c74-b512-b941c8e3111c None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:49.853071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de971c6c-3f78-4c74-b512-b941c8e3111c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:49.853587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de971c6c-3f78-4c74-b512-b941c8e3111c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:49.855661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de971c6c-3f78-4c74-b512-b941c8e3111c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:49.862964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4859135-577d-4343-b33b-8313e5c17fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:49.864834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4859135-577d-4343-b33b-8313e5c17fce None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:49.877563 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 265/527] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Jun 21 08:02:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:49.878652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de971c6c-3f78-4c74-b512-b941c8e3111c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b4859135-577d-4343-b33b-8313e5c17fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:49.893222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:49.894090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:49.895467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:49.895467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:49.895467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:49.895467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:49.895467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 263/528] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:49.895467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4859135-577d-4343-b33b-8313e5c17fce None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:49.920002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:49.981598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:49.998896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de971c6c-3f78-4c74-b512-b941c8e3111c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:50.009184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4859135-577d-4343-b33b-8313e5c17fce None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:50.037266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b604-77a6-4794-904f-a1943b4f7a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:50.038274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b604-77a6-4794-904f-a1943b4f7a3e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:50.038744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b604-77a6-4794-904f-a1943b4f7a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:50.039216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b604-77a6-4794-904f-a1943b4f7a3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:50.046683 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada88da6-79a2-4997-a1f2-9cf681d0eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:50.047411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada88da6-79a2-4997-a1f2-9cf681d0eef6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:50.047784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada88da6-79a2-4997-a1f2-9cf681d0eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:50.048121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada88da6-79a2-4997-a1f2-9cf681d0eef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:50.048756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711b604-77a6-4794-904f-a1943b4f7a3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:50.050200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711b604-77a6-4794-904f-a1943b4f7a3e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-a711b604-77a6-4794-904f-a1943b4f7a3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:02:50.069564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:50.070422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:50.071305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:02:50.071305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:02:50.071305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:02:50.071305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:02:50.071305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:02:50.071305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:02:50.071305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:50.071305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:50.071305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 266/529] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:50.072027 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b604-77a6-4794-904f-a1943b4f7a3e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:50.140257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada88da6-79a2-4997-a1f2-9cf681d0eef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:50.142005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada88da6-79a2-4997-a1f2-9cf681d0eef6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:50.168311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:50.195165 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b604-77a6-4794-904f-a1943b4f7a3e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:50.233957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a5246-e7c7-4f77-8623-5dbcad70149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:50.235065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a5246-e7c7-4f77-8623-5dbcad70149c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:50.235608 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a5246-e7c7-4f77-8623-5dbcad70149c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:50.236108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a5246-e7c7-4f77-8623-5dbcad70149c None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:50.237348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a5246-e7c7-4f77-8623-5dbcad70149c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:50.237853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a5246-e7c7-4f77-8623-5dbcad70149c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:50.239891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a5246-e7c7-4f77-8623-5dbcad70149c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:50.254925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 267/530] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:50.256144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a5246-e7c7-4f77-8623-5dbcad70149c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:50.268783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:50.277388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 264/531] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:50.278087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada88da6-79a2-4997-a1f2-9cf681d0eef6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:50.387714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada88da6-79a2-4997-a1f2-9cf681d0eef6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:50.392124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a5246-e7c7-4f77-8623-5dbcad70149c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:50.407181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:50.425813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf39591-3161-4787-8451-53b099dd14ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:50.426920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf39591-3161-4787-8451-53b099dd14ef None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:50.427407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf39591-3161-4787-8451-53b099dd14ef None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:50.427882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf39591-3161-4787-8451-53b099dd14ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:50.433869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5e3e1-cc62-4069-9b30-d8c9ac551af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:50.434525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5e3e1-cc62-4069-9b30-d8c9ac551af5 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:50.434838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5e3e1-cc62-4069-9b30-d8c9ac551af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:50.435115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5e3e1-cc62-4069-9b30-d8c9ac551af5 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:50.435905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5e3e1-cc62-4069-9b30-d8c9ac551af5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:50.436202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5e3e1-cc62-4069-9b30-d8c9ac551af5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:50.436979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf39591-3161-4787-8451-53b099dd14ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:50.437649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5e3e1-cc62-4069-9b30-d8c9ac551af5 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:50.438830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf39591-3161-4787-8451-53b099dd14ef None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:50.451468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 268/532] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:50.452343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5e3e1-cc62-4069-9b30-d8c9ac551af5 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-4cf39591-3161-4787-8451-53b099dd14ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:02:50.454538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:50.455370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:50.456211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:02:50.456211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:02:50.456211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:02:50.456211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:02:50.456211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:02:50.456211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:02:50.456211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:50.456211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:50.458683 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 265/533] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:50.459719 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf39591-3161-4787-8451-53b099dd14ef None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:50.523373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:50.563143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5e3e1-cc62-4069-9b30-d8c9ac551af5 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:50.564983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf39591-3161-4787-8451-53b099dd14ef None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:50.604609 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee084e95-d35b-4795-8873-b3c4df4d6736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:50.605266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee084e95-d35b-4795-8873-b3c4df4d6736 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:50.605555 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee084e95-d35b-4795-8873-b3c4df4d6736 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:50.605838 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee084e95-d35b-4795-8873-b3c4df4d6736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:50.606695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee084e95-d35b-4795-8873-b3c4df4d6736 None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=36e7b70349d9427e899ee290dda2d3c3) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:50.607013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee084e95-d35b-4795-8873-b3c4df4d6736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:50.608465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee084e95-d35b-4795-8873-b3c4df4d6736 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:50.613799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acafaf-ea49-4837-acd0-ec045cdb7eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:50.615371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acafaf-ea49-4837-acd0-ec045cdb7eea None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:50.615485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 266/534] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:50 2022] GET /identity/v3/role_assignments?user.id=36e7b70349d9427e899ee290dda2d3c3&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:50.615880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acafaf-ea49-4837-acd0-ec045cdb7eea None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:50.616270 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee084e95-d35b-4795-8873-b3c4df4d6736 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:50.616423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acafaf-ea49-4837-acd0-ec045cdb7eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:50.629883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acafaf-ea49-4837-acd0-ec045cdb7eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:50.631816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acafaf-ea49-4837-acd0-ec045cdb7eea None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-96acafaf-ea49-4837-acd0-ec045cdb7eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:50.652615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:50.653705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:50.654764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:50.654764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:50.654764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:50.654764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:50.656926 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 269/535] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:50.662671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acafaf-ea49-4837-acd0-ec045cdb7eea None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:50.666333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:50.772477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee084e95-d35b-4795-8873-b3c4df4d6736 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:50.780391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acafaf-ea49-4837-acd0-ec045cdb7eea None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:50.800207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:50.834717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf1e22-b742-4b5b-a499-ba7eda54175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:50.836235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf1e22-b742-4b5b-a499-ba7eda54175f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:50.836817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf1e22-b742-4b5b-a499-ba7eda54175f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:50.838247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf1e22-b742-4b5b-a499-ba7eda54175f None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:50.839615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf1e22-b742-4b5b-a499-ba7eda54175f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:50.840659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf1e22-b742-4b5b-a499-ba7eda54175f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:50.842724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf1e22-b742-4b5b-a499-ba7eda54175f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:50.846695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e193-c4d0-4593-a828-08721c5a6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:50.847576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e193-c4d0-4593-a828-08721c5a6fcc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:50.847993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e193-c4d0-4593-a828-08721c5a6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:50.848428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e193-c4d0-4593-a828-08721c5a6fcc None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:50.849376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2e193-c4d0-4593-a828-08721c5a6fcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:50.849827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2e193-c4d0-4593-a828-08721c5a6fcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:50.851441 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2e193-c4d0-4593-a828-08721c5a6fcc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:50.877004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 270/536] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:50.886611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf1e22-b742-4b5b-a499-ba7eda54175f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:50.891186 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 267/537] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:50.896455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e193-c4d0-4593-a828-08721c5a6fcc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:51.018880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e193-c4d0-4593-a828-08721c5a6fcc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:51.027164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:51.043212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf1e22-b742-4b5b-a499-ba7eda54175f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:51.079609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5ec3a-b968-42e4-b8ff-cf1ed774248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:51.080406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5ec3a-b968-42e4-b8ff-cf1ed774248d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:51.080687 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5ec3a-b968-42e4-b8ff-cf1ed774248d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:51.080961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5ec3a-b968-42e4-b8ff-cf1ed774248d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:51.088171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5ec3a-b968-42e4-b8ff-cf1ed774248d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:51.089639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5ec3a-b968-42e4-b8ff-cf1ed774248d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-a8b5ec3a-b968-42e4-b8ff-cf1ed774248d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:02:51.104205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:51.105198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:51.106015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:02:51.106015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:02:51.106015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:02:51.106015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:02:51.106015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:02:51.106015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:02:51.106015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:51.106015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:51.106015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 271/538] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:51.107333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df660d16-aac0-40a1-9fcd-8f0e2b7fc07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:51.108125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df660d16-aac0-40a1-9fcd-8f0e2b7fc07b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:51.108412 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df660d16-aac0-40a1-9fcd-8f0e2b7fc07b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:51.108688 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df660d16-aac0-40a1-9fcd-8f0e2b7fc07b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:51.109554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df660d16-aac0-40a1-9fcd-8f0e2b7fc07b None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=31a233e2fc784b01a3a8a24599f3c1a8) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:51.109867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df660d16-aac0-40a1-9fcd-8f0e2b7fc07b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:51.111358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df660d16-aac0-40a1-9fcd-8f0e2b7fc07b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:51.113929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5ec3a-b968-42e4-b8ff-cf1ed774248d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:51.124685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 268/539] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:50 2022] GET /identity/v3/role_assignments?user.id=31a233e2fc784b01a3a8a24599f3c1a8&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:51.187007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:51.210049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b8cbf-e59e-40ce-b1e8-7e2eee1f3f67 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:51.210841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b8cbf-e59e-40ce-b1e8-7e2eee1f3f67 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:51.211325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b8cbf-e59e-40ce-b1e8-7e2eee1f3f67 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:51.213050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 269/540] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:02:51.219102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e5ce8-2ae2-4eaa-b206-d0902a66a8aa None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:51.219700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e5ce8-2ae2-4eaa-b206-d0902a66a8aa None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:51.220176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e5ce8-2ae2-4eaa-b206-d0902a66a8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:51.243334 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-613e5ce8-2ae2-4eaa-b206-d0902a66a8aa None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:51.244997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-613e5ce8-2ae2-4eaa-b206-d0902a66a8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:51.300516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5ec3a-b968-42e4-b8ff-cf1ed774248d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:51.339535 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18769-48eb-4639-8b34-820e28876ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:51.340322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18769-48eb-4639-8b34-820e28876ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:51.340606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18769-48eb-4639-8b34-820e28876ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:51.340879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18769-48eb-4639-8b34-820e28876ab3 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:51.341832 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d18769-48eb-4639-8b34-820e28876ab3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:51.342083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d18769-48eb-4639-8b34-820e28876ab3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:51.343667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d18769-48eb-4639-8b34-820e28876ab3 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:51.357284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 272/541] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:51.358600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e76f9-16db-4c4f-8987-98ea82322b61 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:51.358918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e76f9-16db-4c4f-8987-98ea82322b61 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:51.359195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e76f9-16db-4c4f-8987-98ea82322b61 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:51.360700 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 273/543] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:51.360880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 270/543] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:02:51.366369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b203e3b-c681-4346-8178-2ed745054c92 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:51.366950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b203e3b-c681-4346-8178-2ed745054c92 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:51.367223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b203e3b-c681-4346-8178-2ed745054c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:51.367562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e5ce8-2ae2-4eaa-b206-d0902a66a8aa None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:51.387662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-1b203e3b-c681-4346-8178-2ed745054c92 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:51.388859 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1b203e3b-c681-4346-8178-2ed745054c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:51.466668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 274/544] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:51.467848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b203e3b-c681-4346-8178-2ed745054c92 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:51.507453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e5ce8-2ae2-4eaa-b206-d0902a66a8aa None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:51.509703 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:51.510518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:51.553079 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5068cc-0001-4b77-b003-ce0050c6136b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:51.553788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5068cc-0001-4b77-b003-ce0050c6136b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:51.554168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5068cc-0001-4b77-b003-ce0050c6136b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:51.554537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5068cc-0001-4b77-b003-ce0050c6136b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:51.555494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5068cc-0001-4b77-b003-ce0050c6136b None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=cdac6ddece434ed7abddcffe841476ce) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:51.555897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5068cc-0001-4b77-b003-ce0050c6136b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:51.558135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5068cc-0001-4b77-b003-ce0050c6136b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:51.564400 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 271/545] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:51 2022] GET /identity/v3/role_assignments?user.id=cdac6ddece434ed7abddcffe841476ce&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:51.577949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5068cc-0001-4b77-b003-ce0050c6136b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:51.607035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b203e3b-c681-4346-8178-2ed745054c92 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:51.651272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95615f0-5c8d-4a6e-a95e-964170b70446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:51.652149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95615f0-5c8d-4a6e-a95e-964170b70446 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:51.652606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95615f0-5c8d-4a6e-a95e-964170b70446 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:51.652944 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95615f0-5c8d-4a6e-a95e-964170b70446 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:51.667393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95615f0-5c8d-4a6e-a95e-964170b70446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-c95615f0-5c8d-4a6e-a95e-964170b70446 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:51.676573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:51.678755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:51.680701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 275/546] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:51.688605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95615f0-5c8d-4a6e-a95e-964170b70446 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:51.810588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5068cc-0001-4b77-b003-ce0050c6136b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:51.848823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaa987-db52-445e-9f7d-d4f99692edfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:51.849611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaa987-db52-445e-9f7d-d4f99692edfc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:51.849895 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaa987-db52-445e-9f7d-d4f99692edfc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:51.850170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaa987-db52-445e-9f7d-d4f99692edfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:51.863052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaa987-db52-445e-9f7d-d4f99692edfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-6bfaa987-db52-445e-9f7d-d4f99692edfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:51.871776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:51.872649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:51.873442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 272/547] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:51.878640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:51.880232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaa987-db52-445e-9f7d-d4f99692edfc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:51.911024 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:51.930427 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95615f0-5c8d-4a6e-a95e-964170b70446 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:51.992728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaa987-db52-445e-9f7d-d4f99692edfc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:51.999222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50509d8-f5f7-46d7-955a-2ef5da904268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:51.999891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50509d8-f5f7-46d7-955a-2ef5da904268 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:52.000175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50509d8-f5f7-46d7-955a-2ef5da904268 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:52.000453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50509d8-f5f7-46d7-955a-2ef5da904268 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:52.001210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50509d8-f5f7-46d7-955a-2ef5da904268 None admin] RBAC: Adding query filter params (name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:52.001520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50509d8-f5f7-46d7-955a-2ef5da904268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:52.002944 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50509d8-f5f7-46d7-955a-2ef5da904268 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:52.022249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 276/548] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:02:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:52.029539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50509d8-f5f7-46d7-955a-2ef5da904268 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:52.065704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62554da1-6e44-4eda-99be-945764802375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:52.067161 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62554da1-6e44-4eda-99be-945764802375 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:52.068209 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62554da1-6e44-4eda-99be-945764802375 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:52.068571 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62554da1-6e44-4eda-99be-945764802375 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:52.071965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62554da1-6e44-4eda-99be-945764802375 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:52.071965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62554da1-6e44-4eda-99be-945764802375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:52.071965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62554da1-6e44-4eda-99be-945764802375 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:52.086645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 273/549] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:02:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:52.092755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62554da1-6e44-4eda-99be-945764802375 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:52.208813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:52.227699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62554da1-6e44-4eda-99be-945764802375 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:52.266361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554bda7-6e92-4817-b2c2-b6c5d2d4153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:52.267174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554bda7-6e92-4817-b2c2-b6c5d2d4153d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:52.268263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554bda7-6e92-4817-b2c2-b6c5d2d4153d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:52.268263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554bda7-6e92-4817-b2c2-b6c5d2d4153d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:52.279979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554bda7-6e92-4817-b2c2-b6c5d2d4153d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:52.281455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554bda7-6e92-4817-b2c2-b6c5d2d4153d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-7554bda7-6e92-4817-b2c2-b6c5d2d4153d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:52.299899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:52.301317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:52.302340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:52.302340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:52.302340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:52.302340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:52.306057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 274/550] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:52.308126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554bda7-6e92-4817-b2c2-b6c5d2d4153d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:52.430282 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554bda7-6e92-4817-b2c2-b6c5d2d4153d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:52.465383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50509d8-f5f7-46d7-955a-2ef5da904268 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:52.467914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f87743-a5a4-420e-95aa-a4877258053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:52.468595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f87743-a5a4-420e-95aa-a4877258053c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:52.474259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f87743-a5a4-420e-95aa-a4877258053c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:52.474259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f87743-a5a4-420e-95aa-a4877258053c None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:52.474259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f87743-a5a4-420e-95aa-a4877258053c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:52.474259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f87743-a5a4-420e-95aa-a4877258053c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:52.474259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f87743-a5a4-420e-95aa-a4877258053c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:52.474259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:52.488503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 275/551] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:52.498650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f87743-a5a4-420e-95aa-a4877258053c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:52.602090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f6b46-686d-4aa8-b38a-e5201407fadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:52.602919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f6b46-686d-4aa8-b38a-e5201407fadc None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:52.603763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f6b46-686d-4aa8-b38a-e5201407fadc None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:52.604044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f6b46-686d-4aa8-b38a-e5201407fadc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:52.631571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f6b46-686d-4aa8-b38a-e5201407fadc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:52.633045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f6b46-686d-4aa8-b38a-e5201407fadc None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:52.653072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f87743-a5a4-420e-95aa-a4877258053c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-938f6b46-686d-4aa8-b38a-e5201407fadc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:52.671325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:52.672534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:52.673566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:52.673566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:52.673566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:52.673566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:52.676355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 277/552] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 645 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:52.680150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f6b46-686d-4aa8-b38a-e5201407fadc None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:52.683162 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:52.719997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ea43a-a598-4ee8-8adc-df31be1c3fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:52.721134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ea43a-a598-4ee8-8adc-df31be1c3fbf None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:52.721614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ea43a-a598-4ee8-8adc-df31be1c3fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:52.722086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ea43a-a598-4ee8-8adc-df31be1c3fbf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:52.733306 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ea43a-a598-4ee8-8adc-df31be1c3fbf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:52.735937 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ea43a-a598-4ee8-8adc-df31be1c3fbf None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ac9ea43a-a598-4ee8-8adc-df31be1c3fbf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:02:52.777357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:52.778346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:52.779273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:52.779273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:52.779273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:02:52.779273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:02:52.779273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:02:52.779273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:02:52.779273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:02:52.779273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:02:52.779273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 08:02:52.779273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:52.783054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 276/553] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:02:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:52.791430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ea43a-a598-4ee8-8adc-df31be1c3fbf None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:52.876044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f6b46-686d-4aa8-b38a-e5201407fadc None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:52.914750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea79112-4491-48d3-bb6a-4daa50c1bbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:52.916362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea79112-4491-48d3-bb6a-4daa50c1bbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:52.916994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea79112-4491-48d3-bb6a-4daa50c1bbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:52.917496 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea79112-4491-48d3-bb6a-4daa50c1bbd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:52.918438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea79112-4491-48d3-bb6a-4daa50c1bbd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:52.918961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea79112-4491-48d3-bb6a-4daa50c1bbd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:52.921050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea79112-4491-48d3-bb6a-4daa50c1bbd3 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:52.934865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 278/554] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:52.940386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea79112-4491-48d3-bb6a-4daa50c1bbd3 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:52.961640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:53.062223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ea43a-a598-4ee8-8adc-df31be1c3fbf None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:53.085693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:53.133080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adc0ba-bf8b-4a27-a79d-fad21b69d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:53.134715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc0ba-bf8b-4a27-a79d-fad21b69d598 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:53.135496 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc0ba-bf8b-4a27-a79d-fad21b69d598 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:53.136560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc0ba-bf8b-4a27-a79d-fad21b69d598 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:53.138527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adc0ba-bf8b-4a27-a79d-fad21b69d598 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:53.141083 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adc0ba-bf8b-4a27-a79d-fad21b69d598 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:53.146113 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adc0ba-bf8b-4a27-a79d-fad21b69d598 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:53.157002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea79112-4491-48d3-bb6a-4daa50c1bbd3 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:53.188591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 277/555] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 21 08:02:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:53.193478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514bf1f-5dff-432f-953c-8495659a8957 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:53.193992 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514bf1f-5dff-432f-953c-8495659a8957 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:53.194486 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514bf1f-5dff-432f-953c-8495659a8957 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:53.196437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 278/556] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:53.197892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514bf1f-5dff-432f-953c-8495659a8957 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:53.237622 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749318b4-7a1a-4766-a99a-d0931295e2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:53.238795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749318b4-7a1a-4766-a99a-d0931295e2da None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:53.239513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749318b4-7a1a-4766-a99a-d0931295e2da None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:53.242953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749318b4-7a1a-4766-a99a-d0931295e2da None admin] PATH_INFO: `/v3/users/nova` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:53.252190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749318b4-7a1a-4766-a99a-d0931295e2da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:53.255730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749318b4-7a1a-4766-a99a-d0931295e2da None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-749318b4-7a1a-4766-a99a-d0931295e2da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:02:53.278711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:53.279749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:53.281112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:53.281112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:53.281112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:02:53.281112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:02:53.281112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:02:53.281112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:02:53.281112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:02:53.281112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:02:53.281112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:02:53.281112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:53.291786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 279/557] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 08:02:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:53.293294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b3488-4c50-4ae9-9e3d-8d3586c2cf00 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:53.293781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b3488-4c50-4ae9-9e3d-8d3586c2cf00 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:53.294254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b3488-4c50-4ae9-9e3d-8d3586c2cf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:53.318475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-742b3488-4c50-4ae9-9e3d-8d3586c2cf00 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:53.320426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-742b3488-4c50-4ae9-9e3d-8d3586c2cf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:53.366560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514bf1f-5dff-432f-953c-8495659a8957 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:53.381462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:53.403264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 280/558] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:53.404448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b3488-4c50-4ae9-9e3d-8d3586c2cf00 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:53.412980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c194e78-4efb-4392-8ae6-31b457c91b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:53.413559 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c194e78-4efb-4392-8ae6-31b457c91b4c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:53.413852 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c194e78-4efb-4392-8ae6-31b457c91b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:53.414132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c194e78-4efb-4392-8ae6-31b457c91b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:53.465992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:53.512080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c194e78-4efb-4392-8ae6-31b457c91b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:53.513733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c194e78-4efb-4392-8ae6-31b457c91b4c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:53.516302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b3488-4c50-4ae9-9e3d-8d3586c2cf00 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:53.552680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0080f9-77bd-44f3-8184-0b76a48e335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:53.553373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0080f9-77bd-44f3-8184-0b76a48e335c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:53.553659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0080f9-77bd-44f3-8184-0b76a48e335c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:53.553936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0080f9-77bd-44f3-8184-0b76a48e335c None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:53.555297 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0080f9-77bd-44f3-8184-0b76a48e335c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:53.555614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0080f9-77bd-44f3-8184-0b76a48e335c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:53.557978 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0080f9-77bd-44f3-8184-0b76a48e335c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:53.582257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 281/559] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 08:02:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:53.582257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0080f9-77bd-44f3-8184-0b76a48e335c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:53.633335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 279/560] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:02:53.633335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cdf54-07eb-4720-92e6-6a789b52e66a None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:53.633335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cdf54-07eb-4720-92e6-6a789b52e66a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:53.633335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cdf54-07eb-4720-92e6-6a789b52e66a None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:53.633335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 280/561] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:53.633335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cdf54-07eb-4720-92e6-6a789b52e66a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:53.648389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:53.702632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0080f9-77bd-44f3-8184-0b76a48e335c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:53.715355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:53.746235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abb3fa-576c-4b70-82f1-f46588041039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:53.746973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abb3fa-576c-4b70-82f1-f46588041039 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:53.747262 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abb3fa-576c-4b70-82f1-f46588041039 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:53.747536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abb3fa-576c-4b70-82f1-f46588041039 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:53.752670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cdf54-07eb-4720-92e6-6a789b52e66a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:53.759802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abb3fa-576c-4b70-82f1-f46588041039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-e6abb3fa-576c-4b70-82f1-f46588041039 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:53.767525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:53.768479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:53.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 282/562] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:53.770080 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abb3fa-576c-4b70-82f1-f46588041039 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:53.798082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd599a-d184-4718-b6c4-ed35bdde710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:53.798892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd599a-d184-4718-b6c4-ed35bdde710f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:53.799176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd599a-d184-4718-b6c4-ed35bdde710f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:53.799453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd599a-d184-4718-b6c4-ed35bdde710f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:53.811325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd599a-d184-4718-b6c4-ed35bdde710f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:53.812817 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd599a-d184-4718-b6c4-ed35bdde710f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-82bd599a-d184-4718-b6c4-ed35bdde710f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:53.836976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:53.838479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:53.839591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:53.839591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:53.839591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:53.839591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:53.839591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 281/563] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:53.840578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a562-494e-40b9-b3ef-8d8b029865e2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:53.840859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a562-494e-40b9-b3ef-8d8b029865e2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:53.841151 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a562-494e-40b9-b3ef-8d8b029865e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:53.862676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d325a562-494e-40b9-b3ef-8d8b029865e2 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:53.864861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d325a562-494e-40b9-b3ef-8d8b029865e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:53.897993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abb3fa-576c-4b70-82f1-f46588041039 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:53.935463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f9410-3d67-4a6e-8dca-ae27a8781ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:53.935795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:53.936283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f9410-3d67-4a6e-8dca-ae27a8781ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:53.936761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f9410-3d67-4a6e-8dca-ae27a8781ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:53.936880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f9410-3d67-4a6e-8dca-ae27a8781ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:53.951619 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 282/564] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:53.951619 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325a562-494e-40b9-b3ef-8d8b029865e2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:53.951871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f9410-3d67-4a6e-8dca-ae27a8781ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:53.951871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f9410-3d67-4a6e-8dca-ae27a8781ae5 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-a10f9410-3d67-4a6e-8dca-ae27a8781ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:53.977636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:53.978679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:53.979781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:53.979781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:53.979781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:53.979781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:53.983611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 283/565] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:53.984213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f9410-3d67-4a6e-8dca-ae27a8781ae5 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:54.010155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:54.069428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325a562-494e-40b9-b3ef-8d8b029865e2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:54.098548 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f9410-3d67-4a6e-8dca-ae27a8781ae5 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:54.114990 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b836863-d9ae-47c4-914f-c22118aeeef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:54.115670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836863-d9ae-47c4-914f-c22118aeeef3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.115958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836863-d9ae-47c4-914f-c22118aeeef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.116239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836863-d9ae-47c4-914f-c22118aeeef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.116989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b836863-d9ae-47c4-914f-c22118aeeef3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:54.117298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b836863-d9ae-47c4-914f-c22118aeeef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:54.119341 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b836863-d9ae-47c4-914f-c22118aeeef3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:54.127584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 283/566] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:54.128365 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b836863-d9ae-47c4-914f-c22118aeeef3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:54.138883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad38f1b-c473-4c9c-b770-b04976fee975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:54.139545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad38f1b-c473-4c9c-b770-b04976fee975 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.139823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad38f1b-c473-4c9c-b770-b04976fee975 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.140096 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad38f1b-c473-4c9c-b770-b04976fee975 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.140817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad38f1b-c473-4c9c-b770-b04976fee975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:54.141120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad38f1b-c473-4c9c-b770-b04976fee975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:54.142486 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad38f1b-c473-4c9c-b770-b04976fee975 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:54.154190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 284/567] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:54.155181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad38f1b-c473-4c9c-b770-b04976fee975 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:54.186888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:54.233694 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b836863-d9ae-47c4-914f-c22118aeeef3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:54.235915 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:54.255319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad38f1b-c473-4c9c-b770-b04976fee975 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:54.273403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51defc-bc64-4392-93fc-8695dda2c2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:54.274117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51defc-bc64-4392-93fc-8695dda2c2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.274399 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51defc-bc64-4392-93fc-8695dda2c2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.274712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51defc-bc64-4392-93fc-8695dda2c2e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.285603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51defc-bc64-4392-93fc-8695dda2c2e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:54.289006 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414feb5-8565-42cf-8e05-6083edc5013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:54.289655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414feb5-8565-42cf-8e05-6083edc5013a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.289939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414feb5-8565-42cf-8e05-6083edc5013a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.290216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414feb5-8565-42cf-8e05-6083edc5013a None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.291505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414feb5-8565-42cf-8e05-6083edc5013a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:54.291813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414feb5-8565-42cf-8e05-6083edc5013a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:54.293176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414feb5-8565-42cf-8e05-6083edc5013a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-8b51defc-bc64-4392-93fc-8695dda2c2e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:54.294022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:54.294939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:54.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 284/568] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:54.296761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1014a4f-3d5a-405f-9ead-8400a7fdadcf None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.296761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1014a4f-3d5a-405f-9ead-8400a7fdadcf None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.296974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1014a4f-3d5a-405f-9ead-8400a7fdadcf None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.298474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 285/569] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:54.299206 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1014a4f-3d5a-405f-9ead-8400a7fdadcf None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:54.312864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 285/570] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:54.313891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414feb5-8565-42cf-8e05-6083edc5013a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:54.413703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414feb5-8565-42cf-8e05-6083edc5013a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:54.423204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1014a4f-3d5a-405f-9ead-8400a7fdadcf None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:54.439185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:54.448400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bff12-caf3-4724-9e78-95b6e3672601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:54.449190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bff12-caf3-4724-9e78-95b6e3672601 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.449471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bff12-caf3-4724-9e78-95b6e3672601 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.449744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bff12-caf3-4724-9e78-95b6e3672601 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.456489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bff12-caf3-4724-9e78-95b6e3672601 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:54.457309 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823120f-3c57-4e42-bfa2-6aecf2bd8b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:54.457926 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bff12-caf3-4724-9e78-95b6e3672601 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:54.458090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823120f-3c57-4e42-bfa2-6aecf2bd8b30 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.458376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823120f-3c57-4e42-bfa2-6aecf2bd8b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.458679 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823120f-3c57-4e42-bfa2-6aecf2bd8b30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.470144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823120f-3c57-4e42-bfa2-6aecf2bd8b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:54.471605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823120f-3c57-4e42-bfa2-6aecf2bd8b30 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-062bff12-caf3-4724-9e78-95b6e3672601 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:02:54.473695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:54.474644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:54.475598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:02:54.475598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:02:54.475598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:02:54.475598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:02:54.475598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:02:54.475598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:02:54.475598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:54.475598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:54.475598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 286/571] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:54.476150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bff12-caf3-4724-9e78-95b6e3672601 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:54.479117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-6823120f-3c57-4e42-bfa2-6aecf2bd8b30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:54.492554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:54.493468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:54.494364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:54.494364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:54.494364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:54.494364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:54.494364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 286/572] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:54.495073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d2729-070f-4f7c-be53-3aa3c42a8ee0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.495377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d2729-070f-4f7c-be53-3aa3c42a8ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.495643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d2729-070f-4f7c-be53-3aa3c42a8ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.511756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a92d2729-070f-4f7c-be53-3aa3c42a8ee0 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:54.512950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a92d2729-070f-4f7c-be53-3aa3c42a8ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:54.578668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bff12-caf3-4724-9e78-95b6e3672601 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:54.579748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 287/573] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:54.580580 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d2729-070f-4f7c-be53-3aa3c42a8ee0 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:54.615201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28ef07-8deb-415a-8164-6e66f826c22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:54.615862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28ef07-8deb-415a-8164-6e66f826c22f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.616147 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28ef07-8deb-415a-8164-6e66f826c22f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.616422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28ef07-8deb-415a-8164-6e66f826c22f None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.617159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28ef07-8deb-415a-8164-6e66f826c22f None admin] RBAC: Adding query filter params (name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:54.617462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28ef07-8deb-415a-8164-6e66f826c22f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:54.619140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28ef07-8deb-415a-8164-6e66f826c22f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:54.626984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 287/574] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:02:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:54.627754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28ef07-8deb-415a-8164-6e66f826c22f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:54.689086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:54.691071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:54.693022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d2729-070f-4f7c-be53-3aa3c42a8ee0 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:54.726532 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395deb9b-d7c3-4ca3-bcd5-52f7335adbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:54.727362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395deb9b-d7c3-4ca3-bcd5-52f7335adbfd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.727651 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395deb9b-d7c3-4ca3-bcd5-52f7335adbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.728461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395deb9b-d7c3-4ca3-bcd5-52f7335adbfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.731904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28ef07-8deb-415a-8164-6e66f826c22f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:54.735740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395deb9b-d7c3-4ca3-bcd5-52f7335adbfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:54.737183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395deb9b-d7c3-4ca3-bcd5-52f7335adbfd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-395deb9b-d7c3-4ca3-bcd5-52f7335adbfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:02:54.751160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:54.752035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:54.753315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:02:54.753315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:02:54.753315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:02:54.753315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:02:54.753315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:02:54.753315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:02:54.753315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:54.753315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:54.753315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 288/575] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:54.753315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395deb9b-d7c3-4ca3-bcd5-52f7335adbfd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:54.768637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d880a4-96c4-4951-9d9c-432a3338311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:54.769295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d880a4-96c4-4951-9d9c-432a3338311a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.769588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d880a4-96c4-4951-9d9c-432a3338311a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.769869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d880a4-96c4-4951-9d9c-432a3338311a None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.770684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d880a4-96c4-4951-9d9c-432a3338311a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:54.770999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d880a4-96c4-4951-9d9c-432a3338311a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:54.772431 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d880a4-96c4-4951-9d9c-432a3338311a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:54.785236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 288/576] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:54.785851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d880a4-96c4-4951-9d9c-432a3338311a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:54.858940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395deb9b-d7c3-4ca3-bcd5-52f7335adbfd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:54.882782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d880a4-96c4-4951-9d9c-432a3338311a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:54.893515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce6ebd-0bb9-432e-b948-0bef59606f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:54.894167 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce6ebd-0bb9-432e-b948-0bef59606f07 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.894453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce6ebd-0bb9-432e-b948-0bef59606f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.894762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce6ebd-0bb9-432e-b948-0bef59606f07 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.895485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce6ebd-0bb9-432e-b948-0bef59606f07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:54.895796 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce6ebd-0bb9-432e-b948-0bef59606f07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:54.897159 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce6ebd-0bb9-432e-b948-0bef59606f07 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:54.906398 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:54.909257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 289/577] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:54.910078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce6ebd-0bb9-432e-b948-0bef59606f07 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:54.918011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f9de6-9a58-4375-bbaf-ad139b064e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:54.918837 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f9de6-9a58-4375-bbaf-ad139b064e11 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:54.919126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f9de6-9a58-4375-bbaf-ad139b064e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:54.919400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f9de6-9a58-4375-bbaf-ad139b064e11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:54.928962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:54.930128 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f9de6-9a58-4375-bbaf-ad139b064e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-683f9de6-9a58-4375-bbaf-ad139b064e11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:54.938603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:54.939698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 289/578] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:54.940651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f9de6-9a58-4375-bbaf-ad139b064e11 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:55.012271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce6ebd-0bb9-432e-b948-0bef59606f07 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:55.041102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f9de6-9a58-4375-bbaf-ad139b064e11 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:55.045577 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13347492-1450-436a-b91b-a3e850fd5c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:55.046361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13347492-1450-436a-b91b-a3e850fd5c63 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:55.046667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13347492-1450-436a-b91b-a3e850fd5c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:55.046951 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13347492-1450-436a-b91b-a3e850fd5c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:55.057512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13347492-1450-436a-b91b-a3e850fd5c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:55.058982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13347492-1450-436a-b91b-a3e850fd5c63 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:55.073835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2537b5e-672d-4860-8f2c-86958f8b5447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:55.074479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2537b5e-672d-4860-8f2c-86958f8b5447 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:55.074799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2537b5e-672d-4860-8f2c-86958f8b5447 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:55.075078 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2537b5e-672d-4860-8f2c-86958f8b5447 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:55.075857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2537b5e-672d-4860-8f2c-86958f8b5447 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:55.076165 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2537b5e-672d-4860-8f2c-86958f8b5447 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-13347492-1450-436a-b91b-a3e850fd5c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:55.077272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:55.078248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:55.079272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:55.079272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:55.079272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:55.079272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:55.079496 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2537b5e-672d-4860-8f2c-86958f8b5447 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:55.079572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 290/579] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:55.079572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13347492-1450-436a-b91b-a3e850fd5c63 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:55.092000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 290/580] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:55.092000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2537b5e-672d-4860-8f2c-86958f8b5447 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:55.135976 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:55.152371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:55.182970 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13347492-1450-436a-b91b-a3e850fd5c63 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:55.190587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2537b5e-672d-4860-8f2c-86958f8b5447 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:55.217461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef56f38-f292-4d15-9464-d3402dfa1f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:55.218341 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef56f38-f292-4d15-9464-d3402dfa1f7c None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:55.218655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef56f38-f292-4d15-9464-d3402dfa1f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:55.218924 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef56f38-f292-4d15-9464-d3402dfa1f7c None admin] PATH_INFO: `/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/c0956402a9bb4a9384111b36d5251749/roles/daddec68ba304943b424e61611634a1d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:55.225461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637e9a4-eb0f-496f-b1b7-1538c213af2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:55.226240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e9a4-eb0f-496f-b1b7-1538c213af2c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:55.226526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e9a4-eb0f-496f-b1b7-1538c213af2c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:55.226825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e9a4-eb0f-496f-b1b7-1538c213af2c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:55.233242 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef56f38-f292-4d15-9464-d3402dfa1f7c None admin] RBAC: Authorizing `identity:create_grant(project_id=c279ceb26daa45ba821e6ffb1db4f4f0, user_id=c0956402a9bb4a9384111b36d5251749, role_id=daddec68ba304943b424e61611634a1d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:55.233805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637e9a4-eb0f-496f-b1b7-1538c213af2c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:55.234724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef56f38-f292-4d15-9464-d3402dfa1f7c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:55.235263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637e9a4-eb0f-496f-b1b7-1538c213af2c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:55.247573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 291/581] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:02:55 2022] PUT /identity/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/c0956402a9bb4a9384111b36d5251749/roles/daddec68ba304943b424e61611634a1d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:55.248404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef56f38-f292-4d15-9464-d3402dfa1f7c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-7637e9a4-eb0f-496f-b1b7-1538c213af2c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:02:55.250577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:55.251553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:55.252498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:55.252498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:55.252498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:02:55.252498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:02:55.252498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:02:55.252498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:02:55.252498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:02:55.252498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:02:55.252498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 08:02:55.252498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:55.252498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 291/582] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:55.253064 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637e9a4-eb0f-496f-b1b7-1538c213af2c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:55.369467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef56f38-f292-4d15-9464-d3402dfa1f7c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:55.381863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637e9a4-eb0f-496f-b1b7-1538c213af2c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:55.384791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:55.393134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:55.416964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9990078-5b0a-458a-be54-f7e8bf2d8f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:55.417641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9990078-5b0a-458a-be54-f7e8bf2d8f33 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:55.417922 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9990078-5b0a-458a-be54-f7e8bf2d8f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:55.418205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9990078-5b0a-458a-be54-f7e8bf2d8f33 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:55.419007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9990078-5b0a-458a-be54-f7e8bf2d8f33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:55.419370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9990078-5b0a-458a-be54-f7e8bf2d8f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:55.420680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9990078-5b0a-458a-be54-f7e8bf2d8f33 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:55.426598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff4f6b-a83a-4c1d-8a08-01a917b71158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:55.427303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff4f6b-a83a-4c1d-8a08-01a917b71158 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:55.427815 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff4f6b-a83a-4c1d-8a08-01a917b71158 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:55.428090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff4f6b-a83a-4c1d-8a08-01a917b71158 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:55.428826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff4f6b-a83a-4c1d-8a08-01a917b71158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:55.429133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff4f6b-a83a-4c1d-8a08-01a917b71158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:55.430552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff4f6b-a83a-4c1d-8a08-01a917b71158 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:55.431500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 292/583] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:02:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:55.432530 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9990078-5b0a-458a-be54-f7e8bf2d8f33 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:55.448916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 292/584] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:55.450697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff4f6b-a83a-4c1d-8a08-01a917b71158 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:55.540710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9990078-5b0a-458a-be54-f7e8bf2d8f33 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:55.557569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff4f6b-a83a-4c1d-8a08-01a917b71158 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:55.579603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472d11-2a19-42b1-b295-41b21e0d2448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:55.580254 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472d11-2a19-42b1-b295-41b21e0d2448 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:55.580532 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472d11-2a19-42b1-b295-41b21e0d2448 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:55.580800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472d11-2a19-42b1-b295-41b21e0d2448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:55.581996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df472d11-2a19-42b1-b295-41b21e0d2448 None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=a0c29a6bfcf44b47ae368f47fdd04643) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:55.581996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df472d11-2a19-42b1-b295-41b21e0d2448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:55.583373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df472d11-2a19-42b1-b295-41b21e0d2448 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:55.598662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 293/585] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:02:55 2022] GET /identity/v3/role_assignments?user.id=a0c29a6bfcf44b47ae368f47fdd04643&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:55.598662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472d11-2a19-42b1-b295-41b21e0d2448 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:55.608999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2164175-dd43-4357-ae0b-657913f85f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:55.610139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2164175-dd43-4357-ae0b-657913f85f5b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:55.610782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2164175-dd43-4357-ae0b-657913f85f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:55.611325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2164175-dd43-4357-ae0b-657913f85f5b None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:55.612597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2164175-dd43-4357-ae0b-657913f85f5b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:55.612992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2164175-dd43-4357-ae0b-657913f85f5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:55.615573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2164175-dd43-4357-ae0b-657913f85f5b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:55.642794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 293/586] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 21 08:02:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:55.644074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2164175-dd43-4357-ae0b-657913f85f5b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:55.660245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:55.681728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:55.724334 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472d11-2a19-42b1-b295-41b21e0d2448 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:55.777364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f412af2-8869-4fa6-a333-1ef6cd0e4262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:55.777364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412af2-8869-4fa6-a333-1ef6cd0e4262 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:55.777364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412af2-8869-4fa6-a333-1ef6cd0e4262 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:55.777364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412af2-8869-4fa6-a333-1ef6cd0e4262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:55.787940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f412af2-8869-4fa6-a333-1ef6cd0e4262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:55.789407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f412af2-8869-4fa6-a333-1ef6cd0e4262 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:55.804610 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2164175-dd43-4357-ae0b-657913f85f5b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-9f412af2-8869-4fa6-a333-1ef6cd0e4262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:55.808655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:55.809538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:55.810409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:55.810409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:55.810409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:55.810409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:55.814667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 294/587] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:55.815422 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f412af2-8869-4fa6-a333-1ef6cd0e4262 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:55.849430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6c509-6cb1-4b40-a9db-fd47b6303448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:55.850321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6c509-6cb1-4b40-a9db-fd47b6303448 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:55.850506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6c509-6cb1-4b40-a9db-fd47b6303448 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:55.850809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6c509-6cb1-4b40-a9db-fd47b6303448 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:55.858886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6c509-6cb1-4b40-a9db-fd47b6303448 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:55.860334 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6c509-6cb1-4b40-a9db-fd47b6303448 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-a1e6c509-6cb1-4b40-a9db-fd47b6303448 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:02:55.875420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:55.876380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:55.877314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:55.877314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:55.877314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:02:55.877314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:02:55.877314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:02:55.877314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:02:55.877314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:02:55.877314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:02:55.877314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 08:02:55.877314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:55.881479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 294/588] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:02:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:55.882331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6c509-6cb1-4b40-a9db-fd47b6303448 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:55.943911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:55.950512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f412af2-8869-4fa6-a333-1ef6cd0e4262 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:55.984083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:56.004826 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63997a74-3989-4301-8be4-bbf00082f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:56.005720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63997a74-3989-4301-8be4-bbf00082f176 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:56.006081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63997a74-3989-4301-8be4-bbf00082f176 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:56.006433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63997a74-3989-4301-8be4-bbf00082f176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:56.007367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6c509-6cb1-4b40-a9db-fd47b6303448 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:56.018924 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63997a74-3989-4301-8be4-bbf00082f176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:56.020570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63997a74-3989-4301-8be4-bbf00082f176 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-63997a74-3989-4301-8be4-bbf00082f176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:56.039747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:56.041411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:56.042460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:56.042460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:56.042460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:56.042460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:56.044402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 295/589] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:56.045397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63997a74-3989-4301-8be4-bbf00082f176 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:56.058542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a6adf-58a0-4116-9e38-1e7211f798f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:56.059286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a6adf-58a0-4116-9e38-1e7211f798f4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:56.059578 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a6adf-58a0-4116-9e38-1e7211f798f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:56.059864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a6adf-58a0-4116-9e38-1e7211f798f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:56.061171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a6adf-58a0-4116-9e38-1e7211f798f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:56.061486 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a6adf-58a0-4116-9e38-1e7211f798f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:56.063359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a6adf-58a0-4116-9e38-1e7211f798f4 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:56.082793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 295/590] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:56.084120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a6adf-58a0-4116-9e38-1e7211f798f4 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:56.185313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63997a74-3989-4301-8be4-bbf00082f176 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:56.193575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a6adf-58a0-4116-9e38-1e7211f798f4 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:56.227299 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dee6ea-2a74-4d3f-9492-8a0d7f1d2956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:56.228603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dee6ea-2a74-4d3f-9492-8a0d7f1d2956 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:56.228764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77fd41-d960-4de1-8ee6-56e091156056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:56.228883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dee6ea-2a74-4d3f-9492-8a0d7f1d2956 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:56.229156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dee6ea-2a74-4d3f-9492-8a0d7f1d2956 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:56.229959 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77fd41-d960-4de1-8ee6-56e091156056 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:56.230076 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dee6ea-2a74-4d3f-9492-8a0d7f1d2956 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:56.230299 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dee6ea-2a74-4d3f-9492-8a0d7f1d2956 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:56.230801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77fd41-d960-4de1-8ee6-56e091156056 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:56.231269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77fd41-d960-4de1-8ee6-56e091156056 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:56.231779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dee6ea-2a74-4d3f-9492-8a0d7f1d2956 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:56.232441 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77fd41-d960-4de1-8ee6-56e091156056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:56.232941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77fd41-d960-4de1-8ee6-56e091156056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:56.234484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77fd41-d960-4de1-8ee6-56e091156056 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:56.254014 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 296/591] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:56.255256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77fd41-d960-4de1-8ee6-56e091156056 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:56.256784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 296/592] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 21 08:02:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:56.257649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dee6ea-2a74-4d3f-9492-8a0d7f1d2956 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:56.266967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:56.272305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:56.368372 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77fd41-d960-4de1-8ee6-56e091156056 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:56.388040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dee6ea-2a74-4d3f-9492-8a0d7f1d2956 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:56.419039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0bbe6-0292-4cca-b390-226782fd5383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:56.420878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0bbe6-0292-4cca-b390-226782fd5383 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:56.421292 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0bbe6-0292-4cca-b390-226782fd5383 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:56.421671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0bbe6-0292-4cca-b390-226782fd5383 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:56.434880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0bbe6-0292-4cca-b390-226782fd5383 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:56.436560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0bbe6-0292-4cca-b390-226782fd5383 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:56.437129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d399d3-f04e-47b4-8a61-e5e7ecbde6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:56.438168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d399d3-f04e-47b4-8a61-e5e7ecbde6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:56.438708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d399d3-f04e-47b4-8a61-e5e7ecbde6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:56.439432 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d399d3-f04e-47b4-8a61-e5e7ecbde6d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:56.447350 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d399d3-f04e-47b4-8a61-e5e7ecbde6d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:56.449057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d399d3-f04e-47b4-8a61-e5e7ecbde6d8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-a3a0bbe6-0292-4cca-b390-226782fd5383 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:02:56.454345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:56.455284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:56.456191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:56.456191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:56.456191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:02:56.456191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:02:56.456191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:02:56.456191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:02:56.456191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:02:56.456191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:02:56.456191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 08:02:56.456191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:56.458841 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 297/593] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:56.459871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0bbe6-0292-4cca-b390-226782fd5383 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f5d399d3-f04e-47b4-8a61-e5e7ecbde6d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:02:56.468618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:56.469477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:56.470351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:02:56.470351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:02:56.470351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:02:56.470351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:02:56.470351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:02:56.470351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:02:56.470351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:56.470351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:56.477459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 297/594] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:56.479438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d399d3-f04e-47b4-8a61-e5e7ecbde6d8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:56.543065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:56.551968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:56.597542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0bbe6-0292-4cca-b390-226782fd5383 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:56.605874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d399d3-f04e-47b4-8a61-e5e7ecbde6d8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:56.635880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dc2f5-1096-4566-9f7c-b7a5bf5c15a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:56.636665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dc2f5-1096-4566-9f7c-b7a5bf5c15a2 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:56.636948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dc2f5-1096-4566-9f7c-b7a5bf5c15a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:56.637224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dc2f5-1096-4566-9f7c-b7a5bf5c15a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:56.648242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dc2f5-1096-4566-9f7c-b7a5bf5c15a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:56.649506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dc2f5-1096-4566-9f7c-b7a5bf5c15a2 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:56.654649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673b805-81ce-4f10-81ff-19e50b80cc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:56.655574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673b805-81ce-4f10-81ff-19e50b80cc2b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:56.656082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673b805-81ce-4f10-81ff-19e50b80cc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:56.656571 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673b805-81ce-4f10-81ff-19e50b80cc2b None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:56.658119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673b805-81ce-4f10-81ff-19e50b80cc2b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:56.658929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673b805-81ce-4f10-81ff-19e50b80cc2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:56.660321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673b805-81ce-4f10-81ff-19e50b80cc2b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-370dc2f5-1096-4566-9f7c-b7a5bf5c15a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:56.671716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:56.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:56.673469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:56.673469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:56.673469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:56.673469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:56.680173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 298/595] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:56.680173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dc2f5-1096-4566-9f7c-b7a5bf5c15a2 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:56.685262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 298/596] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Jun 21 08:02:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:56.686365 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673b805-81ce-4f10-81ff-19e50b80cc2b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:56.819203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dc2f5-1096-4566-9f7c-b7a5bf5c15a2 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:56.827435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673b805-81ce-4f10-81ff-19e50b80cc2b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:56.841837 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:56.870356 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35e32f-9053-428c-8f4c-87e25a2c466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:56.871019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35e32f-9053-428c-8f4c-87e25a2c466f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:56.871299 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35e32f-9053-428c-8f4c-87e25a2c466f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:56.871635 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35e32f-9053-428c-8f4c-87e25a2c466f None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:56.872034 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87cbad-2b39-4a67-a522-ee2c7194d032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:56.872359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35e32f-9053-428c-8f4c-87e25a2c466f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:56.872713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35e32f-9053-428c-8f4c-87e25a2c466f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:56.873348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87cbad-2b39-4a67-a522-ee2c7194d032 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:56.873823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87cbad-2b39-4a67-a522-ee2c7194d032 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:56.874081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35e32f-9053-428c-8f4c-87e25a2c466f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:56.874496 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87cbad-2b39-4a67-a522-ee2c7194d032 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:56.875877 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87cbad-2b39-4a67-a522-ee2c7194d032 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:56.876871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87cbad-2b39-4a67-a522-ee2c7194d032 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:56.878509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87cbad-2b39-4a67-a522-ee2c7194d032 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:56.890782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 299/597] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:56.890782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:56.892682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35e32f-9053-428c-8f4c-87e25a2c466f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:56.902872 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 299/598] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:56.903773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87cbad-2b39-4a67-a522-ee2c7194d032 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:57.012552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87cbad-2b39-4a67-a522-ee2c7194d032 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:57.024670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35e32f-9053-428c-8f4c-87e25a2c466f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:57.047120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb61c1-5c14-4c07-a433-2bda5097df8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:57.047899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb61c1-5c14-4c07-a433-2bda5097df8a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.048174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb61c1-5c14-4c07-a433-2bda5097df8a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.048444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb61c1-5c14-4c07-a433-2bda5097df8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:57.055269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb61c1-5c14-4c07-a433-2bda5097df8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:57.056743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb61c1-5c14-4c07-a433-2bda5097df8a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:57.065261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f58e0-d02c-4380-a7d6-c237e2d3d39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:57.066261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f58e0-d02c-4380-a7d6-c237e2d3d39a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.066754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f58e0-d02c-4380-a7d6-c237e2d3d39a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.067211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f58e0-d02c-4380-a7d6-c237e2d3d39a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-4dfb61c1-5c14-4c07-a433-2bda5097df8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:02:57.071379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:57.072916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:57.073802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:02:57.073802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:02:57.073802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:02:57.073802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:02:57.073802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:02:57.073802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:02:57.073802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:57.073802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:57.078358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 300/599] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:57.078840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb61c1-5c14-4c07-a433-2bda5097df8a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:57.083364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f58e0-d02c-4380-a7d6-c237e2d3d39a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:57.085080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f58e0-d02c-4380-a7d6-c237e2d3d39a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-696f58e0-d02c-4380-a7d6-c237e2d3d39a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:57.104977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:57.105897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:57.106812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:57.106812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:57.106812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:57.106812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:57.113428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 300/600] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:57.114158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:57.115968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f58e0-d02c-4380-a7d6-c237e2d3d39a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:57.166277 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:57.208316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb61c1-5c14-4c07-a433-2bda5097df8a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:57.238482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f58e0-d02c-4380-a7d6-c237e2d3d39a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:57.246184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85264e-d005-4a7f-90c3-ccbc45e76654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:57.247243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85264e-d005-4a7f-90c3-ccbc45e76654 None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.247724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85264e-d005-4a7f-90c3-ccbc45e76654 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.248070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85264e-d005-4a7f-90c3-ccbc45e76654 None admin] PATH_INFO: `/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/36e7b70349d9427e899ee290dda2d3c3/roles/daddec68ba304943b424e61611634a1d` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:57.264539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85264e-d005-4a7f-90c3-ccbc45e76654 None admin] RBAC: Authorizing `identity:create_grant(project_id=c279ceb26daa45ba821e6ffb1db4f4f0, user_id=36e7b70349d9427e899ee290dda2d3c3, role_id=daddec68ba304943b424e61611634a1d)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:57.266109 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85264e-d005-4a7f-90c3-ccbc45e76654 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:57.281267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d27a87-c799-4418-8488-2357366fd503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:57.282348 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27a87-c799-4418-8488-2357366fd503 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.282889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27a87-c799-4418-8488-2357366fd503 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.283368 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27a87-c799-4418-8488-2357366fd503 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:57.284427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d27a87-c799-4418-8488-2357366fd503 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:57.284949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d27a87-c799-4418-8488-2357366fd503 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:57.286180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 301/601] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:02:57 2022] PUT /identity/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/36e7b70349d9427e899ee290dda2d3c3/roles/daddec68ba304943b424e61611634a1d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:57.287114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d27a87-c799-4418-8488-2357366fd503 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:57.287223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85264e-d005-4a7f-90c3-ccbc45e76654 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:57.311856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 301/602] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:57.319144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d27a87-c799-4418-8488-2357366fd503 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:57.458608 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:57.470286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:57.475167 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d27a87-c799-4418-8488-2357366fd503 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:57.484918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85264e-d005-4a7f-90c3-ccbc45e76654 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:57.518022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdf5ca-17c8-460e-a845-cdfc528be73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:57.519123 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdf5ca-17c8-460e-a845-cdfc528be73d None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.519620 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdf5ca-17c8-460e-a845-cdfc528be73d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.520003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdf5ca-17c8-460e-a845-cdfc528be73d None admin] PATH_INFO: `/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/31a233e2fc784b01a3a8a24599f3c1a8/roles/daddec68ba304943b424e61611634a1d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:57.529845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441edf-161e-4e9f-bf08-e0237f4dcc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:57.530781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441edf-161e-4e9f-bf08-e0237f4dcc79 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.531211 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441edf-161e-4e9f-bf08-e0237f4dcc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.531654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441edf-161e-4e9f-bf08-e0237f4dcc79 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:57.532652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69441edf-161e-4e9f-bf08-e0237f4dcc79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:57.533104 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69441edf-161e-4e9f-bf08-e0237f4dcc79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:57.534801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69441edf-161e-4e9f-bf08-e0237f4dcc79 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:57.544041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdf5ca-17c8-460e-a845-cdfc528be73d None admin] RBAC: Authorizing `identity:create_grant(project_id=c279ceb26daa45ba821e6ffb1db4f4f0, user_id=31a233e2fc784b01a3a8a24599f3c1a8, role_id=daddec68ba304943b424e61611634a1d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:57.545506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdf5ca-17c8-460e-a845-cdfc528be73d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:57.547342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 302/603] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:57.549050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bfc44-0093-4fed-aaaa-8b2d792e1781 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.549394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bfc44-0093-4fed-aaaa-8b2d792e1781 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.549676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bfc44-0093-4fed-aaaa-8b2d792e1781 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:57.551166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 303/604] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:57.556827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bfc44-0093-4fed-aaaa-8b2d792e1781 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:57.568233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 302/605] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:02:57 2022] PUT /identity/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/31a233e2fc784b01a3a8a24599f3c1a8/roles/daddec68ba304943b424e61611634a1d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:02:57.577407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cc71b-7297-4db3-8d31-dd4130da99ed None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.577407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cc71b-7297-4db3-8d31-dd4130da99ed None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.577407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cc71b-7297-4db3-8d31-dd4130da99ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:57.605229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6f9cc71b-7297-4db3-8d31-dd4130da99ed None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:57.606425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6f9cc71b-7297-4db3-8d31-dd4130da99ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:57.688356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bfc44-0093-4fed-aaaa-8b2d792e1781 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:57.728320 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26226ee7-465c-4f5e-bce8-44e92df9897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:57.729052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26226ee7-465c-4f5e-bce8-44e92df9897e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.729348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26226ee7-465c-4f5e-bce8-44e92df9897e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.729629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26226ee7-465c-4f5e-bce8-44e92df9897e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:57.738801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26226ee7-465c-4f5e-bce8-44e92df9897e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:57.739621 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26226ee7-465c-4f5e-bce8-44e92df9897e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-26226ee7-465c-4f5e-bce8-44e92df9897e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:02:57.756194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:57.757159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:57.758075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:02:57.758075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:02:57.758075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:02:57.758075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:02:57.758075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:02:57.758075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:02:57.758075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:02:57.758075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:57.758075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 304/606] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:57.764245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 303/607] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:57.770675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26226ee7-465c-4f5e-bce8-44e92df9897e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:57.771011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:57.796398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a514b1-11cc-4ca2-9ad7-1c0953705486 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.796692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a514b1-11cc-4ca2-9ad7-1c0953705486 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.797051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a514b1-11cc-4ca2-9ad7-1c0953705486 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:57.798480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 304/608] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:02:57.801818 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a514b1-11cc-4ca2-9ad7-1c0953705486 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:57.887163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26226ee7-465c-4f5e-bce8-44e92df9897e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:57.921941 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:57.928174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d7ccc-a5c9-439e-85d6-13f8b07c1022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:57.929100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d7ccc-a5c9-439e-85d6-13f8b07c1022 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.929587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d7ccc-a5c9-439e-85d6-13f8b07c1022 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.930065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d7ccc-a5c9-439e-85d6-13f8b07c1022 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:57.931452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d7ccc-a5c9-439e-85d6-13f8b07c1022 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:57.932000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d7ccc-a5c9-439e-85d6-13f8b07c1022 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:57.935108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d7ccc-a5c9-439e-85d6-13f8b07c1022 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:57.947469 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a514b1-11cc-4ca2-9ad7-1c0953705486 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:57.951613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 305/609] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:57.953221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d81f-25b2-48b4-9538-b85cf21fbafd None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.953759 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d81f-25b2-48b4-9538-b85cf21fbafd None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.954237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d81f-25b2-48b4-9538-b85cf21fbafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:57.974792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-0e36d81f-25b2-48b4-9538-b85cf21fbafd None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:02:57.976843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0e36d81f-25b2-48b4-9538-b85cf21fbafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:02:57.986727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7640168-43c2-4de9-a634-6fad41300a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:57.987484 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7640168-43c2-4de9-a634-6fad41300a62 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:57.987877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7640168-43c2-4de9-a634-6fad41300a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:57.988151 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7640168-43c2-4de9-a634-6fad41300a62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:58.000814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7640168-43c2-4de9-a634-6fad41300a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-d7640168-43c2-4de9-a634-6fad41300a62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:58.009606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:58.010612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:58.011784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 305/610] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:58.012541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7640168-43c2-4de9-a634-6fad41300a62 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:58.051223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:58.061854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 306/611] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:02:58.063120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36d81f-25b2-48b4-9538-b85cf21fbafd None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:58.146385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7640168-43c2-4de9-a634-6fad41300a62 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:58.170476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36d81f-25b2-48b4-9538-b85cf21fbafd None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:58.186650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3a63a-c7a3-46b8-a74f-a2799217aa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:58.187603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3a63a-c7a3-46b8-a74f-a2799217aa52 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:58.187890 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3a63a-c7a3-46b8-a74f-a2799217aa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:58.188170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3a63a-c7a3-46b8-a74f-a2799217aa52 None admin] PATH_INFO: `/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/cdac6ddece434ed7abddcffe841476ce/roles/daddec68ba304943b424e61611634a1d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:58.197404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:58.205925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3a63a-c7a3-46b8-a74f-a2799217aa52 None admin] RBAC: Authorizing `identity:create_grant(project_id=c279ceb26daa45ba821e6ffb1db4f4f0, user_id=cdac6ddece434ed7abddcffe841476ce, role_id=daddec68ba304943b424e61611634a1d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:58.207613 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3a63a-c7a3-46b8-a74f-a2799217aa52 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:58.214752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4db89-3d1f-4d03-9a73-a478e02f9b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:58.215452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4db89-3d1f-4d03-9a73-a478e02f9b2a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:58.215794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4db89-3d1f-4d03-9a73-a478e02f9b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:58.216013 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4db89-3d1f-4d03-9a73-a478e02f9b2a None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:58.216775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4db89-3d1f-4d03-9a73-a478e02f9b2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:58.217145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4db89-3d1f-4d03-9a73-a478e02f9b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:58.218492 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4db89-3d1f-4d03-9a73-a478e02f9b2a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:58.224046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 306/612] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:02:58 2022] PUT /identity/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/cdac6ddece434ed7abddcffe841476ce/roles/daddec68ba304943b424e61611634a1d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:02:58.225299 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3a63a-c7a3-46b8-a74f-a2799217aa52 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:58.228068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 307/613] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:02:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:58.240141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4db89-3d1f-4d03-9a73-a478e02f9b2a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:58.357811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:58.410959 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3a63a-c7a3-46b8-a74f-a2799217aa52 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:58.423602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4db89-3d1f-4d03-9a73-a478e02f9b2a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:58.451994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba470152-7ca2-4a59-8df9-01c1986592a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:58.452934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba470152-7ca2-4a59-8df9-01c1986592a8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:58.453257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba470152-7ca2-4a59-8df9-01c1986592a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:58.453595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba470152-7ca2-4a59-8df9-01c1986592a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:58.464094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60fb6-58f4-4a21-bc1d-f1257a556072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:58.464885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60fb6-58f4-4a21-bc1d-f1257a556072 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:58.465020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba470152-7ca2-4a59-8df9-01c1986592a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:02:58.465162 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60fb6-58f4-4a21-bc1d-f1257a556072 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:58.465434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60fb6-58f4-4a21-bc1d-f1257a556072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ba470152-7ca2-4a59-8df9-01c1986592a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:02:58.473516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:58.474449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:58.475628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 307/614] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:02:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:58.481732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba470152-7ca2-4a59-8df9-01c1986592a8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:58.485630 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c60fb6-58f4-4a21-bc1d-f1257a556072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:58.485630 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c60fb6-58f4-4a21-bc1d-f1257a556072 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-d9c60fb6-58f4-4a21-bc1d-f1257a556072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:58.508138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:58.509092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:58.510108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:58.510108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:58.510108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:58.510108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:58.511998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 308/615] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:58.516760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60fb6-58f4-4a21-bc1d-f1257a556072 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:58.548695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:58.610988 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba470152-7ca2-4a59-8df9-01c1986592a8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:58.627726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60fb6-58f4-4a21-bc1d-f1257a556072 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:58.637601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:58.648780 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3dab9-8f5c-4353-84d5-e3168ae5ad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:58.649770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3dab9-8f5c-4353-84d5-e3168ae5ad70 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:58.650233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3dab9-8f5c-4353-84d5-e3168ae5ad70 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:58.650695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3dab9-8f5c-4353-84d5-e3168ae5ad70 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:58.651607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3dab9-8f5c-4353-84d5-e3168ae5ad70 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:58.652077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3dab9-8f5c-4353-84d5-e3168ae5ad70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:58.653594 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3dab9-8f5c-4353-84d5-e3168ae5ad70 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:58.662794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 308/616] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:02:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:58.669057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3dab9-8f5c-4353-84d5-e3168ae5ad70 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:58.676075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48041bc-1746-4e3d-ab8a-350d6de64298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:58.676989 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48041bc-1746-4e3d-ab8a-350d6de64298 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:58.677479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48041bc-1746-4e3d-ab8a-350d6de64298 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:58.677961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48041bc-1746-4e3d-ab8a-350d6de64298 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:58.679026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48041bc-1746-4e3d-ab8a-350d6de64298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:58.679538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48041bc-1746-4e3d-ab8a-350d6de64298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:58.681485 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48041bc-1746-4e3d-ab8a-350d6de64298 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:58.695530 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 309/617] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:58.701670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48041bc-1746-4e3d-ab8a-350d6de64298 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:58.773870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3dab9-8f5c-4353-84d5-e3168ae5ad70 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:58.791380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:58.814669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1f11-20cf-47e9-a41b-8050278ca153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:58.814669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1f11-20cf-47e9-a41b-8050278ca153 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:58.814669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1f11-20cf-47e9-a41b-8050278ca153 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:58.814669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1f11-20cf-47e9-a41b-8050278ca153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:58.823661 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d1f11-20cf-47e9-a41b-8050278ca153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:58.825134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d1f11-20cf-47e9-a41b-8050278ca153 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-080d1f11-20cf-47e9-a41b-8050278ca153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:02:58.843493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:58.844459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:58.845405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:02:58.845405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:02:58.845405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:02:58.845405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:58.845405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 309/618] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:58.852193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1f11-20cf-47e9-a41b-8050278ca153 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:58.936575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48041bc-1746-4e3d-ab8a-350d6de64298 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:58.967707 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1f11-20cf-47e9-a41b-8050278ca153 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:59.005164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8fe14-1d68-4876-98ee-39465b8bb6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:59.005830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8fe14-1d68-4876-98ee-39465b8bb6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:59.006114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8fe14-1d68-4876-98ee-39465b8bb6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:59.006392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8fe14-1d68-4876-98ee-39465b8bb6f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:59.007151 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8fe14-1d68-4876-98ee-39465b8bb6f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:59.007459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8fe14-1d68-4876-98ee-39465b8bb6f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:59.009110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8fe14-1d68-4876-98ee-39465b8bb6f6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:59.022355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 310/619] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:59.030962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8fe14-1d68-4876-98ee-39465b8bb6f6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:59.043218 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42559-b7fc-482c-a738-570e029716d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:59.044010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42559-b7fc-482c-a738-570e029716d9 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:59.044291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42559-b7fc-482c-a738-570e029716d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:59.044562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42559-b7fc-482c-a738-570e029716d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:59.053384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d42559-b7fc-482c-a738-570e029716d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:59.054851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d42559-b7fc-482c-a738-570e029716d9 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-c3d42559-b7fc-482c-a738-570e029716d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:02:59.070270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:59.071677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:59.072933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:59.072933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:59.072933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:02:59.072933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:02:59.072933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:02:59.072933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:02:59.072933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:02:59.072933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:02:59.072933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:02:59.072933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:02:59.072933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 310/620] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 08:02:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:02:59.082644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42559-b7fc-482c-a738-570e029716d9 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:59.085617 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:59.131038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:59.184560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42559-b7fc-482c-a738-570e029716d9 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:59.221002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23cd1e-7f3e-4172-9b1e-1f7ac271aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:59.221777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23cd1e-7f3e-4172-9b1e-1f7ac271aa96 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:59.222115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23cd1e-7f3e-4172-9b1e-1f7ac271aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:59.222401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23cd1e-7f3e-4172-9b1e-1f7ac271aa96 None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:59.223321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23cd1e-7f3e-4172-9b1e-1f7ac271aa96 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:59.223635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23cd1e-7f3e-4172-9b1e-1f7ac271aa96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:59.225083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23cd1e-7f3e-4172-9b1e-1f7ac271aa96 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:59.251036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 311/621] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 08:02:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:02:59.252242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23cd1e-7f3e-4172-9b1e-1f7ac271aa96 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:59.285990 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8fe14-1d68-4876-98ee-39465b8bb6f6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:59.340455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e3ea7-00c0-4ff5-a70a-862f8b186622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:59.341622 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e3ea7-00c0-4ff5-a70a-862f8b186622 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:59.342119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e3ea7-00c0-4ff5-a70a-862f8b186622 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:59.342639 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e3ea7-00c0-4ff5-a70a-862f8b186622 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:59.345044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:59.357676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e3ea7-00c0-4ff5-a70a-862f8b186622 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:59.359152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e3ea7-00c0-4ff5-a70a-862f8b186622 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:59.379152 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23cd1e-7f3e-4172-9b1e-1f7ac271aa96 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-3b0e3ea7-00c0-4ff5-a70a-862f8b186622 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:02:59.389930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:02:59.390908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:02:59.391856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:02:59.391856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:02:59.391856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:02:59.391856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:02:59.391856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:02:59.391856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:02:59.391856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:02:59.391856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:02:59.391856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 08:02:59.391856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:02:59.391856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 311/622] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:02:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:02:59.398294 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e3ea7-00c0-4ff5-a70a-862f8b186622 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:59.428502 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e215b-1524-4d3f-9ef9-935caf1fb4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:59.429152 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e215b-1524-4d3f-9ef9-935caf1fb4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:59.429431 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e215b-1524-4d3f-9ef9-935caf1fb4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:59.429701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e215b-1524-4d3f-9ef9-935caf1fb4a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:59.503875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e215b-1524-4d3f-9ef9-935caf1fb4a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:59.505354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e215b-1524-4d3f-9ef9-935caf1fb4a6 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:59.616783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:59.628232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:59.651144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e3ea7-00c0-4ff5-a70a-862f8b186622 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:59.657517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 312/623] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 08:02:59.663053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e215b-1524-4d3f-9ef9-935caf1fb4a6 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:59.705408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491ce93-3b9b-4330-9e2a-87e7dc00071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:59.706063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491ce93-3b9b-4330-9e2a-87e7dc00071c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:59.706344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491ce93-3b9b-4330-9e2a-87e7dc00071c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:59.706636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491ce93-3b9b-4330-9e2a-87e7dc00071c None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:59.707475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491ce93-3b9b-4330-9e2a-87e7dc00071c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:02:59.707780 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491ce93-3b9b-4330-9e2a-87e7dc00071c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:59.709208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491ce93-3b9b-4330-9e2a-87e7dc00071c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:59.728727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 312/624] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 21 08:02:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:02:59.734198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491ce93-3b9b-4330-9e2a-87e7dc00071c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:02:59.840954 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e215b-1524-4d3f-9ef9-935caf1fb4a6 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:59.909620 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491ce93-3b9b-4330-9e2a-87e7dc00071c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:02:59.950353 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005ca9c-c6dc-4944-aab1-ce006faba599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:59.951812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005ca9c-c6dc-4944-aab1-ce006faba599 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:59.952096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005ca9c-c6dc-4944-aab1-ce006faba599 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:59.952369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005ca9c-c6dc-4944-aab1-ce006faba599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:59.953516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c93bca-a377-44aa-9cba-1ae3498dcc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:02:59.954303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c93bca-a377-44aa-9cba-1ae3498dcc96 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:02:59.954575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c93bca-a377-44aa-9cba-1ae3498dcc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:02:59.954869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c93bca-a377-44aa-9cba-1ae3498dcc96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:02:59.972230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:02:59.976078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005ca9c-c6dc-4944-aab1-ce006faba599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:59.977539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005ca9c-c6dc-4944-aab1-ce006faba599 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:02:59.981203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c93bca-a377-44aa-9cba-1ae3498dcc96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:02:59.983035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c93bca-a377-44aa-9cba-1ae3498dcc96 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-40c93bca-a377-44aa-9cba-1ae3498dcc96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:00.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:00.003388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:00.004265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:00.004265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:00.004265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:00.004265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:00.004265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 313/625] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:00.005246 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc01dfe-5438-4583-a658-79a669982860 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.005526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc01dfe-5438-4583-a658-79a669982860 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.005799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc01dfe-5438-4583-a658-79a669982860 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-0005ca9c-c6dc-4944-aab1-ce006faba599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:00.008080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:00.009454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:00.010328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:00.010328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:00.010328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:00.010328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:00.010538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 313/626] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:00.011732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850d45a-711a-44a0-8d19-068c3d35b552 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.012020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850d45a-711a-44a0-8d19-068c3d35b552 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.012355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850d45a-711a-44a0-8d19-068c3d35b552 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.013747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 314/627] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:00.015619 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850d45a-711a-44a0-8d19-068c3d35b552 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:00.015736 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 314/628] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:00.017550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc01dfe-5438-4583-a658-79a669982860 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:00.062044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:00.123336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc01dfe-5438-4583-a658-79a669982860 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:00.129762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850d45a-711a-44a0-8d19-068c3d35b552 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:00.158102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a1360-0349-4504-961c-458c2cb71ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:00.158798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a1360-0349-4504-961c-458c2cb71ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.159099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a1360-0349-4504-961c-458c2cb71ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.159362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a1360-0349-4504-961c-458c2cb71ce8 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.160087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a1360-0349-4504-961c-458c2cb71ce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:00.160395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a1360-0349-4504-961c-458c2cb71ce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:00.161774 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a1360-0349-4504-961c-458c2cb71ce8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:00.166848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13111f-2180-4b4a-b5cc-a39e881983d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:00.167497 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13111f-2180-4b4a-b5cc-a39e881983d4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.167777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13111f-2180-4b4a-b5cc-a39e881983d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.168051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13111f-2180-4b4a-b5cc-a39e881983d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.168766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13111f-2180-4b4a-b5cc-a39e881983d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:00.169074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13111f-2180-4b4a-b5cc-a39e881983d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:00.170433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13111f-2180-4b4a-b5cc-a39e881983d4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:00.174842 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 315/629] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:00.176384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f2ed3-ef25-4671-bbd2-c8326bae0dbc None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.176993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f2ed3-ef25-4671-bbd2-c8326bae0dbc None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.177276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f2ed3-ef25-4671-bbd2-c8326bae0dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.184511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 315/630] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:00.186024 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d1881-bf3d-43bc-9207-01ce21c9fc0b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.186308 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d1881-bf3d-43bc-9207-01ce21c9fc0b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.186582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d1881-bf3d-43bc-9207-01ce21c9fc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.199775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f23f2ed3-ef25-4671-bbd2-c8326bae0dbc None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:00.200984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f23f2ed3-ef25-4671-bbd2-c8326bae0dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:00.203324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-945d1881-bf3d-43bc-9207-01ce21c9fc0b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:00.204475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-945d1881-bf3d-43bc-9207-01ce21c9fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:00.254841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:00.270406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 316/631] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:03:00.271206 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f2ed3-ef25-4671-bbd2-c8326bae0dbc None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:00.288392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 316/632] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:03:00.289581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d1881-bf3d-43bc-9207-01ce21c9fc0b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:00.321267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:00.402386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f2ed3-ef25-4671-bbd2-c8326bae0dbc None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:00.402577 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d1881-bf3d-43bc-9207-01ce21c9fc0b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:00.437648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7441c99-3b8a-4208-8618-d6ff053016c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:00.438421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7441c99-3b8a-4208-8618-d6ff053016c5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.438728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7441c99-3b8a-4208-8618-d6ff053016c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.439004 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7441c99-3b8a-4208-8618-d6ff053016c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.439246 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc2ed4-9493-46f3-9631-f42a7ffb0184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:00.440034 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc2ed4-9493-46f3-9631-f42a7ffb0184 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.440322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc2ed4-9493-46f3-9631-f42a7ffb0184 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.440591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc2ed4-9493-46f3-9631-f42a7ffb0184 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.446048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7441c99-3b8a-4208-8618-d6ff053016c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:00.447508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc2ed4-9493-46f3-9631-f42a7ffb0184 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:00.447636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7441c99-3b8a-4208-8618-d6ff053016c5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:00.448945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc2ed4-9493-46f3-9631-f42a7ffb0184 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-c7441c99-3b8a-4208-8618-d6ff053016c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:00.461468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:00.463153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:00.464038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:00.464038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:00.464038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:00.464038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:00.464038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:00.464038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:00.464038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:00.464038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-27cc2ed4-9493-46f3-9631-f42a7ffb0184 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:00.464483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:00.465771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:00.466670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:00.466670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:00.466670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:00.466670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:00.466670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:00.466670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:00.466670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:00.466670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:00.467562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 317/633] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:00.467562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7441c99-3b8a-4208-8618-d6ff053016c5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:00.469293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 317/634] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:00.470181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc2ed4-9493-46f3-9631-f42a7ffb0184 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:00.512530 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:00.567614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:00.582837 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc2ed4-9493-46f3-9631-f42a7ffb0184 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:00.584422 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7441c99-3b8a-4208-8618-d6ff053016c5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:00.618906 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a84f-b79c-4e8d-b89a-ba6ef9aadcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:00.619702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a84f-b79c-4e8d-b89a-ba6ef9aadcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.619997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a84f-b79c-4e8d-b89a-ba6ef9aadcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.620277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a84f-b79c-4e8d-b89a-ba6ef9aadcf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.623767 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db50c13-5d20-4172-b6fa-edac830e3ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:00.624740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db50c13-5d20-4172-b6fa-edac830e3ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.625195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db50c13-5d20-4172-b6fa-edac830e3ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.625476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db50c13-5d20-4172-b6fa-edac830e3ac5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.630597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663a84f-b79c-4e8d-b89a-ba6ef9aadcf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:00.636697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db50c13-5d20-4172-b6fa-edac830e3ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-6663a84f-b79c-4e8d-b89a-ba6ef9aadcf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:00.638399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:00.639329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 318/635] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:00.645141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a84f-b79c-4e8d-b89a-ba6ef9aadcf6 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-3db50c13-5d20-4172-b6fa-edac830e3ac5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:00.645915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:00.647283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 318/636] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:00.648436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db50c13-5d20-4172-b6fa-edac830e3ac5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:00.745963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a84f-b79c-4e8d-b89a-ba6ef9aadcf6 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:00.746432 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db50c13-5d20-4172-b6fa-edac830e3ac5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:00.747959 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:00.782074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a405103-d4b0-432d-9eca-a22f2de4e3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:00.782252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c67e7-b841-453e-bb40-8ede6edab944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:00.782758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c67e7-b841-453e-bb40-8ede6edab944 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.782897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a405103-d4b0-432d-9eca-a22f2de4e3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.783046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c67e7-b841-453e-bb40-8ede6edab944 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.783197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a405103-d4b0-432d-9eca-a22f2de4e3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.783324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c67e7-b841-453e-bb40-8ede6edab944 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.783489 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a405103-d4b0-432d-9eca-a22f2de4e3b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.784215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c67e7-b841-453e-bb40-8ede6edab944 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:00.784306 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a405103-d4b0-432d-9eca-a22f2de4e3b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:00.784527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c67e7-b841-453e-bb40-8ede6edab944 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:00.784628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a405103-d4b0-432d-9eca-a22f2de4e3b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:00.785957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c67e7-b841-453e-bb40-8ede6edab944 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:00.786047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a405103-d4b0-432d-9eca-a22f2de4e3b4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:00.802612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 319/637] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:00.802817 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 319/638] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:00.802817 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a405103-d4b0-432d-9eca-a22f2de4e3b4 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:00.802967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd51f1-7948-4492-bd70-7de1ff414f58 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.802967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd51f1-7948-4492-bd70-7de1ff414f58 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.802967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd51f1-7948-4492-bd70-7de1ff414f58 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.802967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 320/639] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:00.802967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd51f1-7948-4492-bd70-7de1ff414f58 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:00.813816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:00.902505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a405103-d4b0-432d-9eca-a22f2de4e3b4 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:00.903918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd51f1-7948-4492-bd70-7de1ff414f58 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:00.936201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122b108-981f-4f10-a3f1-e7be8652a97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:00.936860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122b108-981f-4f10-a3f1-e7be8652a97f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.937081 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1d23a-eb9f-421d-acd8-99c411bb4533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:00.937199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122b108-981f-4f10-a3f1-e7be8652a97f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.937405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122b108-981f-4f10-a3f1-e7be8652a97f None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.937736 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1d23a-eb9f-421d-acd8-99c411bb4533 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:00.938022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1d23a-eb9f-421d-acd8-99c411bb4533 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:00.938144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122b108-981f-4f10-a3f1-e7be8652a97f None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:00.938299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1d23a-eb9f-421d-acd8-99c411bb4533 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:00.938451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122b108-981f-4f10-a3f1-e7be8652a97f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:00.939080 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1d23a-eb9f-421d-acd8-99c411bb4533 None admin] RBAC: Adding query filter params (name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:00.939387 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1d23a-eb9f-421d-acd8-99c411bb4533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:00.939852 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122b108-981f-4f10-a3f1-e7be8652a97f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:00.940738 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1d23a-eb9f-421d-acd8-99c411bb4533 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:00.948702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 320/640] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:00.953571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 321/641] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:00.954026 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122b108-981f-4f10-a3f1-e7be8652a97f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:00.954142 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1d23a-eb9f-421d-acd8-99c411bb4533 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:00.979419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:01.022768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:01.053560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122b108-981f-4f10-a3f1-e7be8652a97f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:01.053722 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1d23a-eb9f-421d-acd8-99c411bb4533 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:01.086854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55c9db-2274-436e-8280-32f4789ab00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:01.087551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8d504-fa54-4b01-a387-8a3ba1f544c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:01.088132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55c9db-2274-436e-8280-32f4789ab00d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:01.088352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8d504-fa54-4b01-a387-8a3ba1f544c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:01.088453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55c9db-2274-436e-8280-32f4789ab00d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:01.088636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8d504-fa54-4b01-a387-8a3ba1f544c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:01.088735 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55c9db-2274-436e-8280-32f4789ab00d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:01.088910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8d504-fa54-4b01-a387-8a3ba1f544c3 None admin] PATH_INFO: `/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/a0c29a6bfcf44b47ae368f47fdd04643/roles/daddec68ba304943b424e61611634a1d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:01.089475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55c9db-2274-436e-8280-32f4789ab00d None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=c0956402a9bb4a9384111b36d5251749) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:01.089780 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55c9db-2274-436e-8280-32f4789ab00d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:01.091235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55c9db-2274-436e-8280-32f4789ab00d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:01.096912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 322/642] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:00 2022] GET /identity/v3/role_assignments?user.id=c0956402a9bb4a9384111b36d5251749&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:01.098065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4179e94-e56b-4a11-bcf9-f6286cb70cd6 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:01.098404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4179e94-e56b-4a11-bcf9-f6286cb70cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:01.098654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4179e94-e56b-4a11-bcf9-f6286cb70cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:01.103916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8d504-fa54-4b01-a387-8a3ba1f544c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c279ceb26daa45ba821e6ffb1db4f4f0, user_id=a0c29a6bfcf44b47ae368f47fdd04643, role_id=daddec68ba304943b424e61611634a1d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:01.105396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8d504-fa54-4b01-a387-8a3ba1f544c3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:01.117169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-b4179e94-e56b-4a11-bcf9-f6286cb70cd6 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:01.119087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b4179e94-e56b-4a11-bcf9-f6286cb70cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:01.121380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 321/643] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:03:00 2022] PUT /identity/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/a0c29a6bfcf44b47ae368f47fdd04643/roles/daddec68ba304943b424e61611634a1d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:03:01.122235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8d504-fa54-4b01-a387-8a3ba1f544c3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:01.222253 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 323/644] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:03:01.228212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4179e94-e56b-4a11-bcf9-f6286cb70cd6 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:01.238396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:01.274534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8d504-fa54-4b01-a387-8a3ba1f544c3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:01.322986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa962ef5-0cc9-4226-9540-693195d9bfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:01.324328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa962ef5-0cc9-4226-9540-693195d9bfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:01.325163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa962ef5-0cc9-4226-9540-693195d9bfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:01.325574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa962ef5-0cc9-4226-9540-693195d9bfa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:01.331456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:01.343010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa962ef5-0cc9-4226-9540-693195d9bfa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:01.345346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa962ef5-0cc9-4226-9540-693195d9bfa6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-fa962ef5-0cc9-4226-9540-693195d9bfa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:01.369750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:01.371029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:01.371928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:01.371928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:01.371928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:01.371928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:01.371928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 322/645] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:01.371928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa962ef5-0cc9-4226-9540-693195d9bfa6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:01.383637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4179e94-e56b-4a11-bcf9-f6286cb70cd6 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:01.430714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6202c18-a1d2-4380-aa41-90887ba66a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:01.431542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6202c18-a1d2-4380-aa41-90887ba66a42 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:01.431821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6202c18-a1d2-4380-aa41-90887ba66a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:01.432090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6202c18-a1d2-4380-aa41-90887ba66a42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:01.445397 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6202c18-a1d2-4380-aa41-90887ba66a42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:01.447894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6202c18-a1d2-4380-aa41-90887ba66a42 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-d6202c18-a1d2-4380-aa41-90887ba66a42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:01.467779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:01.468746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:01.470195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:01.470195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:01.470195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:01.470195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:01.470195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 324/646] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:01.470195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6202c18-a1d2-4380-aa41-90887ba66a42 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:01.493442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa962ef5-0cc9-4226-9540-693195d9bfa6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:01.522873 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:01.534093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af0442-8615-4970-b385-0bf5eb33a8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:01.535244 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af0442-8615-4970-b385-0bf5eb33a8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:01.535737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af0442-8615-4970-b385-0bf5eb33a8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:01.536232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af0442-8615-4970-b385-0bf5eb33a8f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:01.550988 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af0442-8615-4970-b385-0bf5eb33a8f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-20af0442-8615-4970-b385-0bf5eb33a8f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:01.560316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:01.561264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:01.562093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:01.562093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:01.562093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:01.562093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:01.562093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:01.562093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:01.562093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:01.562093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:01.562093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:01.562093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:01.562093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:01.562093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:01.569980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 323/647] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:03:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:01.571473 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af0442-8615-4970-b385-0bf5eb33a8f9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:01.610114 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6202c18-a1d2-4380-aa41-90887ba66a42 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:01.660522 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04601d-c14d-4c3d-8656-c018d722cbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:01.661684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04601d-c14d-4c3d-8656-c018d722cbcb None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:01.661972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04601d-c14d-4c3d-8656-c018d722cbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:01.662250 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04601d-c14d-4c3d-8656-c018d722cbcb None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:01.663461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04601d-c14d-4c3d-8656-c018d722cbcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:01.664134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04601d-c14d-4c3d-8656-c018d722cbcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:01.666468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04601d-c14d-4c3d-8656-c018d722cbcb None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:01.682699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 325/648] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:01.683355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:01.686813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04601d-c14d-4c3d-8656-c018d722cbcb None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:01.697927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af0442-8615-4970-b385-0bf5eb33a8f9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:01.744753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8f4e7-4873-42fe-8442-92f756ab6359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:01.745659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f4e7-4873-42fe-8442-92f756ab6359 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:01.745948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f4e7-4873-42fe-8442-92f756ab6359 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:01.746755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f4e7-4873-42fe-8442-92f756ab6359 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:01.747389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8f4e7-4873-42fe-8442-92f756ab6359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:01.747707 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8f4e7-4873-42fe-8442-92f756ab6359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:01.749857 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8f4e7-4873-42fe-8442-92f756ab6359 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:01.766378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 324/649] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:01.767328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8f4e7-4873-42fe-8442-92f756ab6359 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:01.818928 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04601d-c14d-4c3d-8656-c018d722cbcb None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:01.838989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:01.857560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c565367-e480-4abf-b7ff-36f84565a30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:01.858630 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c565367-e480-4abf-b7ff-36f84565a30e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:01.859115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c565367-e480-4abf-b7ff-36f84565a30e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:01.859585 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c565367-e480-4abf-b7ff-36f84565a30e None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:01.860547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c565367-e480-4abf-b7ff-36f84565a30e None admin] RBAC: Adding query filter params (name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:01.861046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c565367-e480-4abf-b7ff-36f84565a30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:01.862756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c565367-e480-4abf-b7ff-36f84565a30e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:01.877250 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 326/650] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:03:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:01.878464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c565367-e480-4abf-b7ff-36f84565a30e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:01.893006 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8f4e7-4873-42fe-8442-92f756ab6359 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:01.922455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:01.935578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3072b80-bd56-4ff7-ab12-798e51049dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:01.936372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3072b80-bd56-4ff7-ab12-798e51049dba None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:01.936653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3072b80-bd56-4ff7-ab12-798e51049dba None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:01.936926 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3072b80-bd56-4ff7-ab12-798e51049dba None admin] PATH_INFO: `/v3/users/glance` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:01.945186 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3072b80-bd56-4ff7-ab12-798e51049dba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:01.946520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3072b80-bd56-4ff7-ab12-798e51049dba None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b3072b80-bd56-4ff7-ab12-798e51049dba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:01.962509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:01.963495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:01.964868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:01.964868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:01.964868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:01.964868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:01.964868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:01.964868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:01.964868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:01.964868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:01.964868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 08:03:01.964868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:01.968773 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 325/651] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:03:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:01.969616 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3072b80-bd56-4ff7-ab12-798e51049dba None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:01.992362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c565367-e480-4abf-b7ff-36f84565a30e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:02.029618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c73e2-22ef-4977-b5b0-2701d2aa1746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:02.030791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c73e2-22ef-4977-b5b0-2701d2aa1746 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:02.031288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c73e2-22ef-4977-b5b0-2701d2aa1746 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:02.031765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c73e2-22ef-4977-b5b0-2701d2aa1746 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:02.039657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c73e2-22ef-4977-b5b0-2701d2aa1746 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:02.041498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c73e2-22ef-4977-b5b0-2701d2aa1746 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-876c73e2-22ef-4977-b5b0-2701d2aa1746 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:02.056702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:02.057651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:02.058560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:02.058560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:02.058560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:02.058560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:02.058560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:02.058560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:02.058560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:02.058560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:02.058560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 08:03:02.058560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:02.061311 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 327/652] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:03:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:02.062462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c73e2-22ef-4977-b5b0-2701d2aa1746 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:02.078483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3072b80-bd56-4ff7-ab12-798e51049dba None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:02.086508 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:02.117134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c0af5-6819-4788-a000-d358f5a2af09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:02.117905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c0af5-6819-4788-a000-d358f5a2af09 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:02.118825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c0af5-6819-4788-a000-d358f5a2af09 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:02.119167 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c0af5-6819-4788-a000-d358f5a2af09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:02.130572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c0af5-6819-4788-a000-d358f5a2af09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:02.132163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c0af5-6819-4788-a000-d358f5a2af09 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f81c0af5-6819-4788-a000-d358f5a2af09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:02.151324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:02.152261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:02.153122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:02.153122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:02.153122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:02.153122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:02.157154 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 326/653] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:02.158089 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c0af5-6819-4788-a000-d358f5a2af09 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:02.175286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:02.179826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c73e2-22ef-4977-b5b0-2701d2aa1746 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:02.216810 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be178b0b-ace7-440d-a45e-ac1db7d1b20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:02.217823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be178b0b-ace7-440d-a45e-ac1db7d1b20a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:02.218302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be178b0b-ace7-440d-a45e-ac1db7d1b20a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:02.218801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be178b0b-ace7-440d-a45e-ac1db7d1b20a None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:02.219953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be178b0b-ace7-440d-a45e-ac1db7d1b20a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:02.220525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be178b0b-ace7-440d-a45e-ac1db7d1b20a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:02.222251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be178b0b-ace7-440d-a45e-ac1db7d1b20a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:02.242174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 328/654] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 21 08:03:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:02.244095 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be178b0b-ace7-440d-a45e-ac1db7d1b20a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:02.273908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c0af5-6819-4788-a000-d358f5a2af09 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:02.311966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6222a1-e32c-4f26-80b4-fb9939779c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:02.312911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6222a1-e32c-4f26-80b4-fb9939779c9a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:02.313200 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6222a1-e32c-4f26-80b4-fb9939779c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:02.313478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6222a1-e32c-4f26-80b4-fb9939779c9a None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:02.314327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6222a1-e32c-4f26-80b4-fb9939779c9a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:02.314658 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6222a1-e32c-4f26-80b4-fb9939779c9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:02.316416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6222a1-e32c-4f26-80b4-fb9939779c9a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:02.339224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 327/655] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 21 08:03:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:02.340480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6222a1-e32c-4f26-80b4-fb9939779c9a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:02.357312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be178b0b-ace7-440d-a45e-ac1db7d1b20a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:02.360035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:02.395989 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4706f1-83cf-4716-b7c4-96c03a851cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:02.396657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4706f1-83cf-4716-b7c4-96c03a851cca None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:02.396945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4706f1-83cf-4716-b7c4-96c03a851cca None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:02.397221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4706f1-83cf-4716-b7c4-96c03a851cca None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:02.398014 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4706f1-83cf-4716-b7c4-96c03a851cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:02.398321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4706f1-83cf-4716-b7c4-96c03a851cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:02.400139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4706f1-83cf-4716-b7c4-96c03a851cca None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:02.418398 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 329/656] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:02.419485 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4706f1-83cf-4716-b7c4-96c03a851cca None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:02.438901 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:02.452726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6222a1-e32c-4f26-80b4-fb9939779c9a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:02.488620 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321ba5a-cf28-4adf-b8d9-9496273354be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:02.489883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321ba5a-cf28-4adf-b8d9-9496273354be None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:02.490375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321ba5a-cf28-4adf-b8d9-9496273354be None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:02.490892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321ba5a-cf28-4adf-b8d9-9496273354be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:02.529633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4706f1-83cf-4716-b7c4-96c03a851cca None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:02.561053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321ba5a-cf28-4adf-b8d9-9496273354be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:02.563239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321ba5a-cf28-4adf-b8d9-9496273354be None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:02.569993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169098a1-f2b9-4d08-9872-8a0c0b595e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:02.570667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169098a1-f2b9-4d08-9872-8a0c0b595e6a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:02.570962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169098a1-f2b9-4d08-9872-8a0c0b595e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:02.571275 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169098a1-f2b9-4d08-9872-8a0c0b595e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:02.583056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:02.649190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169098a1-f2b9-4d08-9872-8a0c0b595e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:02.651251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169098a1-f2b9-4d08-9872-8a0c0b595e6a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:02.668613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:02.671013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 328/657] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:03:02.672036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321ba5a-cf28-4adf-b8d9-9496273354be None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:02.763927 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 330/658] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:03:02.764804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169098a1-f2b9-4d08-9872-8a0c0b595e6a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:02.777419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321ba5a-cf28-4adf-b8d9-9496273354be None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:02.795031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:02.814610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a18c9f-9c04-4eae-b4e5-112d76c22292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:02.815750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a18c9f-9c04-4eae-b4e5-112d76c22292 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:02.816245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a18c9f-9c04-4eae-b4e5-112d76c22292 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:02.816718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a18c9f-9c04-4eae-b4e5-112d76c22292 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:02.824378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a18c9f-9c04-4eae-b4e5-112d76c22292 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:02.826102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a18c9f-9c04-4eae-b4e5-112d76c22292 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b8a18c9f-9c04-4eae-b4e5-112d76c22292 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:02.841553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:02.842505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:02.843466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:02.843466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:02.843466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:02.843466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:02.843466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:02.843466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:02.843466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:02.843466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:02.843466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 08:03:02.843466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:02.846063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 329/659] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:03:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:02.847093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a18c9f-9c04-4eae-b4e5-112d76c22292 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:02.879413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169098a1-f2b9-4d08-9872-8a0c0b595e6a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:02.897080 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:02.918255 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d038c-04cc-47c0-bae0-07b29289e33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:02.919016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d038c-04cc-47c0-bae0-07b29289e33d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:02.919304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d038c-04cc-47c0-bae0-07b29289e33d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:02.919589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d038c-04cc-47c0-bae0-07b29289e33d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:02.930454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d038c-04cc-47c0-bae0-07b29289e33d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:02.932094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d038c-04cc-47c0-bae0-07b29289e33d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-4b5d038c-04cc-47c0-bae0-07b29289e33d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:02.950880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:02.951808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:02.952669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:02.952669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:02.952669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:02.952669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:02.954925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a18c9f-9c04-4eae-b4e5-112d76c22292 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:02.956655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 331/660] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:02.957538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d038c-04cc-47c0-bae0-07b29289e33d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:02.991609 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a1702-97d4-4817-97dd-2d3a26bed904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:02.992764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a1702-97d4-4817-97dd-2d3a26bed904 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:02.993339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a1702-97d4-4817-97dd-2d3a26bed904 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:02.993808 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a1702-97d4-4817-97dd-2d3a26bed904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.004479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a1702-97d4-4817-97dd-2d3a26bed904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:03.006225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a1702-97d4-4817-97dd-2d3a26bed904 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f71a1702-97d4-4817-97dd-2d3a26bed904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:03.024768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:03.026272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:03.027495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:03.027495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:03.027495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:03.027495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:03.029790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 330/661] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:03.030927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a1702-97d4-4817-97dd-2d3a26bed904 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:03.059902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:03.066150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d038c-04cc-47c0-bae0-07b29289e33d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:03.104172 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455bfbe-6d7f-48b3-8845-e998c7211825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:03.104889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455bfbe-6d7f-48b3-8845-e998c7211825 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.105507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455bfbe-6d7f-48b3-8845-e998c7211825 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.105507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455bfbe-6d7f-48b3-8845-e998c7211825 None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.106249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455bfbe-6d7f-48b3-8845-e998c7211825 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:03.106559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455bfbe-6d7f-48b3-8845-e998c7211825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:03.108050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455bfbe-6d7f-48b3-8845-e998c7211825 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:03.132366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 332/662] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Jun 21 08:03:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:03.133266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455bfbe-6d7f-48b3-8845-e998c7211825 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:03.146064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a1702-97d4-4817-97dd-2d3a26bed904 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:03.167950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:03.194685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3447a63-056b-4e8a-9f69-42e54daa7120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:03.195713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3447a63-056b-4e8a-9f69-42e54daa7120 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.196334 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3447a63-056b-4e8a-9f69-42e54daa7120 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.196778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3447a63-056b-4e8a-9f69-42e54daa7120 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.197646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3447a63-056b-4e8a-9f69-42e54daa7120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:03.198092 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3447a63-056b-4e8a-9f69-42e54daa7120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:03.200070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3447a63-056b-4e8a-9f69-42e54daa7120 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:03.215006 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 331/663] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:03.216141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3447a63-056b-4e8a-9f69-42e54daa7120 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:03.270736 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455bfbe-6d7f-48b3-8845-e998c7211825 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:03.311838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48bce8-b7c7-4047-bd20-950633829959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:03.312679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48bce8-b7c7-4047-bd20-950633829959 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.313064 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48bce8-b7c7-4047-bd20-950633829959 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.313440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48bce8-b7c7-4047-bd20-950633829959 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.314272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48bce8-b7c7-4047-bd20-950633829959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:03.314721 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48bce8-b7c7-4047-bd20-950633829959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:03.316208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48bce8-b7c7-4047-bd20-950633829959 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:03.325352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:03.329304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 333/664] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:03.330150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48bce8-b7c7-4047-bd20-950633829959 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:03.341934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3447a63-056b-4e8a-9f69-42e54daa7120 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:03.377390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da1bcf-60e8-4f4c-9103-36319bd2ea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:03.378036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da1bcf-60e8-4f4c-9103-36319bd2ea15 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.378323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da1bcf-60e8-4f4c-9103-36319bd2ea15 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.378601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da1bcf-60e8-4f4c-9103-36319bd2ea15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.420238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:03.434985 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48bce8-b7c7-4047-bd20-950633829959 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:03.445710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da1bcf-60e8-4f4c-9103-36319bd2ea15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:03.447195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da1bcf-60e8-4f4c-9103-36319bd2ea15 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:03.468021 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59da3e3-5fc4-4928-b7f9-cedb73318e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:03.468808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da3e3-5fc4-4928-b7f9-cedb73318e2d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.469088 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da3e3-5fc4-4928-b7f9-cedb73318e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.469365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da3e3-5fc4-4928-b7f9-cedb73318e2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.475993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59da3e3-5fc4-4928-b7f9-cedb73318e2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:03.477518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59da3e3-5fc4-4928-b7f9-cedb73318e2d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-c59da3e3-5fc4-4928-b7f9-cedb73318e2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:03.491609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:03.492464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:03.493930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:03.493930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:03.493930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:03.493930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:03.493930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:03.493930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:03.493930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:03.493930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:03.493930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 334/665] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:03.494787 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd272a-7d48-4fb1-83fc-ec01fb4d4fc7 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.494871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd272a-7d48-4fb1-83fc-ec01fb4d4fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.495095 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd272a-7d48-4fb1-83fc-ec01fb4d4fc7 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.496358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 335/666] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:03.497048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd272a-7d48-4fb1-83fc-ec01fb4d4fc7 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:03.539461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:03.554068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 332/667] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:03:03.555416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df0cb-5917-4bed-9f01-2c2a97b30b3d None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.555821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df0cb-5917-4bed-9f01-2c2a97b30b3d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.556119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df0cb-5917-4bed-9f01-2c2a97b30b3d None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.557357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 333/668] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:03.558046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df0cb-5917-4bed-9f01-2c2a97b30b3d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:03.613600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd272a-7d48-4fb1-83fc-ec01fb4d4fc7 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:03.652967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e7660-8598-4712-9936-7ba50aaa0d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:03.653761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e7660-8598-4712-9936-7ba50aaa0d2b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.654049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e7660-8598-4712-9936-7ba50aaa0d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.654326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e7660-8598-4712-9936-7ba50aaa0d2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.661215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e7660-8598-4712-9936-7ba50aaa0d2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:03.662685 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e7660-8598-4712-9936-7ba50aaa0d2b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:03.663278 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df0cb-5917-4bed-9f01-2c2a97b30b3d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-9a4e7660-8598-4712-9936-7ba50aaa0d2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:03.676379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:03.677233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:03.678127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:03.678127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:03.678127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:03.678127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:03.678127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:03.678127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:03.678127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:03.678127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:03.678127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 336/669] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:03.678826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72dc39-e71b-49cf-8ed5-c01d093d1726 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.679198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72dc39-e71b-49cf-8ed5-c01d093d1726 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.679404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72dc39-e71b-49cf-8ed5-c01d093d1726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.690816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:03.696880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ef72dc39-e71b-49cf-8ed5-c01d093d1726 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:03.698000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ef72dc39-e71b-49cf-8ed5-c01d093d1726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:03.702802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198ace4-a087-44b6-b3eb-efb6e389a8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:03.703454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198ace4-a087-44b6-b3eb-efb6e389a8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.703733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198ace4-a087-44b6-b3eb-efb6e389a8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.704005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198ace4-a087-44b6-b3eb-efb6e389a8b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.704816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198ace4-a087-44b6-b3eb-efb6e389a8b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:03.705119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198ace4-a087-44b6-b3eb-efb6e389a8b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:03.706554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198ace4-a087-44b6-b3eb-efb6e389a8b7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:03.718792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 334/670] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:03.719572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198ace4-a087-44b6-b3eb-efb6e389a8b7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:03.769186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 337/671] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:03:03.770454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a61d8-7090-4ecf-a28d-e3871a44892f None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.770768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a61d8-7090-4ecf-a28d-e3871a44892f None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.771045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a61d8-7090-4ecf-a28d-e3871a44892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.785866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:03.787682 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-973a61d8-7090-4ecf-a28d-e3871a44892f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:03.788886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-973a61d8-7090-4ecf-a28d-e3871a44892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:03.840008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198ace4-a087-44b6-b3eb-efb6e389a8b7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:03.854805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 338/672] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:03:03.855541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a61d8-7090-4ecf-a28d-e3871a44892f None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:03.882773 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c037f-473d-48fb-aceb-b47dddc6b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:03.883564 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c037f-473d-48fb-aceb-b47dddc6b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.884463 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c037f-473d-48fb-aceb-b47dddc6b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.884638 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c037f-473d-48fb-aceb-b47dddc6b2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.895321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c037f-473d-48fb-aceb-b47dddc6b2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:03.896774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c037f-473d-48fb-aceb-b47dddc6b2a6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f22c037f-473d-48fb-aceb-b47dddc6b2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:03.913913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:03.915546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:03.916460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:03.916460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:03.916460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:03.916460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:03.916460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 335/673] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:03.916460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c037f-473d-48fb-aceb-b47dddc6b2a6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:03.923106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:03.958198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a61d8-7090-4ecf-a28d-e3871a44892f None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:03.992666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dfa49-c458-4e4e-8539-aaf60c5d136b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:03.993572 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dfa49-c458-4e4e-8539-aaf60c5d136b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:03.993853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dfa49-c458-4e4e-8539-aaf60c5d136b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:03.994126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dfa49-c458-4e4e-8539-aaf60c5d136b None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:03.994947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dfa49-c458-4e4e-8539-aaf60c5d136b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:03.995252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dfa49-c458-4e4e-8539-aaf60c5d136b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:03.996671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dfa49-c458-4e4e-8539-aaf60c5d136b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:04.007955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 339/674] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:04.009305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dfa49-c458-4e4e-8539-aaf60c5d136b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:04.018722 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:04.022108 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c037f-473d-48fb-aceb-b47dddc6b2a6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:04.056022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b46851-1fb0-46be-8e0b-456a11d5c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:04.056839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b46851-1fb0-46be-8e0b-456a11d5c1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:04.057116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b46851-1fb0-46be-8e0b-456a11d5c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:04.057380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b46851-1fb0-46be-8e0b-456a11d5c1e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:04.058196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b46851-1fb0-46be-8e0b-456a11d5c1e9 None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=31a233e2fc784b01a3a8a24599f3c1a8) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:04.058502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b46851-1fb0-46be-8e0b-456a11d5c1e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:04.059959 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b46851-1fb0-46be-8e0b-456a11d5c1e9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:04.065615 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 336/675] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:03 2022] GET /identity/v3/role_assignments?user.id=31a233e2fc784b01a3a8a24599f3c1a8&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:04.066372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b46851-1fb0-46be-8e0b-456a11d5c1e9 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:04.123240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dfa49-c458-4e4e-8539-aaf60c5d136b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:04.152812 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:04.164744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c036419-9f2e-4c5c-bcc5-1a762d40ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:04.166195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c036419-9f2e-4c5c-bcc5-1a762d40ca7f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:04.166483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c036419-9f2e-4c5c-bcc5-1a762d40ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:04.166803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c036419-9f2e-4c5c-bcc5-1a762d40ca7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:04.178660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c036419-9f2e-4c5c-bcc5-1a762d40ca7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:04.181327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b46851-1fb0-46be-8e0b-456a11d5c1e9 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-1c036419-9f2e-4c5c-bcc5-1a762d40ca7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:04.188373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:04.189468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:04.190343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:04.190343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:04.190343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:04.190343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:04.190343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:04.190343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:04.190343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:04.190343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:04.190343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:04.190343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:04.190343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:04.190343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:04.197477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 340/676] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:03:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:04.198710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c036419-9f2e-4c5c-bcc5-1a762d40ca7f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:04.224331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2400-dd55-4d8d-a44f-b782e3e354cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:04.224530 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2400-dd55-4d8d-a44f-b782e3e354cf None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:04.224818 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2400-dd55-4d8d-a44f-b782e3e354cf None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:04.225206 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2400-dd55-4d8d-a44f-b782e3e354cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:04.238904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb2400-dd55-4d8d-a44f-b782e3e354cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-19bb2400-dd55-4d8d-a44f-b782e3e354cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:04.247833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:04.248775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:04.250031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 337/677] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:04.250812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2400-dd55-4d8d-a44f-b782e3e354cf None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:04.279324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:04.315418 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c036419-9f2e-4c5c-bcc5-1a762d40ca7f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:04.355048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdde1d2-1448-4f00-9210-e430977395bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:04.355977 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdde1d2-1448-4f00-9210-e430977395bc None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:04.356455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdde1d2-1448-4f00-9210-e430977395bc None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:04.356996 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdde1d2-1448-4f00-9210-e430977395bc None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:04.357724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdde1d2-1448-4f00-9210-e430977395bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:04.358031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdde1d2-1448-4f00-9210-e430977395bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:04.359430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdde1d2-1448-4f00-9210-e430977395bc None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:04.360070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2400-dd55-4d8d-a44f-b782e3e354cf None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:04.377366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 341/678] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:04.377366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdde1d2-1448-4f00-9210-e430977395bc None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:04.399974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfbde4-4231-4ee1-aa46-92d08e679518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:04.400623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfbde4-4231-4ee1-aa46-92d08e679518 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:04.400934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfbde4-4231-4ee1-aa46-92d08e679518 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:04.401178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfbde4-4231-4ee1-aa46-92d08e679518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:04.402071 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfbde4-4231-4ee1-aa46-92d08e679518 None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=36e7b70349d9427e899ee290dda2d3c3) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:04.402315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfbde4-4231-4ee1-aa46-92d08e679518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:04.403810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfbde4-4231-4ee1-aa46-92d08e679518 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:04.418650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 338/679] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:04 2022] GET /identity/v3/role_assignments?user.id=36e7b70349d9427e899ee290dda2d3c3&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:04.418650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfbde4-4231-4ee1-aa46-92d08e679518 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:04.443028 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:04.505485 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdde1d2-1448-4f00-9210-e430977395bc None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:04.543661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140aee9-f897-41cc-99db-bd93f20fa159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:04.544440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140aee9-f897-41cc-99db-bd93f20fa159 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:04.544794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140aee9-f897-41cc-99db-bd93f20fa159 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:04.545144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140aee9-f897-41cc-99db-bd93f20fa159 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:04.545569 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:04.546575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140aee9-f897-41cc-99db-bd93f20fa159 None admin] RBAC: Adding query filter params (name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:04.547020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140aee9-f897-41cc-99db-bd93f20fa159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:04.548731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140aee9-f897-41cc-99db-bd93f20fa159 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:04.560335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 342/680] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:03:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:04.561526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140aee9-f897-41cc-99db-bd93f20fa159 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:04.562575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfbde4-4231-4ee1-aa46-92d08e679518 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:04.617447 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c53fb-5413-4a33-9187-eb4e75f906a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:04.618240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c53fb-5413-4a33-9187-eb4e75f906a5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:04.618610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c53fb-5413-4a33-9187-eb4e75f906a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:04.618933 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c53fb-5413-4a33-9187-eb4e75f906a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:04.619694 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c53fb-5413-4a33-9187-eb4e75f906a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:04.620000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c53fb-5413-4a33-9187-eb4e75f906a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:04.621375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c53fb-5413-4a33-9187-eb4e75f906a5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:04.630253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 339/681] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:03:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:04.631332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c53fb-5413-4a33-9187-eb4e75f906a5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:04.701233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140aee9-f897-41cc-99db-bd93f20fa159 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:04.711216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:04.738328 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd2b08-6a8e-4a5d-a8ab-e8d829a88f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:04.739500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd2b08-6a8e-4a5d-a8ab-e8d829a88f73 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:04.739845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd2b08-6a8e-4a5d-a8ab-e8d829a88f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:04.740186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd2b08-6a8e-4a5d-a8ab-e8d829a88f73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:04.747853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd2b08-6a8e-4a5d-a8ab-e8d829a88f73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:04.749384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd2b08-6a8e-4a5d-a8ab-e8d829a88f73 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-21fd2b08-6a8e-4a5d-a8ab-e8d829a88f73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:04.765567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:04.766474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:04.767393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:04.767393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:04.767393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:04.767393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:04.767393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:04.767393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:04.767393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:04.767393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:04.767393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 343/682] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:04.767869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd2b08-6a8e-4a5d-a8ab-e8d829a88f73 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:04.787304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c53fb-5413-4a33-9187-eb4e75f906a5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:04.823517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef965bf6-a4fa-4aa2-b4d4-7cff1f7a3e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:04.824465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef965bf6-a4fa-4aa2-b4d4-7cff1f7a3e02 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:04.824840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef965bf6-a4fa-4aa2-b4d4-7cff1f7a3e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:04.825205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef965bf6-a4fa-4aa2-b4d4-7cff1f7a3e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:04.838196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef965bf6-a4fa-4aa2-b4d4-7cff1f7a3e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:04.840286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef965bf6-a4fa-4aa2-b4d4-7cff1f7a3e02 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ef965bf6-a4fa-4aa2-b4d4-7cff1f7a3e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:04.863840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:04.865240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:04.866144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:04.866144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:04.866144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:04.866144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:04.866144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 340/683] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:04.870648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef965bf6-a4fa-4aa2-b4d4-7cff1f7a3e02 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:04.873470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:04.896444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd2b08-6a8e-4a5d-a8ab-e8d829a88f73 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:04.938291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9330cc9-fd34-4428-a3a9-e0f100d072e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:04.939611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9330cc9-fd34-4428-a3a9-e0f100d072e8 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:04.939892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9330cc9-fd34-4428-a3a9-e0f100d072e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:04.940313 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9330cc9-fd34-4428-a3a9-e0f100d072e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:04.952377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9330cc9-fd34-4428-a3a9-e0f100d072e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:04.953957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9330cc9-fd34-4428-a3a9-e0f100d072e8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-c9330cc9-fd34-4428-a3a9-e0f100d072e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:04.973086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:04.975007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:04.977124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:04.977124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:04.977124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:04.977124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:04.983522 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 344/684] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:04.983522 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9330cc9-fd34-4428-a3a9-e0f100d072e8 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:04.997769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef965bf6-a4fa-4aa2-b4d4-7cff1f7a3e02 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:05.010939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:05.035507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6a40-5430-439c-94fd-2660aa06a950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:05.036090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6a40-5430-439c-94fd-2660aa06a950 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:05.036372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6a40-5430-439c-94fd-2660aa06a950 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:05.036648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6a40-5430-439c-94fd-2660aa06a950 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:05.037435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6a40-5430-439c-94fd-2660aa06a950 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:05.037744 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6a40-5430-439c-94fd-2660aa06a950 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:05.039232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6a40-5430-439c-94fd-2660aa06a950 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:05.052713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 341/685] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:05.053546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6a40-5430-439c-94fd-2660aa06a950 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:05.113148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9330cc9-fd34-4428-a3a9-e0f100d072e8 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:05.138464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:05.151653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df873b-fd76-40f1-8624-e12e0ee226d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:05.152314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df873b-fd76-40f1-8624-e12e0ee226d8 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:05.152596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df873b-fd76-40f1-8624-e12e0ee226d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:05.152872 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df873b-fd76-40f1-8624-e12e0ee226d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:05.153590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df873b-fd76-40f1-8624-e12e0ee226d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:05.153894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df873b-fd76-40f1-8624-e12e0ee226d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:05.155284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df873b-fd76-40f1-8624-e12e0ee226d8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:05.173345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 345/686] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:05.174073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df873b-fd76-40f1-8624-e12e0ee226d8 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:05.191323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6a40-5430-439c-94fd-2660aa06a950 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:05.239369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5eebf3-bfae-45e3-883c-bee90f8fc607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:05.241214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eebf3-bfae-45e3-883c-bee90f8fc607 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:05.242175 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eebf3-bfae-45e3-883c-bee90f8fc607 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:05.242677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eebf3-bfae-45e3-883c-bee90f8fc607 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:05.244679 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5eebf3-bfae-45e3-883c-bee90f8fc607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:05.245141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5eebf3-bfae-45e3-883c-bee90f8fc607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:05.247196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5eebf3-bfae-45e3-883c-bee90f8fc607 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:05.263982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 342/687] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:05.266008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5eebf3-bfae-45e3-883c-bee90f8fc607 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:05.273430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:05.299495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df873b-fd76-40f1-8624-e12e0ee226d8 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:05.335349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7745ac-698b-4671-b7f3-4f650ccc89c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:05.336005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7745ac-698b-4671-b7f3-4f650ccc89c0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:05.336294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7745ac-698b-4671-b7f3-4f650ccc89c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:05.336578 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7745ac-698b-4671-b7f3-4f650ccc89c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:05.337574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7745ac-698b-4671-b7f3-4f650ccc89c0 None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=cdac6ddece434ed7abddcffe841476ce) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:05.337894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7745ac-698b-4671-b7f3-4f650ccc89c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:05.339458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7745ac-698b-4671-b7f3-4f650ccc89c0 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:05.355102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 346/688] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:05 2022] GET /identity/v3/role_assignments?user.id=cdac6ddece434ed7abddcffe841476ce&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:05.356136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7745ac-698b-4671-b7f3-4f650ccc89c0 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:05.398687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5eebf3-bfae-45e3-883c-bee90f8fc607 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:05.427608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:05.441944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf49f-84c9-47e8-924d-d56e4e312404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:05.443176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf49f-84c9-47e8-924d-d56e4e312404 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:05.444775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf49f-84c9-47e8-924d-d56e4e312404 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:05.445283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf49f-84c9-47e8-924d-d56e4e312404 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:05.456326 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cf49f-84c9-47e8-924d-d56e4e312404 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:05.458739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cf49f-84c9-47e8-924d-d56e4e312404 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-769cf49f-84c9-47e8-924d-d56e4e312404 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:05.476750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:05.478283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:05.479231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:05.479231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:05.479231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:05.479231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:05.479231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:05.479231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:05.479231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:05.479231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:05.479231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 08:03:05.479231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:05.482418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 343/689] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:05.487830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf49f-84c9-47e8-924d-d56e4e312404 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:05.615731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7745ac-698b-4671-b7f3-4f650ccc89c0 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:05.625553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf49f-84c9-47e8-924d-d56e4e312404 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:05.659269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f891a-4ba9-4484-9d3a-3b08f6ea93cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:05.660110 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f891a-4ba9-4484-9d3a-3b08f6ea93cc None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:05.660357 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f891a-4ba9-4484-9d3a-3b08f6ea93cc None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:05.660653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f891a-4ba9-4484-9d3a-3b08f6ea93cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:05.671480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f891a-4ba9-4484-9d3a-3b08f6ea93cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:05.672922 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b35cf-d00f-4a56-b852-a09c6dbb90b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:05.673052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f891a-4ba9-4484-9d3a-3b08f6ea93cc None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:05.673905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b35cf-d00f-4a56-b852-a09c6dbb90b7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:05.674409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b35cf-d00f-4a56-b852-a09c6dbb90b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:05.675162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b35cf-d00f-4a56-b852-a09c6dbb90b7 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:05.676874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b35cf-d00f-4a56-b852-a09c6dbb90b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:05.677385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b35cf-d00f-4a56-b852-a09c6dbb90b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:05.679016 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b35cf-d00f-4a56-b852-a09c6dbb90b7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-361f891a-4ba9-4484-9d3a-3b08f6ea93cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:05.690659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:05.691650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:05.692657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:05.692657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:05.692657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:05.692657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:05.692657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:05.692657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:05.692657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:05.692657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:05.692657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:03:05.692657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:05.692657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 347/690] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 08:03:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:05.698373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f891a-4ba9-4484-9d3a-3b08f6ea93cc None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:05.704576 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:05.706371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 344/691] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 21 08:03:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:05.713781 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b35cf-d00f-4a56-b852-a09c6dbb90b7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:05.769688 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:05.831491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f891a-4ba9-4484-9d3a-3b08f6ea93cc None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:05.837507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b35cf-d00f-4a56-b852-a09c6dbb90b7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:05.877636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fb4f7-dee9-4f3d-8ee5-bf5c69f68d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:05.878545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fd730-53d5-4d62-bcd6-a6776eec6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:05.879432 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fb4f7-dee9-4f3d-8ee5-bf5c69f68d3b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:05.880258 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fd730-53d5-4d62-bcd6-a6776eec6823 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:05.880724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fb4f7-dee9-4f3d-8ee5-bf5c69f68d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:05.881173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fd730-53d5-4d62-bcd6-a6776eec6823 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:05.881626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fb4f7-dee9-4f3d-8ee5-bf5c69f68d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:05.882066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fd730-53d5-4d62-bcd6-a6776eec6823 None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:05.883783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fd730-53d5-4d62-bcd6-a6776eec6823 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:05.886534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fd730-53d5-4d62-bcd6-a6776eec6823 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:05.888194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fd730-53d5-4d62-bcd6-a6776eec6823 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:05.928811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 348/692] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 08:03:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:05.934345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fd730-53d5-4d62-bcd6-a6776eec6823 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:06.031784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fb4f7-dee9-4f3d-8ee5-bf5c69f68d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:06.033269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fb4f7-dee9-4f3d-8ee5-bf5c69f68d3b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:06.033379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:06.079889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fd730-53d5-4d62-bcd6-a6776eec6823 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:06.116802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:06.122032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03638e99-9ed3-42b6-bcd9-904ae6072037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:06.122974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03638e99-9ed3-42b6-bcd9-904ae6072037 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:06.124947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03638e99-9ed3-42b6-bcd9-904ae6072037 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:06.126129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03638e99-9ed3-42b6-bcd9-904ae6072037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:06.204345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 345/693] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 08:03:06.211697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fb4f7-dee9-4f3d-8ee5-bf5c69f68d3b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:06.236425 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03638e99-9ed3-42b6-bcd9-904ae6072037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:06.238783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03638e99-9ed3-42b6-bcd9-904ae6072037 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:06.305196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:06.348939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 349/694] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 08:03:06.350725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef20aff-c4b9-448e-a63a-5b9ad1290164 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:06.351221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef20aff-c4b9-448e-a63a-5b9ad1290164 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:06.351702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef20aff-c4b9-448e-a63a-5b9ad1290164 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:06.353814 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 350/695] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:06.354800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef20aff-c4b9-448e-a63a-5b9ad1290164 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:06.394090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fb4f7-dee9-4f3d-8ee5-bf5c69f68d3b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:06.437289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510e8a7-2fc7-4a65-8c8e-3eefb2bd1447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:06.438126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510e8a7-2fc7-4a65-8c8e-3eefb2bd1447 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:06.438959 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510e8a7-2fc7-4a65-8c8e-3eefb2bd1447 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:06.439248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510e8a7-2fc7-4a65-8c8e-3eefb2bd1447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:06.452205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510e8a7-2fc7-4a65-8c8e-3eefb2bd1447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:06.454349 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510e8a7-2fc7-4a65-8c8e-3eefb2bd1447 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:06.466572 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef20aff-c4b9-448e-a63a-5b9ad1290164 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:06.475237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-c510e8a7-2fc7-4a65-8c8e-3eefb2bd1447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:06.476936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:06.478056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:06.479174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:06.479174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:06.479174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:06.479174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:06.486178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 346/696] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:06.487776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8bfe-1945-4964-95a5-b4eeb85e4ccd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:06.488172 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8bfe-1945-4964-95a5-b4eeb85e4ccd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:06.488650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8bfe-1945-4964-95a5-b4eeb85e4ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:06.511511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-dd8c8bfe-1945-4964-95a5-b4eeb85e4ccd None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:06.513468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-dd8c8bfe-1945-4964-95a5-b4eeb85e4ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:06.517041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7fe1b-edca-414c-845b-b2abfa3e8dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:06.518026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7fe1b-edca-414c-845b-b2abfa3e8dae None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:06.518456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7fe1b-edca-414c-845b-b2abfa3e8dae None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:06.518914 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7fe1b-edca-414c-845b-b2abfa3e8dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:06.530532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7fe1b-edca-414c-845b-b2abfa3e8dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:06.532296 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7fe1b-edca-414c-845b-b2abfa3e8dae None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-f9a7fe1b-edca-414c-845b-b2abfa3e8dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:06.551266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:06.552240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:06.553113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:06.553113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:06.553113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:06.553113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:06.556015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 351/697] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:06.556986 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7fe1b-edca-414c-845b-b2abfa3e8dae None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:06.580122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:06.607085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 347/698] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:03:06.608226 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8bfe-1945-4964-95a5-b4eeb85e4ccd None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:06.691848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7fe1b-edca-414c-845b-b2abfa3e8dae None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:06.732287 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45dd9-1694-4009-aaa9-70a179d1443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:06.733285 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45dd9-1694-4009-aaa9-70a179d1443d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:06.733568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45dd9-1694-4009-aaa9-70a179d1443d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:06.733854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45dd9-1694-4009-aaa9-70a179d1443d None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:06.734582 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f45dd9-1694-4009-aaa9-70a179d1443d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:06.734922 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f45dd9-1694-4009-aaa9-70a179d1443d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:06.736307 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f45dd9-1694-4009-aaa9-70a179d1443d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:06.737152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8bfe-1945-4964-95a5-b4eeb85e4ccd None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:06.753612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 352/699] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:06.753612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45dd9-1694-4009-aaa9-70a179d1443d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:06.764778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:06.775213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d50402-f0e2-49d9-b92f-34374f741e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:06.775869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d50402-f0e2-49d9-b92f-34374f741e41 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:06.776149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d50402-f0e2-49d9-b92f-34374f741e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:06.776419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d50402-f0e2-49d9-b92f-34374f741e41 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:06.777139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d50402-f0e2-49d9-b92f-34374f741e41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:06.777442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d50402-f0e2-49d9-b92f-34374f741e41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:06.778819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d50402-f0e2-49d9-b92f-34374f741e41 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:06.790437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 348/700] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:06.791901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a170-c919-4b51-8e57-f4ca73e698b8 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:06.792187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a170-c919-4b51-8e57-f4ca73e698b8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:06.792460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a170-c919-4b51-8e57-f4ca73e698b8 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:06.793902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 349/701] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:06.794520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5a170-c919-4b51-8e57-f4ca73e698b8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:06.855517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:06.884518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45dd9-1694-4009-aaa9-70a179d1443d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:06.914178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5a170-c919-4b51-8e57-f4ca73e698b8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:06.919013 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d3d4e-7df9-4540-9226-39509e535864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:06.919797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d3d4e-7df9-4540-9226-39509e535864 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:06.920074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d3d4e-7df9-4540-9226-39509e535864 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:06.920399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d3d4e-7df9-4540-9226-39509e535864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:06.931661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d3d4e-7df9-4540-9226-39509e535864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:06.933098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d3d4e-7df9-4540-9226-39509e535864 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-618d3d4e-7df9-4540-9226-39509e535864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:06.950843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:06.951697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:06.952603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:06.952603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:06.952603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:06.952603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:06.952603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 353/702] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:06.952970 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d3d4e-7df9-4540-9226-39509e535864 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:06.953428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2114b0c-0c8d-4985-bd4a-98f43d871500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:06.954236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2114b0c-0c8d-4985-bd4a-98f43d871500 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:06.954526 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2114b0c-0c8d-4985-bd4a-98f43d871500 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:06.954832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2114b0c-0c8d-4985-bd4a-98f43d871500 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:06.964230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2114b0c-0c8d-4985-bd4a-98f43d871500 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:06.965684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2114b0c-0c8d-4985-bd4a-98f43d871500 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b2114b0c-0c8d-4985-bd4a-98f43d871500 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:06.980518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:06.981391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:06.982269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:06.982269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:06.982269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:06.982269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:06.982269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:06.982269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:06.982269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:06.982269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:06.982269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 350/703] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:06.983246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a30eef-d4f2-4e92-bda2-1a7c073f78c5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:06.983246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a30eef-d4f2-4e92-bda2-1a7c073f78c5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:06.983464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a30eef-d4f2-4e92-bda2-1a7c073f78c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:07.000169 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-41a30eef-d4f2-4e92-bda2-1a7c073f78c5 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:07.001353 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-41a30eef-d4f2-4e92-bda2-1a7c073f78c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:07.037837 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:07.069915 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d3d4e-7df9-4540-9226-39509e535864 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:07.070950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 351/704] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:03:07.071796 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a30eef-d4f2-4e92-bda2-1a7c073f78c5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:07.102753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:07.112541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072ecc-27af-4257-8623-dc71128a6432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:07.113329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072ecc-27af-4257-8623-dc71128a6432 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:07.113613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072ecc-27af-4257-8623-dc71128a6432 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:07.113892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072ecc-27af-4257-8623-dc71128a6432 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:07.122397 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072ecc-27af-4257-8623-dc71128a6432 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:07.123876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1072ecc-27af-4257-8623-dc71128a6432 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-a1072ecc-27af-4257-8623-dc71128a6432 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:07.140251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:07.141156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:07.142029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:07.142029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:07.142029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:07.142029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:07.142029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:07.142029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:07.142029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:07.142029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:07.142029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 354/705] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:07.143058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072ecc-27af-4257-8623-dc71128a6432 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:07.187822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a30eef-d4f2-4e92-bda2-1a7c073f78c5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:07.226114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a611d-356b-4dd4-b0d8-030d2e26f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:07.227380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a611d-356b-4dd4-b0d8-030d2e26f563 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:07.227671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a611d-356b-4dd4-b0d8-030d2e26f563 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:07.227948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a611d-356b-4dd4-b0d8-030d2e26f563 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:07.229028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a611d-356b-4dd4-b0d8-030d2e26f563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:07.229341 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a611d-356b-4dd4-b0d8-030d2e26f563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:07.231054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a611d-356b-4dd4-b0d8-030d2e26f563 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:07.248127 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 352/706] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:07.248127 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a611d-356b-4dd4-b0d8-030d2e26f563 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:07.260184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1072ecc-27af-4257-8623-dc71128a6432 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:07.280008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:07.298306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121449d7-af63-48dd-84b3-ad8cd03b37d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:07.299007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121449d7-af63-48dd-84b3-ad8cd03b37d0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:07.299300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121449d7-af63-48dd-84b3-ad8cd03b37d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:07.299580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121449d7-af63-48dd-84b3-ad8cd03b37d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:07.300369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121449d7-af63-48dd-84b3-ad8cd03b37d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:07.300681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121449d7-af63-48dd-84b3-ad8cd03b37d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:07.302118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121449d7-af63-48dd-84b3-ad8cd03b37d0 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:07.316928 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 355/707] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:07.317724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121449d7-af63-48dd-84b3-ad8cd03b37d0 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:07.366778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:07.378405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a611d-356b-4dd4-b0d8-030d2e26f563 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:07.417278 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75c7a2-affd-47a4-b719-1e4f920dbb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:07.418486 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75c7a2-affd-47a4-b719-1e4f920dbb15 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:07.418960 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75c7a2-affd-47a4-b719-1e4f920dbb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:07.419414 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75c7a2-affd-47a4-b719-1e4f920dbb15 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:07.420389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75c7a2-affd-47a4-b719-1e4f920dbb15 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:07.422037 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75c7a2-affd-47a4-b719-1e4f920dbb15 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:07.423395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121449d7-af63-48dd-84b3-ad8cd03b37d0 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-be75c7a2-affd-47a4-b719-1e4f920dbb15 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:07.441150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:07.442181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:07.443336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 353/708] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Jun 21 08:03:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:07.444196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75c7a2-affd-47a4-b719-1e4f920dbb15 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:07.462589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e14d6-809b-44b3-9f41-0b59f0132dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:07.463588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e14d6-809b-44b3-9f41-0b59f0132dfc None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:07.464052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e14d6-809b-44b3-9f41-0b59f0132dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:07.464562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e14d6-809b-44b3-9f41-0b59f0132dfc None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:07.465496 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e14d6-809b-44b3-9f41-0b59f0132dfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:07.465962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e14d6-809b-44b3-9f41-0b59f0132dfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:07.467567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e14d6-809b-44b3-9f41-0b59f0132dfc None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:07.484339 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 356/709] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:07.484339 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e14d6-809b-44b3-9f41-0b59f0132dfc None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:07.547188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:07.554294 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75c7a2-affd-47a4-b719-1e4f920dbb15 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:07.590202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cb04e-5b1e-4d96-8d85-e32d1667f921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:07.591026 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cb04e-5b1e-4d96-8d85-e32d1667f921 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:07.591640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cb04e-5b1e-4d96-8d85-e32d1667f921 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:07.591926 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cb04e-5b1e-4d96-8d85-e32d1667f921 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:07.592910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cb04e-5b1e-4d96-8d85-e32d1667f921 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:07.594880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cb04e-5b1e-4d96-8d85-e32d1667f921 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:07.600003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e14d6-809b-44b3-9f41-0b59f0132dfc None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:07.608751 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:07.627793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 354/710] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:03:07 2022] POST /identity/v3/users => generated 254 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:07.629381 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cb04e-5b1e-4d96-8d85-e32d1667f921 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:07.648902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124896e-6497-442a-8873-9332aab3d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:07.650910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124896e-6497-442a-8873-9332aab3d349 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:07.651210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124896e-6497-442a-8873-9332aab3d349 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:07.651486 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124896e-6497-442a-8873-9332aab3d349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:07.652350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124896e-6497-442a-8873-9332aab3d349 None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=a0c29a6bfcf44b47ae368f47fdd04643) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:07.652671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124896e-6497-442a-8873-9332aab3d349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:07.654176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124896e-6497-442a-8873-9332aab3d349 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:07.666662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 357/711] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:07 2022] GET /identity/v3/role_assignments?user.id=a0c29a6bfcf44b47ae368f47fdd04643&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:07.666662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124896e-6497-442a-8873-9332aab3d349 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:07.806737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124896e-6497-442a-8873-9332aab3d349 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:07.839587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cb04e-5b1e-4d96-8d85-e32d1667f921 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:07.854727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111373c9-3c32-4924-8598-b81f05d3adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:07.855325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111373c9-3c32-4924-8598-b81f05d3adbb None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:07.855609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111373c9-3c32-4924-8598-b81f05d3adbb None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:07.856000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111373c9-3c32-4924-8598-b81f05d3adbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:07.856960 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111373c9-3c32-4924-8598-b81f05d3adbb None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=c0956402a9bb4a9384111b36d5251749) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:07.857268 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111373c9-3c32-4924-8598-b81f05d3adbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:07.859740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111373c9-3c32-4924-8598-b81f05d3adbb None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:07.865751 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 358/712] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:07 2022] GET /identity/v3/role_assignments?user.id=c0956402a9bb4a9384111b36d5251749&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=6fcc322b483a475399974562c1e5bd43 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:07.867203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dff43-621b-454a-aca7-a5212d40235f None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:07.867498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dff43-621b-454a-aca7-a5212d40235f None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:07.867805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dff43-621b-454a-aca7-a5212d40235f None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:07.869331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 359/713] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:07.875116 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68130-ac12-4a73-bc57-05cdbd65ab10 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:07.875400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68130-ac12-4a73-bc57-05cdbd65ab10 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:07.875673 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f68130-ac12-4a73-bc57-05cdbd65ab10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:07.893085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e91eb-e887-4442-a901-fe8b42e6d6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:07.894125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e91eb-e887-4442-a901-fe8b42e6d6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:07.894593 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e91eb-e887-4442-a901-fe8b42e6d6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:07.895202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e91eb-e887-4442-a901-fe8b42e6d6c3 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:07.896040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-84f68130-ac12-4a73-bc57-05cdbd65ab10 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:07.896370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e91eb-e887-4442-a901-fe8b42e6d6c3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:07.896874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e91eb-e887-4442-a901-fe8b42e6d6c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:07.897276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-84f68130-ac12-4a73-bc57-05cdbd65ab10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:07.898728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e91eb-e887-4442-a901-fe8b42e6d6c3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:07.907470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 355/714] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 21 08:03:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:07.913728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e91eb-e887-4442-a901-fe8b42e6d6c3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:07.936784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:07.943446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:08.005587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 360/715] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 08:03:08.030591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f68130-ac12-4a73-bc57-05cdbd65ab10 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:08.069653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e91eb-e887-4442-a901-fe8b42e6d6c3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:08.112453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d8440-1e82-4014-9fbe-abb8244e8a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:08.113148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d8440-1e82-4014-9fbe-abb8244e8a26 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:08.113411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d8440-1e82-4014-9fbe-abb8244e8a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:08.113687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d8440-1e82-4014-9fbe-abb8244e8a26 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:08.114919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d8440-1e82-4014-9fbe-abb8244e8a26 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:08.115069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d8440-1e82-4014-9fbe-abb8244e8a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:08.116334 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d8440-1e82-4014-9fbe-abb8244e8a26 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:08.126667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 356/716] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 21 08:03:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:08.167955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f68130-ac12-4a73-bc57-05cdbd65ab10 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:08.207731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8b6bc-a224-488f-ab69-e673a1ef3693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:08.208907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8b6bc-a224-488f-ab69-e673a1ef3693 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:08.209336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8b6bc-a224-488f-ab69-e673a1ef3693 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:08.209757 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8b6bc-a224-488f-ab69-e673a1ef3693 None admin] PATH_INFO: `/v3/services/network` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:08.210575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8b6bc-a224-488f-ab69-e673a1ef3693 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:08.212936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8b6bc-a224-488f-ab69-e673a1ef3693 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-44c8b6bc-a224-488f-ab69-e673a1ef3693 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:08.229150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:08.230471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 08:03:08.231540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:08.234290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 361/717] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:08 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:08.240748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d8440-1e82-4014-9fbe-abb8244e8a26 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:08.360426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:08.383992 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d8440-1e82-4014-9fbe-abb8244e8a26 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:08.422852 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0dae2-92e4-4dbc-b855-d2dae7f57124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:08.423515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0dae2-92e4-4dbc-b855-d2dae7f57124 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:08.423794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0dae2-92e4-4dbc-b855-d2dae7f57124 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:08.424108 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0dae2-92e4-4dbc-b855-d2dae7f57124 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:08.424829 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0dae2-92e4-4dbc-b855-d2dae7f57124 None admin] RBAC: Adding query filter params (name=network) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:08.425132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0dae2-92e4-4dbc-b855-d2dae7f57124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:08.426507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0dae2-92e4-4dbc-b855-d2dae7f57124 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:08.431933 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 357/718] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:08.437397 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8b6bc-a224-488f-ab69-e673a1ef3693 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:08.483681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:08.592808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8b6bc-a224-488f-ab69-e673a1ef3693 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:08.637446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d44e9d-8b0b-4583-9c51-93a9c9bcdb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:08.638043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44e9d-8b0b-4583-9c51-93a9c9bcdb3b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:08.638324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44e9d-8b0b-4583-9c51-93a9c9bcdb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:08.638601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44e9d-8b0b-4583-9c51-93a9c9bcdb3b None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:08.639343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d44e9d-8b0b-4583-9c51-93a9c9bcdb3b None admin] RBAC: Adding query filter params (type=network) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:08.639654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d44e9d-8b0b-4583-9c51-93a9c9bcdb3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:08.641055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d44e9d-8b0b-4583-9c51-93a9c9bcdb3b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:08.652643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 362/719] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:10.435507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0c503-41e3-4bdb-a30e-11771f7073cb None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:10.436542 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0c503-41e3-4bdb-a30e-11771f7073cb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:10.437043 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0c503-41e3-4bdb-a30e-11771f7073cb None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:10.438927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 358/720] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:10.444322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb448cbc-03d7-44f3-895c-fcbee964d9f1 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:10.445118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb448cbc-03d7-44f3-895c-fcbee964d9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:10.445591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb448cbc-03d7-44f3-895c-fcbee964d9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:10.471786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc3b80-9995-4761-b150-a62a969200a5 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:10.472419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc3b80-9995-4761-b150-a62a969200a5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:10.472915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc3b80-9995-4761-b150-a62a969200a5 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:10.474759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 359/721] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:10.476164 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-bb448cbc-03d7-44f3-895c-fcbee964d9f1 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:10.478137 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-bb448cbc-03d7-44f3-895c-fcbee964d9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:10.479974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9720954-5d00-4585-ac5f-4f307e900569 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:10.480261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9720954-5d00-4585-ac5f-4f307e900569 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:10.480541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9720954-5d00-4585-ac5f-4f307e900569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:10.511677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e9720954-5d00-4585-ac5f-4f307e900569 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:10.512877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e9720954-5d00-4585-ac5f-4f307e900569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:10.554717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 363/722] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:03:10.585020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47df6e-126d-4f8a-8629-3207e831d0e6 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:10.585020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47df6e-126d-4f8a-8629-3207e831d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:10.585020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47df6e-126d-4f8a-8629-3207e831d0e6 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:10.585020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 364/723] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:03:10.588291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47df6e-126d-4f8a-8629-3207e831d0e6 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:10.626642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 360/724] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:03:10.626834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:10.626914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493abf62-6637-4776-a644-af88a30107f1 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:10.626914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493abf62-6637-4776-a644-af88a30107f1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:10.626914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493abf62-6637-4776-a644-af88a30107f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:10.657173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-493abf62-6637-4776-a644-af88a30107f1 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:10.658741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-493abf62-6637-4776-a644-af88a30107f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:10.714384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47df6e-126d-4f8a-8629-3207e831d0e6 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:10.730106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 361/725] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:03:10.731400 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493abf62-6637-4776-a644-af88a30107f1 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:10.740505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:10.762081 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284ee32-a3d2-47cb-b757-16049ce9a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:10.762898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284ee32-a3d2-47cb-b757-16049ce9a988 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:10.763181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284ee32-a3d2-47cb-b757-16049ce9a988 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:10.763518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284ee32-a3d2-47cb-b757-16049ce9a988 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:10.774767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284ee32-a3d2-47cb-b757-16049ce9a988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-9284ee32-a3d2-47cb-b757-16049ce9a988 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:10.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:10.784436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:10.785618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 365/726] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:03:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:10.786531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba37de6-f1d1-422c-bfc7-2a3a8e19c355 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:10.786531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba37de6-f1d1-422c-bfc7-2a3a8e19c355 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:10.786531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba37de6-f1d1-422c-bfc7-2a3a8e19c355 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:10.790312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 366/727] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:10.790312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba37de6-f1d1-422c-bfc7-2a3a8e19c355 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:10.846898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493abf62-6637-4776-a644-af88a30107f1 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:10.875927 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:10.886231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1ba96-d017-42e9-8ee9-eb33ab48c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:10.887069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1ba96-d017-42e9-8ee9-eb33ab48c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:10.887347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1ba96-d017-42e9-8ee9-eb33ab48c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:10.887620 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1ba96-d017-42e9-8ee9-eb33ab48c4c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:10.895507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba37de6-f1d1-422c-bfc7-2a3a8e19c355 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:10.898518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1ba96-d017-42e9-8ee9-eb33ab48c4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ddf1ba96-d017-42e9-8ee9-eb33ab48c4c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:10.907125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:10.908042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:10.908897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 362/728] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:10.909580 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1ba96-d017-42e9-8ee9-eb33ab48c4c3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:10.937771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f165d-454d-4ae8-a772-3fd5ead13f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:10.938588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f165d-454d-4ae8-a772-3fd5ead13f16 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:10.938900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f165d-454d-4ae8-a772-3fd5ead13f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:10.939177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f165d-454d-4ae8-a772-3fd5ead13f16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:10.950431 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f165d-454d-4ae8-a772-3fd5ead13f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-fa6f165d-454d-4ae8-a772-3fd5ead13f16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:10.958150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:10.959136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:10.959973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 367/729] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:10.960655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc52f8a-6e0c-40a1-a258-c6646fc10a37 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:10.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc52f8a-6e0c-40a1-a258-c6646fc10a37 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:10.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc52f8a-6e0c-40a1-a258-c6646fc10a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:10.977893 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-cbc52f8a-6e0c-40a1-a258-c6646fc10a37 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:10.979039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-cbc52f8a-6e0c-40a1-a258-c6646fc10a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:10.982527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:11.027464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1ba96-d017-42e9-8ee9-eb33ab48c4c3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:11.062512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3f243-ab43-46ab-8de0-e12c86bee810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:11.063052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 368/730] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:03:11.063231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3f243-ab43-46ab-8de0-e12c86bee810 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:11.063484 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3f243-ab43-46ab-8de0-e12c86bee810 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:11.063759 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc52f8a-6e0c-40a1-a258-c6646fc10a37 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:11.063856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3f243-ab43-46ab-8de0-e12c86bee810 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:11.064506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3f243-ab43-46ab-8de0-e12c86bee810 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:11.064812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3f243-ab43-46ab-8de0-e12c86bee810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:11.066203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3f243-ab43-46ab-8de0-e12c86bee810 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:11.080154 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 363/731] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:03:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:11.081032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3f243-ab43-46ab-8de0-e12c86bee810 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:11.145920 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:11.179784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc52f8a-6e0c-40a1-a258-c6646fc10a37 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:11.187741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3f243-ab43-46ab-8de0-e12c86bee810 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:11.215313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:11.218149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503ea3c-1d0d-497a-bddb-49c5b7c440be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:11.218840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503ea3c-1d0d-497a-bddb-49c5b7c440be None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:11.219125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503ea3c-1d0d-497a-bddb-49c5b7c440be None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:11.219401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503ea3c-1d0d-497a-bddb-49c5b7c440be None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:11.220143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503ea3c-1d0d-497a-bddb-49c5b7c440be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:11.220450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503ea3c-1d0d-497a-bddb-49c5b7c440be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:11.221826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503ea3c-1d0d-497a-bddb-49c5b7c440be None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:11.224301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92935ec8-daf5-4973-9054-e10518f06379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:11.224950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92935ec8-daf5-4973-9054-e10518f06379 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:11.225230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92935ec8-daf5-4973-9054-e10518f06379 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:11.225503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92935ec8-daf5-4973-9054-e10518f06379 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:11.226239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92935ec8-daf5-4973-9054-e10518f06379 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:11.226543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92935ec8-daf5-4973-9054-e10518f06379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:11.228033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92935ec8-daf5-4973-9054-e10518f06379 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:11.232717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 369/732] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:03:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:11.233501 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503ea3c-1d0d-497a-bddb-49c5b7c440be None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:11.236623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 364/733] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:03:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:11.237844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92935ec8-daf5-4973-9054-e10518f06379 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:11.340509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503ea3c-1d0d-497a-bddb-49c5b7c440be None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:11.340761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92935ec8-daf5-4973-9054-e10518f06379 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:11.373833 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edec731-479b-4acc-a8d3-811d10fa089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:11.374073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4b99-eb80-46de-a81c-61e1fadf5a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:11.374499 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edec731-479b-4acc-a8d3-811d10fa089e None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:11.374803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edec731-479b-4acc-a8d3-811d10fa089e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:11.374898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4b99-eb80-46de-a81c-61e1fadf5a40 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:11.375086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edec731-479b-4acc-a8d3-811d10fa089e None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:11.375181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4b99-eb80-46de-a81c-61e1fadf5a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:11.375387 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4b99-eb80-46de-a81c-61e1fadf5a40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:11.375848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edec731-479b-4acc-a8d3-811d10fa089e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:11.377227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edec731-479b-4acc-a8d3-811d10fa089e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:11.379370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:11.387175 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f4b99-eb80-46de-a81c-61e1fadf5a40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:11.388918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f4b99-eb80-46de-a81c-61e1fadf5a40 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:11.393076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 370/734] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:03:11 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:11.394416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4772fb-0993-4ca7-af64-eceaec0df1ca None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:11.394739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4772fb-0993-4ca7-af64-eceaec0df1ca None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:11.395016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4772fb-0993-4ca7-af64-eceaec0df1ca None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:11.396424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 371/735] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:11.397026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4772fb-0993-4ca7-af64-eceaec0df1ca None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e84f4b99-eb80-46de-a81c-61e1fadf5a40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:11.411851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:11.412868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:11.413783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:11.413783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:11.413783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:11.413783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:11.413783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 365/736] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:11.414489 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4b99-eb80-46de-a81c-61e1fadf5a40 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:11.461993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:11.527074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4772fb-0993-4ca7-af64-eceaec0df1ca None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:11.530035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4b99-eb80-46de-a81c-61e1fadf5a40 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:11.567974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcea34-a37c-45de-9532-05b27cb2be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:11.569180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcea34-a37c-45de-9532-05b27cb2be08 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:11.570211 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcea34-a37c-45de-9532-05b27cb2be08 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:11.570652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcea34-a37c-45de-9532-05b27cb2be08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:11.575463 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285e79c-f5d4-446f-99cb-119545dd0a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:11.576338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285e79c-f5d4-446f-99cb-119545dd0a38 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:11.578753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285e79c-f5d4-446f-99cb-119545dd0a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:11.578753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285e79c-f5d4-446f-99cb-119545dd0a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:11.587991 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcea34-a37c-45de-9532-05b27cb2be08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:11.589481 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcea34-a37c-45de-9532-05b27cb2be08 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:11.589606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285e79c-f5d4-446f-99cb-119545dd0a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:11.591037 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285e79c-f5d4-446f-99cb-119545dd0a38 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-3ddcea34-a37c-45de-9532-05b27cb2be08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:11.607785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:11.608823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:11.609717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:11.609717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:11.609717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:11.609717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:11.609717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 372/737] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:11.610432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918091-6b11-4d29-8711-8965aa1bf295 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:11.613644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918091-6b11-4d29-8711-8965aa1bf295 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:11.613644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918091-6b11-4d29-8711-8965aa1bf295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-3285e79c-f5d4-446f-99cb-119545dd0a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:11.613840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:11.614942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:11.615831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:11.615831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:11.615831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:11.615831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:11.615831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 366/738] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:11.615831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285e79c-f5d4-446f-99cb-119545dd0a38 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:11.632678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-4b918091-6b11-4d29-8711-8965aa1bf295 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:11.634461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4b918091-6b11-4d29-8711-8965aa1bf295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:11.684804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:11.734650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 373/739] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 08:03:11.734650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918091-6b11-4d29-8711-8965aa1bf295 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:11.745969 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:11.755968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285e79c-f5d4-446f-99cb-119545dd0a38 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:11.792336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5c433-2f3d-41f9-a907-9792e3c19419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:11.792914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5c433-2f3d-41f9-a907-9792e3c19419 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:11.793198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5c433-2f3d-41f9-a907-9792e3c19419 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:11.793478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5c433-2f3d-41f9-a907-9792e3c19419 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:11.794202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5c433-2f3d-41f9-a907-9792e3c19419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:11.794509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5c433-2f3d-41f9-a907-9792e3c19419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:11.795915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5c433-2f3d-41f9-a907-9792e3c19419 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:11.808228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 367/740] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:11.809014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5c433-2f3d-41f9-a907-9792e3c19419 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:11.855146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918091-6b11-4d29-8711-8965aa1bf295 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:11.895372 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2ecd7-ae9b-418d-80ee-2f0bec5c5bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:11.896034 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2ecd7-ae9b-418d-80ee-2f0bec5c5bed None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:11.896320 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2ecd7-ae9b-418d-80ee-2f0bec5c5bed None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:11.896599 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2ecd7-ae9b-418d-80ee-2f0bec5c5bed None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:11.897358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2ecd7-ae9b-418d-80ee-2f0bec5c5bed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:11.897750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2ecd7-ae9b-418d-80ee-2f0bec5c5bed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:11.899352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2ecd7-ae9b-418d-80ee-2f0bec5c5bed None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:11.911531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 374/741] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:11.912644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2ecd7-ae9b-418d-80ee-2f0bec5c5bed None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:11.922333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5c433-2f3d-41f9-a907-9792e3c19419 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:11.949791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:11.960508 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3882b-b528-4cc9-9b6c-c700976ecc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:11.961168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3882b-b528-4cc9-9b6c-c700976ecc82 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:11.962110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3882b-b528-4cc9-9b6c-c700976ecc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:11.962110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3882b-b528-4cc9-9b6c-c700976ecc82 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:11.963073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3882b-b528-4cc9-9b6c-c700976ecc82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:11.963374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3882b-b528-4cc9-9b6c-c700976ecc82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:11.964742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3882b-b528-4cc9-9b6c-c700976ecc82 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:11.981679 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 368/742] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:11.986740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3882b-b528-4cc9-9b6c-c700976ecc82 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:12.007594 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:12.044770 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2ecd7-ae9b-418d-80ee-2f0bec5c5bed None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:12.083633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdfe3d-d667-4ac0-89d9-ca52ce5552c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:12.084407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdfe3d-d667-4ac0-89d9-ca52ce5552c8 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:12.084754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdfe3d-d667-4ac0-89d9-ca52ce5552c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:12.085001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdfe3d-d667-4ac0-89d9-ca52ce5552c8 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:12.085687 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdfe3d-d667-4ac0-89d9-ca52ce5552c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:12.087645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdfe3d-d667-4ac0-89d9-ca52ce5552c8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:12.114657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 375/743] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:03:11 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:12.114657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdfe3d-d667-4ac0-89d9-ca52ce5552c8 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:12.114992 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3882b-b528-4cc9-9b6c-c700976ecc82 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:12.168592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa61dd9-0062-43b3-91df-0ccbce8fc1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:12.169536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa61dd9-0062-43b3-91df-0ccbce8fc1cb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:12.169883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa61dd9-0062-43b3-91df-0ccbce8fc1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:12.170235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa61dd9-0062-43b3-91df-0ccbce8fc1cb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:12.179228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa61dd9-0062-43b3-91df-0ccbce8fc1cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:12.181677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa61dd9-0062-43b3-91df-0ccbce8fc1cb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-caa61dd9-0062-43b3-91df-0ccbce8fc1cb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:12.197624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:12.198728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:12.199695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:12.199695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:12.199695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:12.199695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:12.199695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:12.199695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:12.199695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:12.199695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:12.199695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 08:03:12.199695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:12.199695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 369/744] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 08:03:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:12.200287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa61dd9-0062-43b3-91df-0ccbce8fc1cb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:12.251976 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:12.268415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdfe3d-d667-4ac0-89d9-ca52ce5552c8 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:12.301863 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:12.319088 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac204216-5bc3-4350-bf02-e56f7cdee786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:12.319891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac204216-5bc3-4350-bf02-e56f7cdee786 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:12.324641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac204216-5bc3-4350-bf02-e56f7cdee786 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:12.324969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac204216-5bc3-4350-bf02-e56f7cdee786 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:12.336946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac204216-5bc3-4350-bf02-e56f7cdee786 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:12.337923 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac204216-5bc3-4350-bf02-e56f7cdee786 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:12.355476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa61dd9-0062-43b3-91df-0ccbce8fc1cb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-ac204216-5bc3-4350-bf02-e56f7cdee786 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:12.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:12.361131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:12.362330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:12.362330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:12.362330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:12.362330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:12.362330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:12.362330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:12.362330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:12.362330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:12.362330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:03:12.362330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:12.362330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 376/745] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 08:03:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:12.363105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac204216-5bc3-4350-bf02-e56f7cdee786 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:12.408707 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b6c25-2a9c-4b04-82f9-16e4963e2947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:12.409771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b6c25-2a9c-4b04-82f9-16e4963e2947 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:12.410198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b6c25-2a9c-4b04-82f9-16e4963e2947 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:12.410631 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b6c25-2a9c-4b04-82f9-16e4963e2947 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:12.420692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b6c25-2a9c-4b04-82f9-16e4963e2947 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:12.422590 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b6c25-2a9c-4b04-82f9-16e4963e2947 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e58b6c25-2a9c-4b04-82f9-16e4963e2947 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:12.437013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:12.438187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:12.439453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:12.439453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:12.439453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:12.439453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:12.439453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:12.439453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:12.439453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:12.439453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:12.439453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 08:03:12.439453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:12.440932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 370/746] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:12.446697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b6c25-2a9c-4b04-82f9-16e4963e2947 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:12.502870 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac204216-5bc3-4350-bf02-e56f7cdee786 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:12.541276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b1804-9a46-4b42-84db-6bb9c38c388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:12.542189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b1804-9a46-4b42-84db-6bb9c38c388a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:12.542563 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b1804-9a46-4b42-84db-6bb9c38c388a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:12.542903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b1804-9a46-4b42-84db-6bb9c38c388a None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:12.543867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b1804-9a46-4b42-84db-6bb9c38c388a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:12.544296 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b1804-9a46-4b42-84db-6bb9c38c388a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:12.546183 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b1804-9a46-4b42-84db-6bb9c38c388a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:12.569093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b6c25-2a9c-4b04-82f9-16e4963e2947 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:12.581100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 377/747] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 21 08:03:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:12.582123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b1804-9a46-4b42-84db-6bb9c38c388a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:12.595733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:12.615038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:12.616532 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5b0f4-bf08-4113-8a3d-e6a98ddcee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:12.617505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5b0f4-bf08-4113-8a3d-e6a98ddcee39 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:12.619719 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5b0f4-bf08-4113-8a3d-e6a98ddcee39 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:12.620424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5b0f4-bf08-4113-8a3d-e6a98ddcee39 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:12.621436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5b0f4-bf08-4113-8a3d-e6a98ddcee39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:12.621893 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5b0f4-bf08-4113-8a3d-e6a98ddcee39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:12.624427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5b0f4-bf08-4113-8a3d-e6a98ddcee39 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:12.651730 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 371/748] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 08:03:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:12.651730 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5b0f4-bf08-4113-8a3d-e6a98ddcee39 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:12.710582 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b1804-9a46-4b42-84db-6bb9c38c388a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:12.764354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d708-d248-4cdd-8c4b-1c7a04307d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:12.765659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d708-d248-4cdd-8c4b-1c7a04307d8e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:12.766567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d708-d248-4cdd-8c4b-1c7a04307d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:12.767150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d708-d248-4cdd-8c4b-1c7a04307d8e None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:12.768239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59d708-d248-4cdd-8c4b-1c7a04307d8e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:12.768693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59d708-d248-4cdd-8c4b-1c7a04307d8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:12.769302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5b0f4-bf08-4113-8a3d-e6a98ddcee39 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:12.770448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59d708-d248-4cdd-8c4b-1c7a04307d8e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:12.800250 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 378/749] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 21 08:03:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:12.800250 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d708-d248-4cdd-8c4b-1c7a04307d8e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:12.819896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fa190-e30c-41de-a27b-9eee6d396700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:12.820510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fa190-e30c-41de-a27b-9eee6d396700 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:12.821561 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fa190-e30c-41de-a27b-9eee6d396700 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:12.822000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fa190-e30c-41de-a27b-9eee6d396700 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:12.878485 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:12.904755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:12.920737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d708-d248-4cdd-8c4b-1c7a04307d8e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:12.924070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fa190-e30c-41de-a27b-9eee6d396700 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:12.925724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fa190-e30c-41de-a27b-9eee6d396700 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:12.959576 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc359b88-a070-46eb-99af-eeb5dca3138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:12.960480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc359b88-a070-46eb-99af-eeb5dca3138e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:12.960859 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc359b88-a070-46eb-99af-eeb5dca3138e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:12.961443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc359b88-a070-46eb-99af-eeb5dca3138e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:12.973468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc359b88-a070-46eb-99af-eeb5dca3138e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:12.975123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc359b88-a070-46eb-99af-eeb5dca3138e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-bc359b88-a070-46eb-99af-eeb5dca3138e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:12.996404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:12.997560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:12.999460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:12.999460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:12.999460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:12.999460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:13.000802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 379/750] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:13.001818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc359b88-a070-46eb-99af-eeb5dca3138e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:13.062155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 372/751] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:03:13.063252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fa190-e30c-41de-a27b-9eee6d396700 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:13.134063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc359b88-a070-46eb-99af-eeb5dca3138e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:13.164284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:13.169700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:13.187892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837608a5-c9a4-4101-811e-1a45d7b91d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:13.188193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fa190-e30c-41de-a27b-9eee6d396700 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:13.188780 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837608a5-c9a4-4101-811e-1a45d7b91d61 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:13.189196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837608a5-c9a4-4101-811e-1a45d7b91d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:13.189566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837608a5-c9a4-4101-811e-1a45d7b91d61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:13.226210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b4e9c-b74d-4f6e-89b4-46adc8d31f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:13.227205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b4e9c-b74d-4f6e-89b4-46adc8d31f92 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:13.227768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b4e9c-b74d-4f6e-89b4-46adc8d31f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:13.228220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b4e9c-b74d-4f6e-89b4-46adc8d31f92 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:13.229080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b4e9c-b74d-4f6e-89b4-46adc8d31f92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:13.229531 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b4e9c-b74d-4f6e-89b4-46adc8d31f92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:13.231093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b4e9c-b74d-4f6e-89b4-46adc8d31f92 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:13.245310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 373/752] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:13.246432 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b4e9c-b74d-4f6e-89b4-46adc8d31f92 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:13.278305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837608a5-c9a4-4101-811e-1a45d7b91d61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:13.280023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837608a5-c9a4-4101-811e-1a45d7b91d61 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:13.376919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b4e9c-b74d-4f6e-89b4-46adc8d31f92 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:13.397716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 380/753] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:03:13.397716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837608a5-c9a4-4101-811e-1a45d7b91d61 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:13.424657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:13.431717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92746b6-3008-4dad-b503-0d582670dcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:13.432645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92746b6-3008-4dad-b503-0d582670dcff None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:13.433028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92746b6-3008-4dad-b503-0d582670dcff None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:13.433403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92746b6-3008-4dad-b503-0d582670dcff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:13.447045 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92746b6-3008-4dad-b503-0d582670dcff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:13.448907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92746b6-3008-4dad-b503-0d582670dcff None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:13.456346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e92746b6-3008-4dad-b503-0d582670dcff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:13.468938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:13.470034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:13.471130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:13.471130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:13.471130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:13.471130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:13.473972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 374/754] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:13.475200 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92746b6-3008-4dad-b503-0d582670dcff None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:13.529338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837608a5-c9a4-4101-811e-1a45d7b91d61 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:13.566229 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896856df-cbbe-4719-aac7-c122ddf30368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:13.568295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896856df-cbbe-4719-aac7-c122ddf30368 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:13.569462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896856df-cbbe-4719-aac7-c122ddf30368 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:13.570111 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896856df-cbbe-4719-aac7-c122ddf30368 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:13.579132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896856df-cbbe-4719-aac7-c122ddf30368 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:13.580601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896856df-cbbe-4719-aac7-c122ddf30368 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:13.585994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92746b6-3008-4dad-b503-0d582670dcff None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-896856df-cbbe-4719-aac7-c122ddf30368 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:13.595523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:13.596382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:13.597683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:13.597683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:13.597683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:13.597683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:13.597683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:13.597683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:13.597683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:13.597683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:13.597683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 381/755] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:13.598863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19991-911b-480d-9cf1-cfca3a8bfb97 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:13.598863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19991-911b-480d-9cf1-cfca3a8bfb97 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:13.598987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19991-911b-480d-9cf1-cfca3a8bfb97 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:13.602747 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 382/756] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:13.602747 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa19991-911b-480d-9cf1-cfca3a8bfb97 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:13.628941 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d6388-46d5-4140-88a3-0014478d46eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:13.629807 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d6388-46d5-4140-88a3-0014478d46eb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:13.630093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d6388-46d5-4140-88a3-0014478d46eb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:13.630366 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d6388-46d5-4140-88a3-0014478d46eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:13.641022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d6388-46d5-4140-88a3-0014478d46eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:13.642454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d6388-46d5-4140-88a3-0014478d46eb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ad2d6388-46d5-4140-88a3-0014478d46eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:13.660903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:13.661779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:13.663523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:13.663523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:13.663523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:13.663523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:13.663523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 375/757] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:13.663523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d6388-46d5-4140-88a3-0014478d46eb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:13.699127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:13.718936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:13.720799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa19991-911b-480d-9cf1-cfca3a8bfb97 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:13.756290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02753ff-d3d9-4b0d-b64e-f073d7b725ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:13.756956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02753ff-d3d9-4b0d-b64e-f073d7b725ad None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:13.757237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02753ff-d3d9-4b0d-b64e-f073d7b725ad None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:13.757512 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02753ff-d3d9-4b0d-b64e-f073d7b725ad None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:13.759130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02753ff-d3d9-4b0d-b64e-f073d7b725ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:13.759446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02753ff-d3d9-4b0d-b64e-f073d7b725ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:13.760831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02753ff-d3d9-4b0d-b64e-f073d7b725ad None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:13.772588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 383/758] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:13.773907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701401-9db4-4139-b709-6835835a0268 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:13.774716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701401-9db4-4139-b709-6835835a0268 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:13.775007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701401-9db4-4139-b709-6835835a0268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:13.785106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d6388-46d5-4140-88a3-0014478d46eb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:13.792325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-38701401-9db4-4139-b709-6835835a0268 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:13.793524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-38701401-9db4-4139-b709-6835835a0268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:13.824279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56792a62-7b4c-4989-aaf2-8756cced3900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:13.824928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56792a62-7b4c-4989-aaf2-8756cced3900 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:13.825210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56792a62-7b4c-4989-aaf2-8756cced3900 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:13.825486 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56792a62-7b4c-4989-aaf2-8756cced3900 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:13.826279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56792a62-7b4c-4989-aaf2-8756cced3900 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:13.826577 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56792a62-7b4c-4989-aaf2-8756cced3900 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:13.828044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56792a62-7b4c-4989-aaf2-8756cced3900 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:13.840706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 376/759] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:13.841745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56792a62-7b4c-4989-aaf2-8756cced3900 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:13.873319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 384/760] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:13.874520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38701401-9db4-4139-b709-6835835a0268 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:13.947255 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:13.962978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56792a62-7b4c-4989-aaf2-8756cced3900 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:13.974845 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:13.981225 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38701401-9db4-4139-b709-6835835a0268 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:14.000646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86f9aa-2780-415f-b07c-2d5f3c5125ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:14.001311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86f9aa-2780-415f-b07c-2d5f3c5125ba None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.001597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86f9aa-2780-415f-b07c-2d5f3c5125ba None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.001877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86f9aa-2780-415f-b07c-2d5f3c5125ba None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.002612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86f9aa-2780-415f-b07c-2d5f3c5125ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:14.003044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86f9aa-2780-415f-b07c-2d5f3c5125ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:14.004429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86f9aa-2780-415f-b07c-2d5f3c5125ba None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:14.021595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 377/761] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:14.022250 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86f9aa-2780-415f-b07c-2d5f3c5125ba None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:14.022549 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64eccb-2e2b-4021-9779-9d2599fe862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:14.023393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64eccb-2e2b-4021-9779-9d2599fe862a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.023678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64eccb-2e2b-4021-9779-9d2599fe862a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.024194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64eccb-2e2b-4021-9779-9d2599fe862a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.032056 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64eccb-2e2b-4021-9779-9d2599fe862a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:14.033509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64eccb-2e2b-4021-9779-9d2599fe862a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-aa64eccb-2e2b-4021-9779-9d2599fe862a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:14.047473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:14.048356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:14.049222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:14.049222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:14.049222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:14.049222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:14.049222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:14.049222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:14.049222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:14.049222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:14.049222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 385/762] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:14.049704 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64eccb-2e2b-4021-9779-9d2599fe862a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:14.138416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86f9aa-2780-415f-b07c-2d5f3c5125ba None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:14.161980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64eccb-2e2b-4021-9779-9d2599fe862a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:14.174798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29e2b1-4389-431a-ade9-75ceb5aea600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:14.175751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29e2b1-4389-431a-ade9-75ceb5aea600 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.176048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29e2b1-4389-431a-ade9-75ceb5aea600 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.176324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29e2b1-4389-431a-ade9-75ceb5aea600 None admin] PATH_INFO: `/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/c0956402a9bb4a9384111b36d5251749/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.178320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29e2b1-4389-431a-ade9-75ceb5aea600 None admin] RBAC: Authorizing `identity:create_grant(project_id=c279ceb26daa45ba821e6ffb1db4f4f0, user_id=c0956402a9bb4a9384111b36d5251749, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:14.179828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29e2b1-4389-431a-ade9-75ceb5aea600 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:14.194114 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:14.194641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 378/763] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:03:14 2022] PUT /identity/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/c0956402a9bb4a9384111b36d5251749/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:03:14.195368 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29e2b1-4389-431a-ade9-75ceb5aea600 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:14.207074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c6482-7d26-4e18-bca4-0bd8820fa7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:14.207963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c6482-7d26-4e18-bca4-0bd8820fa7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.208249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c6482-7d26-4e18-bca4-0bd8820fa7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.209346 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c6482-7d26-4e18-bca4-0bd8820fa7f1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.210268 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c6482-7d26-4e18-bca4-0bd8820fa7f1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:14.213392 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c6482-7d26-4e18-bca4-0bd8820fa7f1 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-3c8c6482-7d26-4e18-bca4-0bd8820fa7f1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:14.231762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:14.232786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:14.233615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 386/764] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Jun 21 08:03:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:14.235169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c6482-7d26-4e18-bca4-0bd8820fa7f1 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:14.237319 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:14.324230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29e2b1-4389-431a-ade9-75ceb5aea600 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:14.365966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39faac6-9f1e-4aa4-bd6f-e0b3ed42dbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:14.368134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39faac6-9f1e-4aa4-bd6f-e0b3ed42dbbc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.368134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39faac6-9f1e-4aa4-bd6f-e0b3ed42dbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.368134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39faac6-9f1e-4aa4-bd6f-e0b3ed42dbbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.378502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39faac6-9f1e-4aa4-bd6f-e0b3ed42dbbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:14.379485 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c6482-7d26-4e18-bca4-0bd8820fa7f1 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:14.380005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39faac6-9f1e-4aa4-bd6f-e0b3ed42dbbc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f39faac6-9f1e-4aa4-bd6f-e0b3ed42dbbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:14.394689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:14.395603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:14.397141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:14.397141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:14.397141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:14.397141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:14.397141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:14.397141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:14.397141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:14.397141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:14.397141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 379/765] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:14.397141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39faac6-9f1e-4aa4-bd6f-e0b3ed42dbbc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:14.425104 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52f0fb-b258-400f-a49e-4ba58ff9910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:14.425768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52f0fb-b258-400f-a49e-4ba58ff9910d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.426052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52f0fb-b258-400f-a49e-4ba58ff9910d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.426333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52f0fb-b258-400f-a49e-4ba58ff9910d None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.427157 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52f0fb-b258-400f-a49e-4ba58ff9910d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:14.427466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52f0fb-b258-400f-a49e-4ba58ff9910d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:14.428918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52f0fb-b258-400f-a49e-4ba58ff9910d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:14.442737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 387/766] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:14.444161 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35249a-9c6a-450f-b887-c6062dcaa401 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.444450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35249a-9c6a-450f-b887-c6062dcaa401 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.444724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35249a-9c6a-450f-b887-c6062dcaa401 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.450367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 388/767] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:14.450367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35249a-9c6a-450f-b887-c6062dcaa401 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:14.503989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:14.511177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:14.519430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39faac6-9f1e-4aa4-bd6f-e0b3ed42dbbc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:14.561218 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35249a-9c6a-450f-b887-c6062dcaa401 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:14.565301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa7df1-e595-496b-815b-56974b0a76be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:14.566160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa7df1-e595-496b-815b-56974b0a76be None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.566569 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa7df1-e595-496b-815b-56974b0a76be None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.567082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa7df1-e595-496b-815b-56974b0a76be None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.567917 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa7df1-e595-496b-815b-56974b0a76be None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:14.568376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa7df1-e595-496b-815b-56974b0a76be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:14.570480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa7df1-e595-496b-815b-56974b0a76be None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:14.577542 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 380/768] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 21 08:03:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:14.578473 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa7df1-e595-496b-815b-56974b0a76be None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:14.606973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc910359-b87b-4d9f-befb-26ec1dfe267a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:14.607871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc910359-b87b-4d9f-befb-26ec1dfe267a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.608099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc910359-b87b-4d9f-befb-26ec1dfe267a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.608382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc910359-b87b-4d9f-befb-26ec1dfe267a None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.609491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc910359-b87b-4d9f-befb-26ec1dfe267a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:14.610076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc910359-b87b-4d9f-befb-26ec1dfe267a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:14.611990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc910359-b87b-4d9f-befb-26ec1dfe267a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:14.626202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 389/769] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:14.627528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b08134-84fb-47be-b4e3-7028c83b9368 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.627817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b08134-84fb-47be-b4e3-7028c83b9368 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.628097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b08134-84fb-47be-b4e3-7028c83b9368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.645568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-31b08134-84fb-47be-b4e3-7028c83b9368 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:14.646777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-31b08134-84fb-47be-b4e3-7028c83b9368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:14.692015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa7df1-e595-496b-815b-56974b0a76be None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:14.724253 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 390/770] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:14.725098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b08134-84fb-47be-b4e3-7028c83b9368 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:14.737395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e5048-d3a2-4e97-b684-02f39f0f6e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:14.738044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e5048-d3a2-4e97-b684-02f39f0f6e6e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.738329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e5048-d3a2-4e97-b684-02f39f0f6e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.738602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e5048-d3a2-4e97-b684-02f39f0f6e6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.739723 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e5048-d3a2-4e97-b684-02f39f0f6e6e None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=89cb97f51e6b4568a09e83cfbdf9e8c6) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:14.740034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e5048-d3a2-4e97-b684-02f39f0f6e6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:14.741581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e5048-d3a2-4e97-b684-02f39f0f6e6e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:14.749112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 381/771] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:14 2022] GET /identity/v3/role_assignments?user.id=89cb97f51e6b4568a09e83cfbdf9e8c6&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:14.749876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e5048-d3a2-4e97-b684-02f39f0f6e6e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:14.773236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:14.795919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:14.872196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b08134-84fb-47be-b4e3-7028c83b9368 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:14.876076 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e5048-d3a2-4e97-b684-02f39f0f6e6e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:14.918075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd106f-5c65-4bee-9063-255f16efad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:14.918771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd106f-5c65-4bee-9063-255f16efad6c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.919073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd106f-5c65-4bee-9063-255f16efad6c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.919339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd106f-5c65-4bee-9063-255f16efad6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.920183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd106f-5c65-4bee-9063-255f16efad6c None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=a0c29a6bfcf44b47ae368f47fdd04643) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:14.920497 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd106f-5c65-4bee-9063-255f16efad6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:14.920956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1770e-7e23-40c4-aa8f-2611aa83cea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:14.921623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1770e-7e23-40c4-aa8f-2611aa83cea8 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:14.921905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1770e-7e23-40c4-aa8f-2611aa83cea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:14.921998 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd106f-5c65-4bee-9063-255f16efad6c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:14.922182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1770e-7e23-40c4-aa8f-2611aa83cea8 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:14.922930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1770e-7e23-40c4-aa8f-2611aa83cea8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:14.923237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1770e-7e23-40c4-aa8f-2611aa83cea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:14.924616 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1770e-7e23-40c4-aa8f-2611aa83cea8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:14.929314 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 382/772] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:14 2022] GET /identity/v3/role_assignments?user.id=a0c29a6bfcf44b47ae368f47fdd04643&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=6fcc322b483a475399974562c1e5bd43 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:14.930739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd106f-5c65-4bee-9063-255f16efad6c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:14.946728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 391/773] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 21 08:03:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:14.950021 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1770e-7e23-40c4-aa8f-2611aa83cea8 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:15.037449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:15.059589 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd106f-5c65-4bee-9063-255f16efad6c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:15.106030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9091009-b774-4132-b160-85f70e6d7c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:15.106867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9091009-b774-4132-b160-85f70e6d7c52 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:15.107150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9091009-b774-4132-b160-85f70e6d7c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:15.109841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9091009-b774-4132-b160-85f70e6d7c52 None admin] PATH_INFO: `/v3/services/network` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:15.110512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9091009-b774-4132-b160-85f70e6d7c52 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:15.112888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9091009-b774-4132-b160-85f70e6d7c52 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e9091009-b774-4132-b160-85f70e6d7c52 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:15.133695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:15.134762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 08:03:15.135606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:15.136981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 383/774] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:14 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:15.144184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9091009-b774-4132-b160-85f70e6d7c52 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:15.166506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1770e-7e23-40c4-aa8f-2611aa83cea8 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:15.178125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:15.228925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fcc51-fe6f-4e6a-9005-a66e7c7d580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:15.229593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fcc51-fe6f-4e6a-9005-a66e7c7d580d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:15.229874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fcc51-fe6f-4e6a-9005-a66e7c7d580d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:15.230143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fcc51-fe6f-4e6a-9005-a66e7c7d580d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:15.230965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fcc51-fe6f-4e6a-9005-a66e7c7d580d None admin] RBAC: Adding query filter params (interface=public, service_id=1a8c86163cad4180a9a7a74983bd4489, region_id=RegionOne) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:15.231273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fcc51-fe6f-4e6a-9005-a66e7c7d580d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:15.232643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fcc51-fe6f-4e6a-9005-a66e7c7d580d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:15.249103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 392/775] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 08:03:14 2022] GET /identity/v3/endpoints?service_id=1a8c86163cad4180a9a7a74983bd4489&interface=public®ion_id=RegionOne => generated 194 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:15.255774 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fcc51-fe6f-4e6a-9005-a66e7c7d580d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:15.333345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9091009-b774-4132-b160-85f70e6d7c52 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:15.399782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad46142-fbd1-44b7-9aca-7146cbc8fe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:15.400461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad46142-fbd1-44b7-9aca-7146cbc8fe87 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:15.400748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad46142-fbd1-44b7-9aca-7146cbc8fe87 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:15.401026 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad46142-fbd1-44b7-9aca-7146cbc8fe87 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:15.401864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad46142-fbd1-44b7-9aca-7146cbc8fe87 None admin] RBAC: Adding query filter params (name=network) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:15.402283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad46142-fbd1-44b7-9aca-7146cbc8fe87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:15.403693 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad46142-fbd1-44b7-9aca-7146cbc8fe87 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:15.405734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fcc51-fe6f-4e6a-9005-a66e7c7d580d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:15.417590 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 384/776] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:15.422901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad46142-fbd1-44b7-9aca-7146cbc8fe87 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:15.437982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:15.453571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0f427-6c12-4476-bfa6-b28296cd3fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:15.455943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0f427-6c12-4476-bfa6-b28296cd3fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:15.456561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0f427-6c12-4476-bfa6-b28296cd3fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:15.457796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0f427-6c12-4476-bfa6-b28296cd3fb0 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:15.458683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0f427-6c12-4476-bfa6-b28296cd3fb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:15.462649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0f427-6c12-4476-bfa6-b28296cd3fb0 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:15.473625 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 393/777] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 08:03:15 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:15.592654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad46142-fbd1-44b7-9aca-7146cbc8fe87 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:15.650293 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abec26d-f2b4-4fe3-9890-d14ffc43aae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:15.651349 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abec26d-f2b4-4fe3-9890-d14ffc43aae1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:15.651844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abec26d-f2b4-4fe3-9890-d14ffc43aae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:15.652291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abec26d-f2b4-4fe3-9890-d14ffc43aae1 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:15.653241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abec26d-f2b4-4fe3-9890-d14ffc43aae1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:15.653738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abec26d-f2b4-4fe3-9890-d14ffc43aae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:15.655394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abec26d-f2b4-4fe3-9890-d14ffc43aae1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:15.666508 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 385/778] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:15.671845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0f427-6c12-4476-bfa6-b28296cd3fb0 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:15.725955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:15.816313 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0f427-6c12-4476-bfa6-b28296cd3fb0 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:15.863360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95657ae-9191-4ba5-9036-a0f7507e228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:15.864193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95657ae-9191-4ba5-9036-a0f7507e228c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:15.864476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95657ae-9191-4ba5-9036-a0f7507e228c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:15.864753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95657ae-9191-4ba5-9036-a0f7507e228c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:15.865544 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95657ae-9191-4ba5-9036-a0f7507e228c None admin] RBAC: Adding query filter params (interface=public, service_id=0455f5fcb68747ad8389f4b5194adb44, region_id=RegionOne) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:15.865861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95657ae-9191-4ba5-9036-a0f7507e228c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:15.867268 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95657ae-9191-4ba5-9036-a0f7507e228c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:15.879080 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 394/779] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 08:03:15 2022] GET /identity/v3/endpoints?service_id=0455f5fcb68747ad8389f4b5194adb44&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:15.884621 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abec26d-f2b4-4fe3-9890-d14ffc43aae1 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:16.009466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:16.045588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abec26d-f2b4-4fe3-9890-d14ffc43aae1 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:16.090001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acf41f-e75c-4d6a-8f2e-d0cad5c1cdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:16.091102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acf41f-e75c-4d6a-8f2e-d0cad5c1cdde None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:16.091582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acf41f-e75c-4d6a-8f2e-d0cad5c1cdde None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:16.092075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acf41f-e75c-4d6a-8f2e-d0cad5c1cdde None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:16.092956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acf41f-e75c-4d6a-8f2e-d0cad5c1cdde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:16.094507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acf41f-e75c-4d6a-8f2e-d0cad5c1cdde None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:16.100319 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 386/780] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 08:03:15 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:16.670865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99101f7f-2595-4789-9228-63cf95a3e88a None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:16.671545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99101f7f-2595-4789-9228-63cf95a3e88a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:16.672045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99101f7f-2595-4789-9228-63cf95a3e88a None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:16.674240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 395/781] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:16.680021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0745312-61b2-4bb0-a29b-033c672aa25c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:16.680588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0745312-61b2-4bb0-a29b-033c672aa25c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:16.681176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0745312-61b2-4bb0-a29b-033c672aa25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:16.699031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d0745312-61b2-4bb0-a29b-033c672aa25c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:16.700510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d0745312-61b2-4bb0-a29b-033c672aa25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:16.775326 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 387/782] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:16.819943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99101f7f-2595-4789-9228-63cf95a3e88a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:16.948134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:16.954430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99101f7f-2595-4789-9228-63cf95a3e88a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:16.991119 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c9e4d-5c8d-4b3a-a541-29a5273c1db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:16.992264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c9e4d-5c8d-4b3a-a541-29a5273c1db2 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:16.993433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c9e4d-5c8d-4b3a-a541-29a5273c1db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:16.993985 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c9e4d-5c8d-4b3a-a541-29a5273c1db2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:17.004886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c9e4d-5c8d-4b3a-a541-29a5273c1db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-b42c9e4d-5c8d-4b3a-a541-29a5273c1db2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:17.013283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:17.014196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:17.015039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:17.015039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:17.015039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:17.015039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:17.015039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:17.015039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:17.015039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:17.015039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:17.015039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:17.015039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:17.015039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:17.015039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:17.017705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 396/783] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:17.024352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0745312-61b2-4bb0-a29b-033c672aa25c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:17.104451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:17.144715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0745312-61b2-4bb0-a29b-033c672aa25c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:17.186355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2145c7b-5705-49fd-a88a-d06cbfaadb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:17.187051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2145c7b-5705-49fd-a88a-d06cbfaadb8e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:17.187335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2145c7b-5705-49fd-a88a-d06cbfaadb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:17.187612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2145c7b-5705-49fd-a88a-d06cbfaadb8e None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:17.188503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2145c7b-5705-49fd-a88a-d06cbfaadb8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:17.188816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2145c7b-5705-49fd-a88a-d06cbfaadb8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:17.190192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2145c7b-5705-49fd-a88a-d06cbfaadb8e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:17.199587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 388/784] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:03:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:17.205123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c9e4d-5c8d-4b3a-a541-29a5273c1db2 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:17.332344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c9e4d-5c8d-4b3a-a541-29a5273c1db2 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:17.374330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64957-edbf-4298-9d70-a5b3a7b984d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:17.375205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64957-edbf-4298-9d70-a5b3a7b984d3 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:17.375489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64957-edbf-4298-9d70-a5b3a7b984d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:17.375768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64957-edbf-4298-9d70-a5b3a7b984d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:17.382489 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cbd39-3ac7-4d8c-9627-53ca771d8335 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:17.382817 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cbd39-3ac7-4d8c-9627-53ca771d8335 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:17.383811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cbd39-3ac7-4d8c-9627-53ca771d8335 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:17.385855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 389/785] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:17.392786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab64957-edbf-4298-9d70-a5b3a7b984d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:17.393473 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860a9a-e366-4dba-b098-a99323db99eb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:17.393768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860a9a-e366-4dba-b098-a99323db99eb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:17.394052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860a9a-e366-4dba-b098-a99323db99eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:17.394337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab64957-edbf-4298-9d70-a5b3a7b984d3 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:17.412059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e8860a9a-e366-4dba-b098-a99323db99eb None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-3ab64957-edbf-4298-9d70-a5b3a7b984d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:17.412856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:17.413730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:17.415299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:17.415299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:17.415299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:17.415299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:17.415532 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e8860a9a-e366-4dba-b098-a99323db99eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:17.415612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 397/786] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:17.415689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb159033-ebf7-4233-b472-8a4c23e330ea None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:17.416202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb159033-ebf7-4233-b472-8a4c23e330ea None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:17.416202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb159033-ebf7-4233-b472-8a4c23e330ea None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:17.422924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 398/787] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:17.425541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f2673-cb57-4961-b076-d5323a7baec4 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:17.425859 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f2673-cb57-4961-b076-d5323a7baec4 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:17.426104 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f2673-cb57-4961-b076-d5323a7baec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:17.451873 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-937f2673-cb57-4961-b076-d5323a7baec4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:17.454202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-937f2673-cb57-4961-b076-d5323a7baec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:17.463484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:17.492585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 390/788] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:17.493778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8860a9a-e366-4dba-b098-a99323db99eb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:17.547611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 399/789] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:17.554636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f2673-cb57-4961-b076-d5323a7baec4 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:17.581650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:17.636297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8860a9a-e366-4dba-b098-a99323db99eb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:17.682520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9267022-acd5-4241-a47d-baf53d93b920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:17.683511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9267022-acd5-4241-a47d-baf53d93b920 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:17.683966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9267022-acd5-4241-a47d-baf53d93b920 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:17.684434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9267022-acd5-4241-a47d-baf53d93b920 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:17.685328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9267022-acd5-4241-a47d-baf53d93b920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:17.685816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9267022-acd5-4241-a47d-baf53d93b920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:17.687406 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9267022-acd5-4241-a47d-baf53d93b920 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:17.687863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f2673-cb57-4961-b076-d5323a7baec4 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:17.704453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 391/790] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:17.705612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9267022-acd5-4241-a47d-baf53d93b920 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:17.729986 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d14f2-c03d-497a-8ab2-45b09359834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:17.730815 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d14f2-c03d-497a-8ab2-45b09359834a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:17.731129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d14f2-c03d-497a-8ab2-45b09359834a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:17.731857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d14f2-c03d-497a-8ab2-45b09359834a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:17.746775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d14f2-c03d-497a-8ab2-45b09359834a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-213d14f2-c03d-497a-8ab2-45b09359834a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:17.755602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:17.756521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:17.757371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 400/791] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:03:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:17.758094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d14f2-c03d-497a-8ab2-45b09359834a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:17.766087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:17.830962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9267022-acd5-4241-a47d-baf53d93b920 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:17.855868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:17.872899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbfece-2b44-4162-9614-2823c6db28bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:17.873862 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbfece-2b44-4162-9614-2823c6db28bd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:17.874223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbfece-2b44-4162-9614-2823c6db28bd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:17.874567 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbfece-2b44-4162-9614-2823c6db28bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:17.886724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbfece-2b44-4162-9614-2823c6db28bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-a1dbfece-2b44-4162-9614-2823c6db28bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:17.894971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:17.895900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:17.896727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:17.896727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:17.896727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:17.896727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:17.896727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:17.896727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:17.896727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:17.896727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:17.896727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:17.896727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:17.896727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:17.896727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:17.901781 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 392/792] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:17.902748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbfece-2b44-4162-9614-2823c6db28bd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:17.903834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d14f2-c03d-497a-8ab2-45b09359834a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:17.939242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31662738-a485-4d5f-b443-c9cb7ad35c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:17.940170 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662738-a485-4d5f-b443-c9cb7ad35c23 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:17.940519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662738-a485-4d5f-b443-c9cb7ad35c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:17.940861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662738-a485-4d5f-b443-c9cb7ad35c23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:17.949530 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31662738-a485-4d5f-b443-c9cb7ad35c23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:17.951154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31662738-a485-4d5f-b443-c9cb7ad35c23 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-31662738-a485-4d5f-b443-c9cb7ad35c23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:17.966384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:17.967385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:17.968317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:17.968317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:17.968317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:17.968317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:17.968317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:17.968317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:17.968317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:17.968317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:17.968317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:03:17.968317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:17.972528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 401/793] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 08:03:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:17.973273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31662738-a485-4d5f-b443-c9cb7ad35c23 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:18.030787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbfece-2b44-4162-9614-2823c6db28bd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:18.039893 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:18.067357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965eeb9-00d2-4116-bb4f-a13a2cb4250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:18.068419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965eeb9-00d2-4116-bb4f-a13a2cb4250b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:18.068704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965eeb9-00d2-4116-bb4f-a13a2cb4250b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:18.069124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965eeb9-00d2-4116-bb4f-a13a2cb4250b None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:18.069866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965eeb9-00d2-4116-bb4f-a13a2cb4250b None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:18.070178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965eeb9-00d2-4116-bb4f-a13a2cb4250b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:18.072087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965eeb9-00d2-4116-bb4f-a13a2cb4250b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:18.080322 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 393/794] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:03:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:18.080925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965eeb9-00d2-4116-bb4f-a13a2cb4250b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:18.084968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31662738-a485-4d5f-b443-c9cb7ad35c23 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:18.122932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3cca8-f79b-4abf-8e49-301cc4f3dc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:18.123953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3cca8-f79b-4abf-8e49-301cc4f3dc90 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:18.124248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3cca8-f79b-4abf-8e49-301cc4f3dc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:18.124533 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3cca8-f79b-4abf-8e49-301cc4f3dc90 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:18.125081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:18.125605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3cca8-f79b-4abf-8e49-301cc4f3dc90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:18.126097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3cca8-f79b-4abf-8e49-301cc4f3dc90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:18.127749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3cca8-f79b-4abf-8e49-301cc4f3dc90 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:18.137526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 402/795] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:03:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:18.138562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a08be-d338-492a-a9ab-2a734537a1a7 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:18.138897 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a08be-d338-492a-a9ab-2a734537a1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:18.139177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a08be-d338-492a-a9ab-2a734537a1a7 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:18.140522 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 403/796] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:18.145189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a08be-d338-492a-a9ab-2a734537a1a7 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:18.189678 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965eeb9-00d2-4116-bb4f-a13a2cb4250b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:18.223388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88e093-cdcb-45ec-bab1-0f4d30c6e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:18.224044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88e093-cdcb-45ec-bab1-0f4d30c6e676 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:18.224324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88e093-cdcb-45ec-bab1-0f4d30c6e676 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:18.224601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88e093-cdcb-45ec-bab1-0f4d30c6e676 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:18.225423 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88e093-cdcb-45ec-bab1-0f4d30c6e676 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:18.225729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88e093-cdcb-45ec-bab1-0f4d30c6e676 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:18.227698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88e093-cdcb-45ec-bab1-0f4d30c6e676 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:18.251190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 394/797] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 08:03:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:18.251190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88e093-cdcb-45ec-bab1-0f4d30c6e676 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:18.266782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a08be-d338-492a-a9ab-2a734537a1a7 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:18.292438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:18.307685 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc1f78-3124-4e5c-8a21-da9c70b988cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:18.309125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc1f78-3124-4e5c-8a21-da9c70b988cd None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:18.309474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc1f78-3124-4e5c-8a21-da9c70b988cd None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:18.309811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc1f78-3124-4e5c-8a21-da9c70b988cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:18.322012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc1f78-3124-4e5c-8a21-da9c70b988cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:18.323556 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc1f78-3124-4e5c-8a21-da9c70b988cd None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-68fc1f78-3124-4e5c-8a21-da9c70b988cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:18.341701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:18.342902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:18.344041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:18.344041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:18.344041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:18.344041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:18.349472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 404/798] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:18.350817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717d688-affc-4b79-bd71-aac27a5fae08 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:18.351169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717d688-affc-4b79-bd71-aac27a5fae08 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:18.351451 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717d688-affc-4b79-bd71-aac27a5fae08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:18.362058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:18.366073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88e093-cdcb-45ec-bab1-0f4d30c6e676 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:18.369733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-4717d688-affc-4b79-bd71-aac27a5fae08 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:18.370937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4717d688-affc-4b79-bd71-aac27a5fae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:18.403837 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8d9e4-747c-4a30-a9ef-3c243d4e47be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:18.404545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8d9e4-747c-4a30-a9ef-3c243d4e47be None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:18.404825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8d9e4-747c-4a30-a9ef-3c243d4e47be None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:18.405187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8d9e4-747c-4a30-a9ef-3c243d4e47be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:18.417277 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8d9e4-747c-4a30-a9ef-3c243d4e47be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:18.418745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8d9e4-747c-4a30-a9ef-3c243d4e47be None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b8a8d9e4-747c-4a30-a9ef-3c243d4e47be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:18.436579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:18.437665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:18.438777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:18.438777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:18.438777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:18.438777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:18.442487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 395/799] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:18.443354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8d9e4-747c-4a30-a9ef-3c243d4e47be None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:18.445302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 405/800] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:18.446485 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717d688-affc-4b79-bd71-aac27a5fae08 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:18.551190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8d9e4-747c-4a30-a9ef-3c243d4e47be None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:18.559472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717d688-affc-4b79-bd71-aac27a5fae08 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:18.567697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:18.593766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306efdd-2239-4ef8-889b-0d662abc04e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:18.594470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306efdd-2239-4ef8-889b-0d662abc04e8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:18.594788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306efdd-2239-4ef8-889b-0d662abc04e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:18.595073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306efdd-2239-4ef8-889b-0d662abc04e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:18.598211 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1dc8d-0b7c-49d7-8794-88518e4227aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:18.599042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1dc8d-0b7c-49d7-8794-88518e4227aa None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:18.599386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1dc8d-0b7c-49d7-8794-88518e4227aa None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:18.599723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1dc8d-0b7c-49d7-8794-88518e4227aa None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:18.600506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1dc8d-0b7c-49d7-8794-88518e4227aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:18.600884 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1dc8d-0b7c-49d7-8794-88518e4227aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:18.602548 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1dc8d-0b7c-49d7-8794-88518e4227aa None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:18.614552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 406/801] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:18.615434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1dc8d-0b7c-49d7-8794-88518e4227aa None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:18.624973 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:18.684834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306efdd-2239-4ef8-889b-0d662abc04e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:18.693331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306efdd-2239-4ef8-889b-0d662abc04e8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:18.741913 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1dc8d-0b7c-49d7-8794-88518e4227aa None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:18.778592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd84d4-d3a6-4a87-99f8-857372f2aae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:18.779285 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd84d4-d3a6-4a87-99f8-857372f2aae1 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:18.779564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd84d4-d3a6-4a87-99f8-857372f2aae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:18.779835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd84d4-d3a6-4a87-99f8-857372f2aae1 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:18.780567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd84d4-d3a6-4a87-99f8-857372f2aae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:18.780871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd84d4-d3a6-4a87-99f8-857372f2aae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:18.782272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd84d4-d3a6-4a87-99f8-857372f2aae1 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:18.796491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 407/802] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:18.797352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd84d4-d3a6-4a87-99f8-857372f2aae1 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:18.825773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:18.898882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd84d4-d3a6-4a87-99f8-857372f2aae1 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:18.904762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 396/803] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:03:18.905590 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306efdd-2239-4ef8-889b-0d662abc04e8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:18.934304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cbd06-0860-45d6-a5ae-8204a01541b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:18.935184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cbd06-0860-45d6-a5ae-8204a01541b5 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:18.935410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cbd06-0860-45d6-a5ae-8204a01541b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:18.935683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cbd06-0860-45d6-a5ae-8204a01541b5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:18.936323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cbd06-0860-45d6-a5ae-8204a01541b5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:18.937686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cbd06-0860-45d6-a5ae-8204a01541b5 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-8a9cbd06-0860-45d6-a5ae-8204a01541b5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:18.949513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:18.950437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:18.951289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 408/804] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Jun 21 08:03:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:18.952121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898e6a5-843c-4196-bce2-621b7c011f98 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:18.952374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898e6a5-843c-4196-bce2-621b7c011f98 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:18.952568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898e6a5-843c-4196-bce2-621b7c011f98 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:18.953813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 409/805] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:18.954490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898e6a5-843c-4196-bce2-621b7c011f98 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:18.962888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:19.012391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306efdd-2239-4ef8-889b-0d662abc04e8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:19.049500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cda846-4901-48d4-8574-93d8112a1a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:19.050296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cda846-4901-48d4-8574-93d8112a1a60 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.050570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cda846-4901-48d4-8574-93d8112a1a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.050870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cda846-4901-48d4-8574-93d8112a1a60 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.058570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cda846-4901-48d4-8574-93d8112a1a60 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:19.060040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cda846-4901-48d4-8574-93d8112a1a60 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:19.067796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f9cda846-4901-48d4-8574-93d8112a1a60 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:19.074855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:19.075854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:19.076789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:19.076789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:19.076789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:19.076789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:19.076789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:19.076789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:19.076789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:19.076789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:19.076789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 08:03:19.076789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:19.076789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 397/806] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 08:03:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:19.076789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cda846-4901-48d4-8574-93d8112a1a60 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:19.079787 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898e6a5-843c-4196-bce2-621b7c011f98 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:19.115177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b854-7cec-41a1-b225-fdd4476ecfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:19.115953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b854-7cec-41a1-b225-fdd4476ecfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.116231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b854-7cec-41a1-b225-fdd4476ecfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.116505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b854-7cec-41a1-b225-fdd4476ecfa4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.123995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26b854-7cec-41a1-b225-fdd4476ecfa4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:19.125413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26b854-7cec-41a1-b225-fdd4476ecfa4 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-ab26b854-7cec-41a1-b225-fdd4476ecfa4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:19.139012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:19.139950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:19.141264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:19.141264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:19.141264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:19.141264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:19.141264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:19.141264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:19.141264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:19.141264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:19.141264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 08:03:19.141264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:19.141264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 410/807] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:19.141264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b854-7cec-41a1-b225-fdd4476ecfa4 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:19.180977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cda846-4901-48d4-8574-93d8112a1a60 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:19.193178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:19.215089 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc0bce-8dd6-4063-b280-22999b45f620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:19.215865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc0bce-8dd6-4063-b280-22999b45f620 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.216144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc0bce-8dd6-4063-b280-22999b45f620 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.216415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc0bce-8dd6-4063-b280-22999b45f620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.227232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc0bce-8dd6-4063-b280-22999b45f620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:19.228660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc0bce-8dd6-4063-b280-22999b45f620 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:19.239910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b854-7cec-41a1-b225-fdd4476ecfa4 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-cefc0bce-8dd6-4063-b280-22999b45f620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:19.246231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:19.247351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:19.252913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:19.252913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:19.252913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:19.252913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:19.252913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 398/808] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:19.252913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ec584-efa7-4e6d-87fd-4997d2d05c7c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.252913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ec584-efa7-4e6d-87fd-4997d2d05c7c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.252913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ec584-efa7-4e6d-87fd-4997d2d05c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.265258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-377ec584-efa7-4e6d-87fd-4997d2d05c7c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:19.266425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-377ec584-efa7-4e6d-87fd-4997d2d05c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:19.281712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b05cd-c404-4625-8e25-c668e8352749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:19.282367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b05cd-c404-4625-8e25-c668e8352749 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.282674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b05cd-c404-4625-8e25-c668e8352749 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.282948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b05cd-c404-4625-8e25-c668e8352749 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.283653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b05cd-c404-4625-8e25-c668e8352749 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:19.283957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b05cd-c404-4625-8e25-c668e8352749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:19.285309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b05cd-c404-4625-8e25-c668e8352749 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:19.290537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 411/809] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 21 08:03:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:19.291336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b05cd-c404-4625-8e25-c668e8352749 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:19.306743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:19.336481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 399/810] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:19.337408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ec584-efa7-4e6d-87fd-4997d2d05c7c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:19.392939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b05cd-c404-4625-8e25-c668e8352749 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:19.427668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15ba6a-c758-4cad-b940-51a3a8a1fd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:19.428326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15ba6a-c758-4cad-b940-51a3a8a1fd87 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.428614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15ba6a-c758-4cad-b940-51a3a8a1fd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.428891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15ba6a-c758-4cad-b940-51a3a8a1fd87 None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.429816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15ba6a-c758-4cad-b940-51a3a8a1fd87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:19.430509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15ba6a-c758-4cad-b940-51a3a8a1fd87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:19.431743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:19.431989 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15ba6a-c758-4cad-b940-51a3a8a1fd87 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:19.439374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ec584-efa7-4e6d-87fd-4997d2d05c7c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:19.449632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 412/811] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 21 08:03:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:19.450378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15ba6a-c758-4cad-b940-51a3a8a1fd87 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:19.475472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1e90c-505a-4b2a-9da4-3f6eb6e3e7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:19.476128 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1e90c-505a-4b2a-9da4-3f6eb6e3e7bc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.476402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1e90c-505a-4b2a-9da4-3f6eb6e3e7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.476708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1e90c-505a-4b2a-9da4-3f6eb6e3e7bc None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.477584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1e90c-505a-4b2a-9da4-3f6eb6e3e7bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:19.477880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1e90c-505a-4b2a-9da4-3f6eb6e3e7bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:19.479329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1e90c-505a-4b2a-9da4-3f6eb6e3e7bc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:19.496352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 400/812] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 21 08:03:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:19.496951 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1e90c-505a-4b2a-9da4-3f6eb6e3e7bc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:19.523947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:19.553601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15ba6a-c758-4cad-b940-51a3a8a1fd87 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:19.587869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afcfb2-7372-4b98-ade6-77e1f3495274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:19.588530 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afcfb2-7372-4b98-ade6-77e1f3495274 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.588810 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afcfb2-7372-4b98-ade6-77e1f3495274 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.589084 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afcfb2-7372-4b98-ade6-77e1f3495274 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.589830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afcfb2-7372-4b98-ade6-77e1f3495274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:19.590134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afcfb2-7372-4b98-ade6-77e1f3495274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:19.591570 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afcfb2-7372-4b98-ade6-77e1f3495274 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:19.596531 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1e90c-505a-4b2a-9da4-3f6eb6e3e7bc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:19.603638 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 413/813] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:19.604438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afcfb2-7372-4b98-ade6-77e1f3495274 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:19.630852 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d3e51-d52a-47b5-910d-9a3125626891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:19.631506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3e51-d52a-47b5-910d-9a3125626891 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.631786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3e51-d52a-47b5-910d-9a3125626891 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.632059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3e51-d52a-47b5-910d-9a3125626891 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.633254 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d3e51-d52a-47b5-910d-9a3125626891 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:19.634085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d3e51-d52a-47b5-910d-9a3125626891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:19.635483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d3e51-d52a-47b5-910d-9a3125626891 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:19.644562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 401/814] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 21 08:03:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:19.644562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d3e51-d52a-47b5-910d-9a3125626891 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:19.659065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:19.707933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afcfb2-7372-4b98-ade6-77e1f3495274 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:19.736732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:19.740852 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d3e51-d52a-47b5-910d-9a3125626891 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:19.743066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149f731-3e67-4f2f-abf5-4fde2ce6fdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:19.743875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f731-3e67-4f2f-abf5-4fde2ce6fdeb None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.744154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f731-3e67-4f2f-abf5-4fde2ce6fdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.744598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f731-3e67-4f2f-abf5-4fde2ce6fdeb None admin] PATH_INFO: `/v3/services/network` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.745245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149f731-3e67-4f2f-abf5-4fde2ce6fdeb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:19.746588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149f731-3e67-4f2f-abf5-4fde2ce6fdeb None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-f149f731-3e67-4f2f-abf5-4fde2ce6fdeb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:19.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:19.759376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:19.760192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 414/815] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:19 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:19.761204 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149f731-3e67-4f2f-abf5-4fde2ce6fdeb None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:19.781938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231605a-db3e-455c-b0a9-f906884d03a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:19.783167 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231605a-db3e-455c-b0a9-f906884d03a3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.783458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231605a-db3e-455c-b0a9-f906884d03a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.783733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231605a-db3e-455c-b0a9-f906884d03a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.795273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231605a-db3e-455c-b0a9-f906884d03a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:19.796778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231605a-db3e-455c-b0a9-f906884d03a3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-6231605a-db3e-455c-b0a9-f906884d03a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:19.814877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:19.815775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:19.816671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:19.816671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:19.816671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:19.816671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:19.816671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 402/816] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:19.816943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231605a-db3e-455c-b0a9-f906884d03a3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:19.867532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149f731-3e67-4f2f-abf5-4fde2ce6fdeb None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:19.885480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:19.900953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f440cd0-6234-4f27-a201-75aea825c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:19.901738 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f440cd0-6234-4f27-a201-75aea825c5ab None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.902023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f440cd0-6234-4f27-a201-75aea825c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.902300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f440cd0-6234-4f27-a201-75aea825c5ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.912696 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f440cd0-6234-4f27-a201-75aea825c5ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:19.914742 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f440cd0-6234-4f27-a201-75aea825c5ab None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:19.919476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231605a-db3e-455c-b0a9-f906884d03a3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-1f440cd0-6234-4f27-a201-75aea825c5ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:19.931419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:19.932478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:19.933352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:19.933352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:19.933352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:19.933352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:19.933352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 415/817] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:19.933352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f440cd0-6234-4f27-a201-75aea825c5ab None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:19.954645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd8ae0-fc8a-4777-8b87-980e341d4890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:19.955639 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8ae0-fc8a-4777-8b87-980e341d4890 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:19.955925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8ae0-fc8a-4777-8b87-980e341d4890 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:19.956205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8ae0-fc8a-4777-8b87-980e341d4890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:19.963513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd8ae0-fc8a-4777-8b87-980e341d4890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:19.964889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd8ae0-fc8a-4777-8b87-980e341d4890 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-38cd8ae0-fc8a-4777-8b87-980e341d4890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:19.979119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:19.980073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:19.980942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:19.980942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:19.980942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:19.980942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:19.980942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:19.980942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:19.980942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:19.980942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:19.980942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 403/818] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:19.981419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd8ae0-fc8a-4777-8b87-980e341d4890 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:19.989045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:20.040729 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f440cd0-6234-4f27-a201-75aea825c5ab None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:20.074463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfb292-8729-4453-9071-ceeeedba937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:20.075245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfb292-8729-4453-9071-ceeeedba937f None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:20.075530 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfb292-8729-4453-9071-ceeeedba937f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:20.075818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfb292-8729-4453-9071-ceeeedba937f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:20.076555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfb292-8729-4453-9071-ceeeedba937f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:20.077918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfb292-8729-4453-9071-ceeeedba937f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:20.078783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd8ae0-fc8a-4777-8b87-980e341d4890 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:20.098367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 416/819] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 08:03:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:20.099422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfb292-8729-4453-9071-ceeeedba937f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:20.115607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:20.133905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd61e3e-533c-4e42-8a85-5000bb4b40be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:20.134748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61e3e-533c-4e42-8a85-5000bb4b40be None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:20.135083 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61e3e-533c-4e42-8a85-5000bb4b40be None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:20.135361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61e3e-533c-4e42-8a85-5000bb4b40be None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:20.136093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd61e3e-533c-4e42-8a85-5000bb4b40be None admin] RBAC: Adding query filter params (name=network) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:20.136402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd61e3e-533c-4e42-8a85-5000bb4b40be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:20.137834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd61e3e-533c-4e42-8a85-5000bb4b40be None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:20.142890 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 404/820] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:20.143745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd61e3e-533c-4e42-8a85-5000bb4b40be None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:20.225461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfb292-8729-4453-9071-ceeeedba937f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:20.228561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:20.258235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd61e3e-533c-4e42-8a85-5000bb4b40be None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:20.268816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac122e-d55d-4777-837b-92cfc8c2f9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:20.269484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac122e-d55d-4777-837b-92cfc8c2f9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:20.269767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac122e-d55d-4777-837b-92cfc8c2f9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:20.270044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac122e-d55d-4777-837b-92cfc8c2f9c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:20.270848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac122e-d55d-4777-837b-92cfc8c2f9c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:20.271153 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac122e-d55d-4777-837b-92cfc8c2f9c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:20.272536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac122e-d55d-4777-837b-92cfc8c2f9c9 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:20.285372 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 417/821] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:20.286217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac122e-d55d-4777-837b-92cfc8c2f9c9 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:20.300732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f3490-d7fa-475c-8576-f84ff5274844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:20.301401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3490-d7fa-475c-8576-f84ff5274844 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:20.301685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3490-d7fa-475c-8576-f84ff5274844 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:20.301965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f3490-d7fa-475c-8576-f84ff5274844 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:20.302755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f3490-d7fa-475c-8576-f84ff5274844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:20.303065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f3490-d7fa-475c-8576-f84ff5274844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:20.304439 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f3490-d7fa-475c-8576-f84ff5274844 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:20.317398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 405/822] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:20.318303 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f3490-d7fa-475c-8576-f84ff5274844 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:20.372177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:20.430354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f3490-d7fa-475c-8576-f84ff5274844 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:20.470278 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b80432-cd20-445b-9114-e8a518b3a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:20.470981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b80432-cd20-445b-9114-e8a518b3a36c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:20.471263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b80432-cd20-445b-9114-e8a518b3a36c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:20.471539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b80432-cd20-445b-9114-e8a518b3a36c None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:20.472262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b80432-cd20-445b-9114-e8a518b3a36c None admin] RBAC: Adding query filter params (type=network) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:20.472569 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b80432-cd20-445b-9114-e8a518b3a36c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:20.473989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b80432-cd20-445b-9114-e8a518b3a36c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:20.485143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 406/823] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:20.485143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b80432-cd20-445b-9114-e8a518b3a36c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:20.528746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac122e-d55d-4777-837b-92cfc8c2f9c9 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:20.573153 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fc009-3760-448c-b8a8-4be770e28991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:20.574129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fc009-3760-448c-b8a8-4be770e28991 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:20.574129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fc009-3760-448c-b8a8-4be770e28991 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:20.574404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fc009-3760-448c-b8a8-4be770e28991 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:20.575172 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fc009-3760-448c-b8a8-4be770e28991 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:20.575480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fc009-3760-448c-b8a8-4be770e28991 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:20.576938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fc009-3760-448c-b8a8-4be770e28991 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:20.591319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 418/824] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:20.592149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fc009-3760-448c-b8a8-4be770e28991 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:20.603872 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b80432-cd20-445b-9114-e8a518b3a36c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:20.620450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:20.621000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:20.643796 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6897f-a8c5-4170-81b0-7b8c883043f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:20.645044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6897f-a8c5-4170-81b0-7b8c883043f3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:20.645551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6897f-a8c5-4170-81b0-7b8c883043f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:20.646029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6897f-a8c5-4170-81b0-7b8c883043f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:20.654169 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6897f-a8c5-4170-81b0-7b8c883043f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:20.655989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6897f-a8c5-4170-81b0-7b8c883043f3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e9c6897f-a8c5-4170-81b0-7b8c883043f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:20.671301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:20.672166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:20.673139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:20.673139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:20.673139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:20.673139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:20.673139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:20.673139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:20.673139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:20.673139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:20.680287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 407/825] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:20.681319 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6897f-a8c5-4170-81b0-7b8c883043f3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:20.704798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fc009-3760-448c-b8a8-4be770e28991 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:20.740712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b10754-6555-4031-98a0-44ddb6c8f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:20.741549 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b10754-6555-4031-98a0-44ddb6c8f646 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:20.741827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b10754-6555-4031-98a0-44ddb6c8f646 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:20.742580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b10754-6555-4031-98a0-44ddb6c8f646 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:20.749662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b10754-6555-4031-98a0-44ddb6c8f646 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:20.751126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b10754-6555-4031-98a0-44ddb6c8f646 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-08b10754-6555-4031-98a0-44ddb6c8f646 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:20.765559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:20.766439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:20.768480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:20.768480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:20.768480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:20.768480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:20.768480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:20.768480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:20.768480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:20.768480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:20.768480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 419/826] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:20.768480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b10754-6555-4031-98a0-44ddb6c8f646 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:20.798227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6897f-a8c5-4170-81b0-7b8c883043f3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:20.832794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981dfe5-a0a8-4711-8c35-b58d358484e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:20.833448 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981dfe5-a0a8-4711-8c35-b58d358484e5 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:20.833731 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981dfe5-a0a8-4711-8c35-b58d358484e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:20.834011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981dfe5-a0a8-4711-8c35-b58d358484e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:20.834791 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981dfe5-a0a8-4711-8c35-b58d358484e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:20.836754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981dfe5-a0a8-4711-8c35-b58d358484e5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:20.857177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 408/827] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 08:03:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:20.858152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981dfe5-a0a8-4711-8c35-b58d358484e5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:20.884077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:20.897373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:20.901255 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b10754-6555-4031-98a0-44ddb6c8f646 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:20.965016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847d5dc-eaa3-4166-b213-3ab0bcfbb5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:20.966018 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847d5dc-eaa3-4166-b213-3ab0bcfbb5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:20.966513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847d5dc-eaa3-4166-b213-3ab0bcfbb5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:20.967526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847d5dc-eaa3-4166-b213-3ab0bcfbb5b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:20.969051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847d5dc-eaa3-4166-b213-3ab0bcfbb5b6 None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=c0956402a9bb4a9384111b36d5251749) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:20.969857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847d5dc-eaa3-4166-b213-3ab0bcfbb5b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:20.971939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847d5dc-eaa3-4166-b213-3ab0bcfbb5b6 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:20.981943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 420/828] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:20 2022] GET /identity/v3/role_assignments?user.id=c0956402a9bb4a9384111b36d5251749&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=6fcc322b483a475399974562c1e5bd43 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:20.983242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847d5dc-eaa3-4166-b213-3ab0bcfbb5b6 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:21.015122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981dfe5-a0a8-4711-8c35-b58d358484e5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:21.060207 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d76c52-928f-4ecf-aef3-cd8ce8854870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:21.061246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76c52-928f-4ecf-aef3-cd8ce8854870 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:21.061835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76c52-928f-4ecf-aef3-cd8ce8854870 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:21.062313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76c52-928f-4ecf-aef3-cd8ce8854870 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:21.063360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d76c52-928f-4ecf-aef3-cd8ce8854870 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:21.063833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d76c52-928f-4ecf-aef3-cd8ce8854870 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:21.065305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d76c52-928f-4ecf-aef3-cd8ce8854870 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:21.084141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 409/829] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:21.086661 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d76c52-928f-4ecf-aef3-cd8ce8854870 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:21.129041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847d5dc-eaa3-4166-b213-3ab0bcfbb5b6 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:21.183954 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f9cf2-906a-4aa0-a8ca-7651f276959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:21.185225 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f9cf2-906a-4aa0-a8ca-7651f276959d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:21.185798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f9cf2-906a-4aa0-a8ca-7651f276959d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:21.186273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f9cf2-906a-4aa0-a8ca-7651f276959d None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:21.187993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f9cf2-906a-4aa0-a8ca-7651f276959d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:21.188683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f9cf2-906a-4aa0-a8ca-7651f276959d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:21.190907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f9cf2-906a-4aa0-a8ca-7651f276959d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:21.193554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:21.208722 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 421/830] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:21.211652 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d76c52-928f-4ecf-aef3-cd8ce8854870 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:21.213799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f9cf2-906a-4aa0-a8ca-7651f276959d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:21.217645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:21.265476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e8c29-ba3e-46cd-9244-b6a738fa8816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:21.266383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e8c29-ba3e-46cd-9244-b6a738fa8816 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:21.266766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e8c29-ba3e-46cd-9244-b6a738fa8816 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:21.267048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e8c29-ba3e-46cd-9244-b6a738fa8816 None admin] PATH_INFO: `/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/89cb97f51e6b4568a09e83cfbdf9e8c6/roles/daddec68ba304943b424e61611634a1d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:21.286887 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e8c29-ba3e-46cd-9244-b6a738fa8816 None admin] RBAC: Authorizing `identity:create_grant(project_id=c279ceb26daa45ba821e6ffb1db4f4f0, user_id=89cb97f51e6b4568a09e83cfbdf9e8c6, role_id=daddec68ba304943b424e61611634a1d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:21.289934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e8c29-ba3e-46cd-9244-b6a738fa8816 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:21.315006 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 410/831] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:03:21 2022] PUT /identity/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/89cb97f51e6b4568a09e83cfbdf9e8c6/roles/daddec68ba304943b424e61611634a1d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:03:21.354027 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f9cf2-906a-4aa0-a8ca-7651f276959d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:21.405385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48d5bb-5a58-4634-87fd-4b886bdae4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:21.406640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48d5bb-5a58-4634-87fd-4b886bdae4a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:21.407102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48d5bb-5a58-4634-87fd-4b886bdae4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:21.407531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48d5bb-5a58-4634-87fd-4b886bdae4a8 None admin] PATH_INFO: `/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/a0c29a6bfcf44b47ae368f47fdd04643/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:21.409823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48d5bb-5a58-4634-87fd-4b886bdae4a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c279ceb26daa45ba821e6ffb1db4f4f0, user_id=a0c29a6bfcf44b47ae368f47fdd04643, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:21.411480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48d5bb-5a58-4634-87fd-4b886bdae4a8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:21.432696 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 422/832] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:03:21 2022] PUT /identity/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/a0c29a6bfcf44b47ae368f47fdd04643/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:03:22.207754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993de0e6-7c63-40ad-8792-1f054d2a3020 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:22.208280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993de0e6-7c63-40ad-8792-1f054d2a3020 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:22.208280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993de0e6-7c63-40ad-8792-1f054d2a3020 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:22.209888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 411/833] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:22.216065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d76be5-96a7-4f1d-87a8-f2889fd8fca3 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:22.216487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d76be5-96a7-4f1d-87a8-f2889fd8fca3 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:22.216675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d76be5-96a7-4f1d-87a8-f2889fd8fca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:22.234741 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-81d76be5-96a7-4f1d-87a8-f2889fd8fca3 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:22.235931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-81d76be5-96a7-4f1d-87a8-f2889fd8fca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:22.299813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:22.309688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 423/834] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:22.334899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993de0e6-7c63-40ad-8792-1f054d2a3020 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:22.449445 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993de0e6-7c63-40ad-8792-1f054d2a3020 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:22.488190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe573567-953a-417c-97a2-698ef1a34854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:22.489496 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe573567-953a-417c-97a2-698ef1a34854 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:22.489938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe573567-953a-417c-97a2-698ef1a34854 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:22.490353 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe573567-953a-417c-97a2-698ef1a34854 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:22.491176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe573567-953a-417c-97a2-698ef1a34854 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:22.493251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe573567-953a-417c-97a2-698ef1a34854 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-fe573567-953a-417c-97a2-698ef1a34854 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:22.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:22.506650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 08:03:22.508636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:22.511025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 412/835] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:03:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:22.518754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d76be5-96a7-4f1d-87a8-f2889fd8fca3 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:22.621674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d76be5-96a7-4f1d-87a8-f2889fd8fca3 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:22.658800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87aa57-7dfe-433f-b780-abbb1f857a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:22.659812 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87aa57-7dfe-433f-b780-abbb1f857a38 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:22.660308 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87aa57-7dfe-433f-b780-abbb1f857a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:22.660791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87aa57-7dfe-433f-b780-abbb1f857a38 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:22.661686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87aa57-7dfe-433f-b780-abbb1f857a38 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:22.662183 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87aa57-7dfe-433f-b780-abbb1f857a38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:22.663767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87aa57-7dfe-433f-b780-abbb1f857a38 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:22.669348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 424/836] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:03:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:22.675891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe573567-953a-417c-97a2-698ef1a34854 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:22.681406 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:22.787916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe573567-953a-417c-97a2-698ef1a34854 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:22.823263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ed584-97e1-4b20-8da3-24cf28cc884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:22.823972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ed584-97e1-4b20-8da3-24cf28cc884b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:22.824258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ed584-97e1-4b20-8da3-24cf28cc884b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:22.824580 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ed584-97e1-4b20-8da3-24cf28cc884b None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:22.825335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ed584-97e1-4b20-8da3-24cf28cc884b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:22.825642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ed584-97e1-4b20-8da3-24cf28cc884b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:22.827034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ed584-97e1-4b20-8da3-24cf28cc884b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:22.832222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 413/837] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:03:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:23.228665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a85a0-90b2-430e-8f5b-4fbf9026c692 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:23.229181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a85a0-90b2-430e-8f5b-4fbf9026c692 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:23.229258 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a85a0-90b2-430e-8f5b-4fbf9026c692 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:23.230869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 425/838] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:23.236094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e591d-b351-4a59-9fe0-2777130ac212 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:23.236510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e591d-b351-4a59-9fe0-2777130ac212 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:23.236679 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e591d-b351-4a59-9fe0-2777130ac212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:23.254713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6f0e591d-b351-4a59-9fe0-2777130ac212 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:23.255905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6f0e591d-b351-4a59-9fe0-2777130ac212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:23.317670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:23.326479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 414/839] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:23.348751 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a85a0-90b2-430e-8f5b-4fbf9026c692 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:23.410684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:23.420029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f5ad9-654f-48a1-87aa-40d262db86c8 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:23.420321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f5ad9-654f-48a1-87aa-40d262db86c8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:23.420601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f5ad9-654f-48a1-87aa-40d262db86c8 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:23.422137 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 415/840] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:03:23.427575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a41e11-926d-4cd3-86e3-76386f38fc8a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:23.428083 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a41e11-926d-4cd3-86e3-76386f38fc8a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:23.428561 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a41e11-926d-4cd3-86e3-76386f38fc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:23.448461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-58a41e11-926d-4cd3-86e3-76386f38fc8a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:23.450101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-58a41e11-926d-4cd3-86e3-76386f38fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:23.458048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a85a0-90b2-430e-8f5b-4fbf9026c692 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:23.504203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbc528-0d21-43aa-b32d-785ee32f2a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:23.505343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc528-0d21-43aa-b32d-785ee32f2a80 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:23.505830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc528-0d21-43aa-b32d-785ee32f2a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:23.506322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc528-0d21-43aa-b32d-785ee32f2a80 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:23.507240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbc528-0d21-43aa-b32d-785ee32f2a80 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:23.508972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbc528-0d21-43aa-b32d-785ee32f2a80 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-58bbc528-0d21-43aa-b32d-785ee32f2a80 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:23.522363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:23.523567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 08:03:23.524568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:23.527549 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 426/841] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Jun 21 08:03:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:23.534666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbc528-0d21-43aa-b32d-785ee32f2a80 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:23.540549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 416/842] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:23.564636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a41e11-926d-4cd3-86e3-76386f38fc8a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:23.646727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbc528-0d21-43aa-b32d-785ee32f2a80 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:23.671017 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:23.684664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1ac65-0de8-4331-a3f7-7deee2044a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:23.685489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1ac65-0de8-4331-a3f7-7deee2044a35 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:23.686067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1ac65-0de8-4331-a3f7-7deee2044a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:23.686363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1ac65-0de8-4331-a3f7-7deee2044a35 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:23.687120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1ac65-0de8-4331-a3f7-7deee2044a35 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:23.687429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1ac65-0de8-4331-a3f7-7deee2044a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:23.688797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1ac65-0de8-4331-a3f7-7deee2044a35 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:23.693283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 427/843] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 08:03:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:23.694460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b8485-1ad8-447b-b4f5-13b3ac4f279a None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:23.694794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b8485-1ad8-447b-b4f5-13b3ac4f279a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:23.695115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b8485-1ad8-447b-b4f5-13b3ac4f279a None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:23.695594 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a41e11-926d-4cd3-86e3-76386f38fc8a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:23.700196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 428/844] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:23.700196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b8485-1ad8-447b-b4f5-13b3ac4f279a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:23.726142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:23.736577 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eddb46-08bc-4c7b-9b78-ae18d15c74bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:23.737363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eddb46-08bc-4c7b-9b78-ae18d15c74bb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:23.737646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eddb46-08bc-4c7b-9b78-ae18d15c74bb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:23.737921 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eddb46-08bc-4c7b-9b78-ae18d15c74bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:23.748858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eddb46-08bc-4c7b-9b78-ae18d15c74bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-56eddb46-08bc-4c7b-9b78-ae18d15c74bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:23.756574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:23.757501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 417/845] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:03:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:23.763351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f7f0d-fc74-447d-8a8a-caeb1b105a75 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:23.764112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f7f0d-fc74-447d-8a8a-caeb1b105a75 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:23.764112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f7f0d-fc74-447d-8a8a-caeb1b105a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:23.777549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-548f7f0d-fc74-447d-8a8a-caeb1b105a75 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:23.778870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-548f7f0d-fc74-447d-8a8a-caeb1b105a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:23.821856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b8485-1ad8-447b-b4f5-13b3ac4f279a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:23.850218 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 418/846] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:23.852084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f7f0d-fc74-447d-8a8a-caeb1b105a75 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:23.872516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124ec56-2a8a-489b-992d-a92c2ade1cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:23.873519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124ec56-2a8a-489b-992d-a92c2ade1cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:23.874013 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124ec56-2a8a-489b-992d-a92c2ade1cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:23.874467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124ec56-2a8a-489b-992d-a92c2ade1cf2 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:23.875648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124ec56-2a8a-489b-992d-a92c2ade1cf2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:23.875967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124ec56-2a8a-489b-992d-a92c2ade1cf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:23.877343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124ec56-2a8a-489b-992d-a92c2ade1cf2 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:23.881995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 429/847] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 08:03:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:23.882962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124ec56-2a8a-489b-992d-a92c2ade1cf2 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:23.941417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:23.984307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f7f0d-fc74-447d-8a8a-caeb1b105a75 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:24.000953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124ec56-2a8a-489b-992d-a92c2ade1cf2 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:24.006468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:24.031864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dc0d4-40b9-4afd-8ec0-a24309e72428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:24.033040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dc0d4-40b9-4afd-8ec0-a24309e72428 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:24.033532 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dc0d4-40b9-4afd-8ec0-a24309e72428 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:24.034010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dc0d4-40b9-4afd-8ec0-a24309e72428 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:24.035033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dc0d4-40b9-4afd-8ec0-a24309e72428 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:24.035659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dc0d4-40b9-4afd-8ec0-a24309e72428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:24.037383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dc0d4-40b9-4afd-8ec0-a24309e72428 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:24.042764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d341-4dfc-4125-a539-cc7bba70858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:24.043573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d341-4dfc-4125-a539-cc7bba70858d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:24.043854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d341-4dfc-4125-a539-cc7bba70858d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:24.044129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d341-4dfc-4125-a539-cc7bba70858d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:24.048617 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 419/848] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:03:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:24.054408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dc0d4-40b9-4afd-8ec0-a24309e72428 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:24.056371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6d341-4dfc-4125-a539-cc7bba70858d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-22f6d341-4dfc-4125-a539-cc7bba70858d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:24.064663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:24.065591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:24.066434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 430/849] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:24.073948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d341-4dfc-4125-a539-cc7bba70858d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:24.177972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dc0d4-40b9-4afd-8ec0-a24309e72428 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:24.185696 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d341-4dfc-4125-a539-cc7bba70858d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:24.197315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:24.218036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437798-0768-4e0f-9d46-c56d38736713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:24.219309 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437798-0768-4e0f-9d46-c56d38736713 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:24.219823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437798-0768-4e0f-9d46-c56d38736713 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:24.220407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31437798-0768-4e0f-9d46-c56d38736713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:24.221843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d24a3-e0bf-403b-9538-e06d93e2609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:24.222513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d24a3-e0bf-403b-9538-e06d93e2609c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:24.222824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d24a3-e0bf-403b-9538-e06d93e2609c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:24.223099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d24a3-e0bf-403b-9538-e06d93e2609c None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:24.223904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d24a3-e0bf-403b-9538-e06d93e2609c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:24.224212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d24a3-e0bf-403b-9538-e06d93e2609c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:24.225575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d24a3-e0bf-403b-9538-e06d93e2609c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:24.234592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31437798-0768-4e0f-9d46-c56d38736713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:24.236016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 431/850] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:03:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:24.236964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31437798-0768-4e0f-9d46-c56d38736713 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:24.241436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d24a3-e0bf-403b-9538-e06d93e2609c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-31437798-0768-4e0f-9d46-c56d38736713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:24.256790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:24.257757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:24.259323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:24.259323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:24.259323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:24.259323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:24.262910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 420/851] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:24.264140 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437798-0768-4e0f-9d46-c56d38736713 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:24.297703 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:24.357038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d24a3-e0bf-403b-9538-e06d93e2609c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:24.376633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31437798-0768-4e0f-9d46-c56d38736713 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:24.395092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d5e54-cc43-48e4-b2dd-d60a5d5db546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:24.396246 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d5e54-cc43-48e4-b2dd-d60a5d5db546 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:24.396727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d5e54-cc43-48e4-b2dd-d60a5d5db546 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:24.397200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d5e54-cc43-48e4-b2dd-d60a5d5db546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:24.409552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d5e54-cc43-48e4-b2dd-d60a5d5db546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:24.411644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d5e54-cc43-48e4-b2dd-d60a5d5db546 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:24.413432 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc093c3-482d-48c0-91d6-e9cbafb614ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:24.414398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc093c3-482d-48c0-91d6-e9cbafb614ec None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:24.414878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc093c3-482d-48c0-91d6-e9cbafb614ec None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:24.414956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc093c3-482d-48c0-91d6-e9cbafb614ec None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:24.416106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc093c3-482d-48c0-91d6-e9cbafb614ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:24.416231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc093c3-482d-48c0-91d6-e9cbafb614ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:24.417615 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc093c3-482d-48c0-91d6-e9cbafb614ec None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-358d5e54-cc43-48e4-b2dd-d60a5d5db546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:24.432861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:24.433863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:24.434765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:24.434765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:24.434765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:24.434765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:24.435420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 421/852] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:24.436128 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc093c3-482d-48c0-91d6-e9cbafb614ec None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:24.437220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 432/853] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:24.442648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d5e54-cc43-48e4-b2dd-d60a5d5db546 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:24.472400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:24.542429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:24.553962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc093c3-482d-48c0-91d6-e9cbafb614ec None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:24.562532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d5e54-cc43-48e4-b2dd-d60a5d5db546 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:24.596144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1690fad-f954-472b-8659-1c2d272a116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:24.597056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1690fad-f954-472b-8659-1c2d272a116f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:24.597340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1690fad-f954-472b-8659-1c2d272a116f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:24.597613 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1690fad-f954-472b-8659-1c2d272a116f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:24.602900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca211e-7523-4657-bb0a-b8aa016af5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:24.603678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca211e-7523-4657-bb0a-b8aa016af5ea None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:24.604063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca211e-7523-4657-bb0a-b8aa016af5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:24.604439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca211e-7523-4657-bb0a-b8aa016af5ea None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:24.605274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca211e-7523-4657-bb0a-b8aa016af5ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:24.605680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca211e-7523-4657-bb0a-b8aa016af5ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:24.606544 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1690fad-f954-472b-8659-1c2d272a116f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:24.607266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca211e-7523-4657-bb0a-b8aa016af5ea None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:24.608017 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1690fad-f954-472b-8659-1c2d272a116f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:24.622134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 433/854] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f1690fad-f954-472b-8659-1c2d272a116f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:24.624715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:24.625660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:24.626599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:24.626599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:24.626599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:24.626599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:24.626599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:24.626599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:24.626599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:24.626599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:24.626599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 08:03:24.626599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:24.630480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 422/855] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 08:03:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:24.631279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca211e-7523-4657-bb0a-b8aa016af5ea None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:24.631456 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1690fad-f954-472b-8659-1c2d272a116f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:24.723871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:24.740921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca211e-7523-4657-bb0a-b8aa016af5ea None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:24.744851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1690fad-f954-472b-8659-1c2d272a116f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:24.776847 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cb842-1f9f-44af-b413-0487cf3c58e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:24.777634 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cb842-1f9f-44af-b413-0487cf3c58e6 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:24.777921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cb842-1f9f-44af-b413-0487cf3c58e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:24.778188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cb842-1f9f-44af-b413-0487cf3c58e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:24.782663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba92b7-4703-40f8-a06e-8b1a88e14337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:24.783542 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba92b7-4703-40f8-a06e-8b1a88e14337 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:24.784014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba92b7-4703-40f8-a06e-8b1a88e14337 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:24.784465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba92b7-4703-40f8-a06e-8b1a88e14337 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:24.785488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba92b7-4703-40f8-a06e-8b1a88e14337 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:24.785726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6cb842-1f9f-44af-b413-0487cf3c58e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:24.786169 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba92b7-4703-40f8-a06e-8b1a88e14337 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:24.787215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6cb842-1f9f-44af-b413-0487cf3c58e6 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:24.788022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba92b7-4703-40f8-a06e-8b1a88e14337 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-7e6cb842-1f9f-44af-b413-0487cf3c58e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:24.809312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:24.810283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:24.811238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:24.811238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:24.811238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:24.811238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:24.811238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:24.811238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:24.811238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:24.811238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:24.811238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 08:03:24.811238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:24.811238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 434/856] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:24.819604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cb842-1f9f-44af-b413-0487cf3c58e6 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:24.819904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 423/857] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 21 08:03:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:24.821641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba92b7-4703-40f8-a06e-8b1a88e14337 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:24.833110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:24.938349 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba92b7-4703-40f8-a06e-8b1a88e14337 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:24.952153 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cb842-1f9f-44af-b413-0487cf3c58e6 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:24.974824 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a750c02-2d4d-4a5f-bf72-f07a9b6c69a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:24.975680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a750c02-2d4d-4a5f-bf72-f07a9b6c69a9 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:24.975964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a750c02-2d4d-4a5f-bf72-f07a9b6c69a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:24.976776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a750c02-2d4d-4a5f-bf72-f07a9b6c69a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:24.988670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd97456-2a77-48af-8bb0-ef07b018d06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:24.989582 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd97456-2a77-48af-8bb0-ef07b018d06e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:24.989864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd97456-2a77-48af-8bb0-ef07b018d06e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:24.990143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd97456-2a77-48af-8bb0-ef07b018d06e None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:24.991010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd97456-2a77-48af-8bb0-ef07b018d06e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:24.991376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd97456-2a77-48af-8bb0-ef07b018d06e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:24.993485 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd97456-2a77-48af-8bb0-ef07b018d06e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:25.014853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 435/858] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 21 08:03:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:25.016248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ccb6b-ae31-4c2b-87ba-9107440d1f2a None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:25.016539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ccb6b-ae31-4c2b-87ba-9107440d1f2a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:25.016815 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ccb6b-ae31-4c2b-87ba-9107440d1f2a None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:25.021861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 436/859] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:25.021861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ccb6b-ae31-4c2b-87ba-9107440d1f2a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:25.024836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:25.051949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a750c02-2d4d-4a5f-bf72-f07a9b6c69a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:25.053487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a750c02-2d4d-4a5f-bf72-f07a9b6c69a9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:25.063845 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:25.146928 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ccb6b-ae31-4c2b-87ba-9107440d1f2a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:25.172315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 424/860] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:03:25.173586 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd33ce7-be8f-4fc4-9d08-ed5fecb10f1d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:25.173876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd33ce7-be8f-4fc4-9d08-ed5fecb10f1d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:25.174159 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd33ce7-be8f-4fc4-9d08-ed5fecb10f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:25.184183 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09be915-97c7-4670-9adc-416ffb674b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:25.185033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09be915-97c7-4670-9adc-416ffb674b4c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:25.185310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09be915-97c7-4670-9adc-416ffb674b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:25.185581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09be915-97c7-4670-9adc-416ffb674b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:25.192538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1bd33ce7-be8f-4fc4-9d08-ed5fecb10f1d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:25.194121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1bd33ce7-be8f-4fc4-9d08-ed5fecb10f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:25.259545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09be915-97c7-4670-9adc-416ffb674b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:25.260991 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09be915-97c7-4670-9adc-416ffb674b4c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:25.262847 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:25.275064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 425/861] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:25.275939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd33ce7-be8f-4fc4-9d08-ed5fecb10f1d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:25.321344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:25.375478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 437/862] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:25 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:03:25.376302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09be915-97c7-4670-9adc-416ffb674b4c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:25.392214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd33ce7-be8f-4fc4-9d08-ed5fecb10f1d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:25.430322 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e21481-55a4-4d9a-94d8-79a109ba91bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:25.431665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e21481-55a4-4d9a-94d8-79a109ba91bd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:25.432168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e21481-55a4-4d9a-94d8-79a109ba91bd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:25.432636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e21481-55a4-4d9a-94d8-79a109ba91bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:25.444074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e21481-55a4-4d9a-94d8-79a109ba91bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:25.446419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e21481-55a4-4d9a-94d8-79a109ba91bd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-24e21481-55a4-4d9a-94d8-79a109ba91bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:25.475626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:25.476686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:25.482794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:25.482794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:25.482794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:25.482794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:25.482794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 426/863] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:25.482794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e21481-55a4-4d9a-94d8-79a109ba91bd None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:25.489765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09be915-97c7-4670-9adc-416ffb674b4c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:25.491356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:25.528613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25266222-7164-40ce-9e52-8cb481e718bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:25.529267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266222-7164-40ce-9e52-8cb481e718bf None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:25.529547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266222-7164-40ce-9e52-8cb481e718bf None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:25.529820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266222-7164-40ce-9e52-8cb481e718bf None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:25.530531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25266222-7164-40ce-9e52-8cb481e718bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:25.531995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25266222-7164-40ce-9e52-8cb481e718bf None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:25.550786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 438/864] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:03:25 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:25.551706 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25266222-7164-40ce-9e52-8cb481e718bf None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:25.609365 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:25.624719 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e21481-55a4-4d9a-94d8-79a109ba91bd None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:25.682998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25266222-7164-40ce-9e52-8cb481e718bf None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:25.690391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c02c4b-ae75-4319-aedb-0cff15844945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:25.692271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02c4b-ae75-4319-aedb-0cff15844945 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:25.692783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02c4b-ae75-4319-aedb-0cff15844945 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:25.693795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02c4b-ae75-4319-aedb-0cff15844945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:25.710301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c02c4b-ae75-4319-aedb-0cff15844945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:25.713536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c02c4b-ae75-4319-aedb-0cff15844945 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:25.722529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2d6b2-0ff7-4b2a-b816-d34a032754fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:25.723237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2d6b2-0ff7-4b2a-b816-d34a032754fe None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:25.723519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2d6b2-0ff7-4b2a-b816-d34a032754fe None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:25.723792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2d6b2-0ff7-4b2a-b816-d34a032754fe None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:25.725316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2d6b2-0ff7-4b2a-b816-d34a032754fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:25.725622 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2d6b2-0ff7-4b2a-b816-d34a032754fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:25.727079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2d6b2-0ff7-4b2a-b816-d34a032754fe None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-88c02c4b-ae75-4319-aedb-0cff15844945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:25.738601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:25.739813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:25.740715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:25.740715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:25.740715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:25.740715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:25.740944 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 439/865] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:25.743159 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 427/866] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:25.746360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2d6b2-0ff7-4b2a-b816-d34a032754fe None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:25.749126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c02c4b-ae75-4319-aedb-0cff15844945 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:25.768376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:25.862127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2d6b2-0ff7-4b2a-b816-d34a032754fe None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:25.871936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c02c4b-ae75-4319-aedb-0cff15844945 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:25.901055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd826805-cef9-404e-8c90-87b196b35301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:25.902399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd826805-cef9-404e-8c90-87b196b35301 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:25.902963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd826805-cef9-404e-8c90-87b196b35301 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:25.903341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd826805-cef9-404e-8c90-87b196b35301 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:25.911029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd826805-cef9-404e-8c90-87b196b35301 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:25.912787 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd826805-cef9-404e-8c90-87b196b35301 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:25.914972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294303e5-7a53-4bb7-b520-f033a72aa84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:25.916255 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294303e5-7a53-4bb7-b520-f033a72aa84b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:25.916727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294303e5-7a53-4bb7-b520-f033a72aa84b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:25.917534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294303e5-7a53-4bb7-b520-f033a72aa84b None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:25.918518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294303e5-7a53-4bb7-b520-f033a72aa84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:25.918979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294303e5-7a53-4bb7-b520-f033a72aa84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:25.920480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294303e5-7a53-4bb7-b520-f033a72aa84b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:25.927702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-dd826805-cef9-404e-8c90-87b196b35301 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:25.930545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:25.931865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:25.932941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:25.932941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:25.932941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:25.932941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:25.932941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:25.932941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:25.932941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:25.932941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:25.937932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 440/867] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:25.940083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd826805-cef9-404e-8c90-87b196b35301 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:25.941885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 428/868] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:25.947745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294303e5-7a53-4bb7-b520-f033a72aa84b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:26.033460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:26.062982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd826805-cef9-404e-8c90-87b196b35301 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:26.086541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294303e5-7a53-4bb7-b520-f033a72aa84b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:26.100295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cedff3-6df4-4086-886e-7ae4fb088f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:26.101844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cedff3-6df4-4086-886e-7ae4fb088f93 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:26.102466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cedff3-6df4-4086-886e-7ae4fb088f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:26.102865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cedff3-6df4-4086-886e-7ae4fb088f93 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:26.103658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cedff3-6df4-4086-886e-7ae4fb088f93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:26.104081 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cedff3-6df4-4086-886e-7ae4fb088f93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:26.105609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cedff3-6df4-4086-886e-7ae4fb088f93 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:26.119795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 441/869] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:26.121035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c007d73-798c-4e45-81bb-a6c56fc8e19e None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:26.121321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c007d73-798c-4e45-81bb-a6c56fc8e19e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:26.121594 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c007d73-798c-4e45-81bb-a6c56fc8e19e None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:26.122988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 442/870] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:26.127462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c007d73-798c-4e45-81bb-a6c56fc8e19e None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:26.127787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313980d-dabe-4b63-8dbc-b983eeab4214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:26.128576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313980d-dabe-4b63-8dbc-b983eeab4214 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:26.128859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313980d-dabe-4b63-8dbc-b983eeab4214 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:26.129135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313980d-dabe-4b63-8dbc-b983eeab4214 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:26.136902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313980d-dabe-4b63-8dbc-b983eeab4214 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:26.138349 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313980d-dabe-4b63-8dbc-b983eeab4214 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f313980d-dabe-4b63-8dbc-b983eeab4214 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:26.153220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:26.154109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:26.155038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:26.155038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:26.155038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:26.155038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:26.155038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:26.155038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:26.155038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:26.155038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:26.159183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 429/871] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:26.160177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a4bd8-bf44-4f02-a986-da0932a14753 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:26.160468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a4bd8-bf44-4f02-a986-da0932a14753 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:26.160750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a4bd8-bf44-4f02-a986-da0932a14753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:26.177723 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-aa4a4bd8-bf44-4f02-a986-da0932a14753 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:26.179028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-aa4a4bd8-bf44-4f02-a986-da0932a14753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:26.234814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:26.238052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c007d73-798c-4e45-81bb-a6c56fc8e19e None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:26.251033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 430/872] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:26 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:26.262192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a4bd8-bf44-4f02-a986-da0932a14753 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:26.279511 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330daa8-8646-4ea9-9ae0-c34fd6dda058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:26.280168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330daa8-8646-4ea9-9ae0-c34fd6dda058 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:26.280449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330daa8-8646-4ea9-9ae0-c34fd6dda058 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:26.280723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330daa8-8646-4ea9-9ae0-c34fd6dda058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:26.281560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330daa8-8646-4ea9-9ae0-c34fd6dda058 None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=89cb97f51e6b4568a09e83cfbdf9e8c6) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:26.281871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330daa8-8646-4ea9-9ae0-c34fd6dda058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:26.283326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330daa8-8646-4ea9-9ae0-c34fd6dda058 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:26.289255 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 443/873] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:26 2022] GET /identity/v3/role_assignments?user.id=89cb97f51e6b4568a09e83cfbdf9e8c6&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:26.290018 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330daa8-8646-4ea9-9ae0-c34fd6dda058 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:26.292575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:26.400103 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a4bd8-bf44-4f02-a986-da0932a14753 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:26.442572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451c085-6479-49ef-95aa-2e8ba4ee0174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:26.443631 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451c085-6479-49ef-95aa-2e8ba4ee0174 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:26.444092 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451c085-6479-49ef-95aa-2e8ba4ee0174 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:26.444578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451c085-6479-49ef-95aa-2e8ba4ee0174 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:26.445793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330daa8-8646-4ea9-9ae0-c34fd6dda058 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:26.446763 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451c085-6479-49ef-95aa-2e8ba4ee0174 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:26.447343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451c085-6479-49ef-95aa-2e8ba4ee0174 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:26.449069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451c085-6479-49ef-95aa-2e8ba4ee0174 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:26.462349 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 431/874] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:26.468401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451c085-6479-49ef-95aa-2e8ba4ee0174 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:26.491984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca93c-44bd-48f0-b60c-415c2dacebb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:26.492919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca93c-44bd-48f0-b60c-415c2dacebb5 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:26.493206 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca93c-44bd-48f0-b60c-415c2dacebb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:26.493483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca93c-44bd-48f0-b60c-415c2dacebb5 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:26.494543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaca93c-44bd-48f0-b60c-415c2dacebb5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:26.495982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaca93c-44bd-48f0-b60c-415c2dacebb5 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:26.518524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 444/875] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:03:26 2022] POST /identity/v3/services => generated 269 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:26.540605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:26.612213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451c085-6479-49ef-95aa-2e8ba4ee0174 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:26.659941 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d56249-b802-4111-93fd-ba7e1e94e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:26.660529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d56249-b802-4111-93fd-ba7e1e94e5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:26.660811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d56249-b802-4111-93fd-ba7e1e94e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:26.661086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d56249-b802-4111-93fd-ba7e1e94e5f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:26.661993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d56249-b802-4111-93fd-ba7e1e94e5f0 None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=a0c29a6bfcf44b47ae368f47fdd04643) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:26.662314 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d56249-b802-4111-93fd-ba7e1e94e5f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:26.663929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d56249-b802-4111-93fd-ba7e1e94e5f0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:26.671347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 432/876] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:26 2022] GET /identity/v3/role_assignments?user.id=a0c29a6bfcf44b47ae368f47fdd04643&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=6fcc322b483a475399974562c1e5bd43 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:27.788009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d59c-10c2-43a3-9bf4-fd782348b70a None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:27.788551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d59c-10c2-43a3-9bf4-fd782348b70a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:27.788551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817d59c-10c2-43a3-9bf4-fd782348b70a None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:27.790799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 445/877] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:27.796199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3405-f4d5-429b-ba08-7d2e63b5a946 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:27.797035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3405-f4d5-429b-ba08-7d2e63b5a946 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:27.797529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3405-f4d5-429b-ba08-7d2e63b5a946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:27.815842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e98e3405-f4d5-429b-ba08-7d2e63b5a946 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:27.817354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e98e3405-f4d5-429b-ba08-7d2e63b5a946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:27.894510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 433/878] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:27.918760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817d59c-10c2-43a3-9bf4-fd782348b70a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:27.984045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:28.027638 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817d59c-10c2-43a3-9bf4-fd782348b70a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:28.066054 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abab51-4b62-46aa-ad5e-179419a71c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:28.066868 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abab51-4b62-46aa-ad5e-179419a71c76 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:28.067149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abab51-4b62-46aa-ad5e-179419a71c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:28.067420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abab51-4b62-46aa-ad5e-179419a71c76 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:28.068063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abab51-4b62-46aa-ad5e-179419a71c76 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:28.069423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abab51-4b62-46aa-ad5e-179419a71c76 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-45abab51-4b62-46aa-ad5e-179419a71c76 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:28.081318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:28.082324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:28.083177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 446/879] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:03:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:28.089527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3405-f4d5-429b-ba08-7d2e63b5a946 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:28.130890 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:28.200313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3405-f4d5-429b-ba08-7d2e63b5a946 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:28.235386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dba49-39a4-4e06-a28e-01d1dccf4bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:28.236377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dba49-39a4-4e06-a28e-01d1dccf4bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:28.236857 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dba49-39a4-4e06-a28e-01d1dccf4bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:28.237310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dba49-39a4-4e06-a28e-01d1dccf4bd8 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:28.238193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dba49-39a4-4e06-a28e-01d1dccf4bd8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:28.238968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dba49-39a4-4e06-a28e-01d1dccf4bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:28.240514 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dba49-39a4-4e06-a28e-01d1dccf4bd8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:28.247092 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 434/880] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:03:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:28.253003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abab51-4b62-46aa-ad5e-179419a71c76 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:28.364767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abab51-4b62-46aa-ad5e-179419a71c76 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:28.394993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:28.401053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada8b4c-bf08-452e-89bf-6d17a1c90f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:28.402161 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada8b4c-bf08-452e-89bf-6d17a1c90f7b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:28.402838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada8b4c-bf08-452e-89bf-6d17a1c90f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:28.403577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada8b4c-bf08-452e-89bf-6d17a1c90f7b None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:28.404286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada8b4c-bf08-452e-89bf-6d17a1c90f7b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:28.404587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada8b4c-bf08-452e-89bf-6d17a1c90f7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:28.405942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada8b4c-bf08-452e-89bf-6d17a1c90f7b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:28.411412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 447/881] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:03:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:28.417580 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dba49-39a4-4e06-a28e-01d1dccf4bd8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:28.529272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dba49-39a4-4e06-a28e-01d1dccf4bd8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:28.530883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:28.576925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd887c7-e8df-4ea4-8b40-3ac75a798e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:28.577603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd887c7-e8df-4ea4-8b40-3ac75a798e3d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:28.577888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd887c7-e8df-4ea4-8b40-3ac75a798e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:28.578166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd887c7-e8df-4ea4-8b40-3ac75a798e3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:28.579015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd887c7-e8df-4ea4-8b40-3ac75a798e3d None admin] RBAC: Adding query filter params (interface=public, service_id=89a2cd510d8a4be5bec851bfb46e4709, region_id=RegionOne) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:28.579331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd887c7-e8df-4ea4-8b40-3ac75a798e3d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:28.580792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd887c7-e8df-4ea4-8b40-3ac75a798e3d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:28.594122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 435/882] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 08:03:28 2022] GET /identity/v3/endpoints?service_id=89a2cd510d8a4be5bec851bfb46e4709&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:28.600404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada8b4c-bf08-452e-89bf-6d17a1c90f7b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:28.600935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c1d7b-4886-47a5-ac19-7f940f37190a None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:28.601377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c1d7b-4886-47a5-ac19-7f940f37190a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:28.601741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c1d7b-4886-47a5-ac19-7f940f37190a None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:28.606690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 436/883] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:03:28.610103 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29430e-6599-4f6a-b822-9a731903fb17 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:28.610385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29430e-6599-4f6a-b822-9a731903fb17 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:28.610687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29430e-6599-4f6a-b822-9a731903fb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:28.628167 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1f29430e-6599-4f6a-b822-9a731903fb17 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:28.629354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1f29430e-6599-4f6a-b822-9a731903fb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:28.718718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 437/884] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:28.733416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada8b4c-bf08-452e-89bf-6d17a1c90f7b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:28.740715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29430e-6599-4f6a-b822-9a731903fb17 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:28.773675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebd8ff-a000-49ae-ae22-3a9ebbd5281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:28.774334 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebd8ff-a000-49ae-ae22-3a9ebbd5281b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:28.774668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebd8ff-a000-49ae-ae22-3a9ebbd5281b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:28.774916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebd8ff-a000-49ae-ae22-3a9ebbd5281b None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:28.775588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebd8ff-a000-49ae-ae22-3a9ebbd5281b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:28.776947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebd8ff-a000-49ae-ae22-3a9ebbd5281b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:28.790733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 448/885] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 08:03:28 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:03:28.790733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73e37b-65a5-42ad-8834-a15753ba588b None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:28.790733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73e37b-65a5-42ad-8834-a15753ba588b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:28.790733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73e37b-65a5-42ad-8834-a15753ba588b None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:28.790733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 449/886] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:28.791962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577a01f-3280-4a27-b613-8b903426b626 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:28.792220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577a01f-3280-4a27-b613-8b903426b626 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:28.792502 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577a01f-3280-4a27-b613-8b903426b626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:28.810294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e577a01f-3280-4a27-b613-8b903426b626 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:28.811534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e577a01f-3280-4a27-b613-8b903426b626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:28.866004 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:28.871925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29430e-6599-4f6a-b822-9a731903fb17 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:28.891011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:28.898243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 450/887] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:28.900168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40df4ff-bab8-4a1f-ae49-fa0bde6d4d1b None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:28.900451 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40df4ff-bab8-4a1f-ae49-fa0bde6d4d1b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:28.900727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40df4ff-bab8-4a1f-ae49-fa0bde6d4d1b None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:28.902213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 451/888] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:28.907680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392dd05-fbbf-40c8-8f73-4916633b67d2 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:28.907963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392dd05-fbbf-40c8-8f73-4916633b67d2 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:28.908367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392dd05-fbbf-40c8-8f73-4916633b67d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:28.920901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6dfd8-b4b3-46cf-81f7-8799ed880fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:28.922000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6dfd8-b4b3-46cf-81f7-8799ed880fef None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:28.922467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6dfd8-b4b3-46cf-81f7-8799ed880fef None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:28.922937 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6dfd8-b4b3-46cf-81f7-8799ed880fef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:28.927686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e392dd05-fbbf-40c8-8f73-4916633b67d2 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:28.928948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e392dd05-fbbf-40c8-8f73-4916633b67d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:28.935600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6dfd8-b4b3-46cf-81f7-8799ed880fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-63a6dfd8-b4b3-46cf-81f7-8799ed880fef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:28.943968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:28.945547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 438/889] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 21 08:03:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:28.947289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6dfd8-b4b3-46cf-81f7-8799ed880fef None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:29.005749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 452/890] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:29.006668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392dd05-fbbf-40c8-8f73-4916633b67d2 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:29.070678 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6dfd8-b4b3-46cf-81f7-8799ed880fef None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:29.109061 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59f859-72f4-4095-a58c-3cd2c295da58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:29.109865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59f859-72f4-4095-a58c-3cd2c295da58 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:29.110144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59f859-72f4-4095-a58c-3cd2c295da58 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:29.110416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59f859-72f4-4095-a58c-3cd2c295da58 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:29.110848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392dd05-fbbf-40c8-8f73-4916633b67d2 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:29.111107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59f859-72f4-4095-a58c-3cd2c295da58 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:29.112534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59f859-72f4-4095-a58c-3cd2c295da58 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-6a59f859-72f4-4095-a58c-3cd2c295da58 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:29.125896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:29.127029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:29.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 439/891] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Jun 21 08:03:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:29.129173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59f859-72f4-4095-a58c-3cd2c295da58 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:29.130039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:29.152366 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:29.155159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82252beb-c2f5-49bf-8180-92736dc8ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:29.155845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252beb-c2f5-49bf-8180-92736dc8ba66 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:29.156125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252beb-c2f5-49bf-8180-92736dc8ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:29.156398 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252beb-c2f5-49bf-8180-92736dc8ba66 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:29.157170 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82252beb-c2f5-49bf-8180-92736dc8ba66 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:29.157440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82252beb-c2f5-49bf-8180-92736dc8ba66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:29.158837 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82252beb-c2f5-49bf-8180-92736dc8ba66 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:29.172602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 453/892] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 08:03:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:29.173315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82252beb-c2f5-49bf-8180-92736dc8ba66 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:29.237304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59f859-72f4-4095-a58c-3cd2c295da58 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:29.275516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c5633-b3f6-4552-94c0-2cd3458d772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:29.275844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82252beb-c2f5-49bf-8180-92736dc8ba66 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:29.276327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c5633-b3f6-4552-94c0-2cd3458d772a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:29.276612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c5633-b3f6-4552-94c0-2cd3458d772a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:29.276888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c5633-b3f6-4552-94c0-2cd3458d772a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:29.277549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c5633-b3f6-4552-94c0-2cd3458d772a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:29.278960 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c5633-b3f6-4552-94c0-2cd3458d772a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-815c5633-b3f6-4552-94c0-2cd3458d772a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:29.294575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:29.295774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:29.296697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 440/893] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 08:03:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:29.299444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c5633-b3f6-4552-94c0-2cd3458d772a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:29.321650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16742ecf-4cfa-4dfd-bca5-adfea39f9a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:29.322239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16742ecf-4cfa-4dfd-bca5-adfea39f9a48 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:29.322527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16742ecf-4cfa-4dfd-bca5-adfea39f9a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:29.322833 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16742ecf-4cfa-4dfd-bca5-adfea39f9a48 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:29.323542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16742ecf-4cfa-4dfd-bca5-adfea39f9a48 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:29.323851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16742ecf-4cfa-4dfd-bca5-adfea39f9a48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:29.325220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16742ecf-4cfa-4dfd-bca5-adfea39f9a48 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:29.330087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 454/894] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 08:03:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:29.335227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16742ecf-4cfa-4dfd-bca5-adfea39f9a48 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:29.380381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:29.394831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:29.411943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c5633-b3f6-4552-94c0-2cd3458d772a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:29.446067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16742ecf-4cfa-4dfd-bca5-adfea39f9a48 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:29.448031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3d025-fd32-4e6a-8b0a-5ca1106b6481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:29.448820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3d025-fd32-4e6a-8b0a-5ca1106b6481 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:29.449105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3d025-fd32-4e6a-8b0a-5ca1106b6481 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:29.449386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3d025-fd32-4e6a-8b0a-5ca1106b6481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:29.460681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3d025-fd32-4e6a-8b0a-5ca1106b6481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:29.462196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3d025-fd32-4e6a-8b0a-5ca1106b6481 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-28b3d025-fd32-4e6a-8b0a-5ca1106b6481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:29.480898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:29.481794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:29.482702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:29.482702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:29.482702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:29.482702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:29.482702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 441/895] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:29.483476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3d025-fd32-4e6a-8b0a-5ca1106b6481 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:29.490943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297fd1c-5a57-45c4-a882-28144655b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:29.491648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297fd1c-5a57-45c4-a882-28144655b6ad None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:29.492625 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297fd1c-5a57-45c4-a882-28144655b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:29.492907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297fd1c-5a57-45c4-a882-28144655b6ad None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:29.493730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297fd1c-5a57-45c4-a882-28144655b6ad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:29.494041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297fd1c-5a57-45c4-a882-28144655b6ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:29.495449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297fd1c-5a57-45c4-a882-28144655b6ad None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:29.501000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 455/896] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 08:03:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:29.501867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297fd1c-5a57-45c4-a882-28144655b6ad None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:29.597050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3d025-fd32-4e6a-8b0a-5ca1106b6481 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:29.616224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297fd1c-5a57-45c4-a882-28144655b6ad None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:29.619472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:29.632994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dae2b-ea90-433e-9efa-eedde9e6d7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:29.633657 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dae2b-ea90-433e-9efa-eedde9e6d7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:29.633943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dae2b-ea90-433e-9efa-eedde9e6d7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:29.634224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dae2b-ea90-433e-9efa-eedde9e6d7c6 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:29.634962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dae2b-ea90-433e-9efa-eedde9e6d7c6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:29.635272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dae2b-ea90-433e-9efa-eedde9e6d7c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:29.636641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dae2b-ea90-433e-9efa-eedde9e6d7c6 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:29.638701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:29.642175 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 442/897] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 08:03:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:29.642798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dae2b-ea90-433e-9efa-eedde9e6d7c6 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:29.665219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22269c-15f4-4676-87f6-8e10f5e9e1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:29.666160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22269c-15f4-4676-87f6-8e10f5e9e1bb None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:29.666655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22269c-15f4-4676-87f6-8e10f5e9e1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:29.667116 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22269c-15f4-4676-87f6-8e10f5e9e1bb None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:29.668010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22269c-15f4-4676-87f6-8e10f5e9e1bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:29.668497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22269c-15f4-4676-87f6-8e10f5e9e1bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:29.670052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22269c-15f4-4676-87f6-8e10f5e9e1bb None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:29.682695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 456/898] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:29.683486 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22269c-15f4-4676-87f6-8e10f5e9e1bb None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:29.757587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dae2b-ea90-433e-9efa-eedde9e6d7c6 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:29.783491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22269c-15f4-4676-87f6-8e10f5e9e1bb None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:29.793080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce61df-f9e8-42bc-9d46-d2e938d22440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:29.793898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce61df-f9e8-42bc-9d46-d2e938d22440 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:29.794178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce61df-f9e8-42bc-9d46-d2e938d22440 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:29.794446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce61df-f9e8-42bc-9d46-d2e938d22440 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:29.795298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce61df-f9e8-42bc-9d46-d2e938d22440 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:29.795599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce61df-f9e8-42bc-9d46-d2e938d22440 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:29.797003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce61df-f9e8-42bc-9d46-d2e938d22440 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:29.812297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 443/899] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 08:03:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:29.812297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce61df-f9e8-42bc-9d46-d2e938d22440 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:29.826902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a348fa-d586-4f7e-808a-1aea27b905a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:29.829187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a348fa-d586-4f7e-808a-1aea27b905a6 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:29.829659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a348fa-d586-4f7e-808a-1aea27b905a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:29.830545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a348fa-d586-4f7e-808a-1aea27b905a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:29.831885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a348fa-d586-4f7e-808a-1aea27b905a6 None admin] RBAC: Adding query filter params (interface=public, service_id=2619463eb0b14dd0bbd6ec3150ad811f, region_id=RegionOne) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:29.832371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a348fa-d586-4f7e-808a-1aea27b905a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:29.835073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a348fa-d586-4f7e-808a-1aea27b905a6 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:29.844083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 457/900] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 08:03:29 2022] GET /identity/v3/endpoints?service_id=2619463eb0b14dd0bbd6ec3150ad811f&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:29.849599 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a348fa-d586-4f7e-808a-1aea27b905a6 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:29.897245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:29.900986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:29.951409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce61df-f9e8-42bc-9d46-d2e938d22440 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:29.993691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20068aa3-c623-43dc-bf75-2eb801bf9301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:29.994502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20068aa3-c623-43dc-bf75-2eb801bf9301 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:29.994816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20068aa3-c623-43dc-bf75-2eb801bf9301 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:29.995093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20068aa3-c623-43dc-bf75-2eb801bf9301 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:30.003192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20068aa3-c623-43dc-bf75-2eb801bf9301 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:30.004636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20068aa3-c623-43dc-bf75-2eb801bf9301 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:30.012695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a348fa-d586-4f7e-808a-1aea27b905a6 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-20068aa3-c623-43dc-bf75-2eb801bf9301 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:30.020258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:30.021194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:30.022125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:30.022125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:30.022125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:30.022125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:30.022125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:30.022125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:30.022125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:30.022125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:30.022125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 08:03:30.022125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:30.022125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 444/901] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 08:03:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:30.027430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20068aa3-c623-43dc-bf75-2eb801bf9301 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:30.060701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23970ae-599b-4639-88d1-487d4b92a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:30.061381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23970ae-599b-4639-88d1-487d4b92a4ae None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:30.061673 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23970ae-599b-4639-88d1-487d4b92a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:30.061918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23970ae-599b-4639-88d1-487d4b92a4ae None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:30.062605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23970ae-599b-4639-88d1-487d4b92a4ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:30.064004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23970ae-599b-4639-88d1-487d4b92a4ae None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:30.071214 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 458/902] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 08:03:29 2022] GET /identity/v3/services => generated 1268 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:03:30.158611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20068aa3-c623-43dc-bf75-2eb801bf9301 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:30.187311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:30.201944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de7e3b-38ef-42e5-ae32-318fb9792ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:30.202947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de7e3b-38ef-42e5-ae32-318fb9792ddb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:30.203389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de7e3b-38ef-42e5-ae32-318fb9792ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:30.203811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de7e3b-38ef-42e5-ae32-318fb9792ddb None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:30.204803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de7e3b-38ef-42e5-ae32-318fb9792ddb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:30.205267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de7e3b-38ef-42e5-ae32-318fb9792ddb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:30.206972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de7e3b-38ef-42e5-ae32-318fb9792ddb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:30.227834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 445/903] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 21 08:03:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:30.233178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23970ae-599b-4639-88d1-487d4b92a4ae None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:30.333799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:30.344371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23970ae-599b-4639-88d1-487d4b92a4ae None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:30.381818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50464e-dfe5-4046-b662-038a30a6c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:30.382552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50464e-dfe5-4046-b662-038a30a6c232 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:30.382808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50464e-dfe5-4046-b662-038a30a6c232 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:30.383185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50464e-dfe5-4046-b662-038a30a6c232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:30.454858 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50464e-dfe5-4046-b662-038a30a6c232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:30.456240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50464e-dfe5-4046-b662-038a30a6c232 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:30.552392 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:30.562162 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 459/904] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:30 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 08:03:30.576538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de7e3b-38ef-42e5-ae32-318fb9792ddb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:30.683342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de7e3b-38ef-42e5-ae32-318fb9792ddb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:30.718682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9319d8-8295-4564-814d-7342a1ef7b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:30.719805 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9319d8-8295-4564-814d-7342a1ef7b22 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:30.720282 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9319d8-8295-4564-814d-7342a1ef7b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:30.720764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9319d8-8295-4564-814d-7342a1ef7b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:30.731795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9319d8-8295-4564-814d-7342a1ef7b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:30.733495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9319d8-8295-4564-814d-7342a1ef7b22 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-7a9319d8-8295-4564-814d-7342a1ef7b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:30.752524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:30.753459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:30.754333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:30.754333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:30.754333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:30.754333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:30.756674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 446/905] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:30.763271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50464e-dfe5-4046-b662-038a30a6c232 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:30.869163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff5ff3-fd7e-4c4c-8809-b43e8eeb83ee None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:30.869829 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff5ff3-fd7e-4c4c-8809-b43e8eeb83ee None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:30.870311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff5ff3-fd7e-4c4c-8809-b43e8eeb83ee None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:30.872163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 447/906] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:30.872416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50464e-dfe5-4046-b662-038a30a6c232 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:30.876928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416923-5113-4dbc-a9b8-a2e5cfe659b4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:30.877219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416923-5113-4dbc-a9b8-a2e5cfe659b4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:30.877499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416923-5113-4dbc-a9b8-a2e5cfe659b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:30.894369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ce416923-5113-4dbc-a9b8-a2e5cfe659b4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:30.895711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ce416923-5113-4dbc-a9b8-a2e5cfe659b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:30.922159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf249-aca3-4c0a-9096-6b832e7e8cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:30.923206 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf249-aca3-4c0a-9096-6b832e7e8cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:30.923890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf249-aca3-4c0a-9096-6b832e7e8cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:30.924322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf249-aca3-4c0a-9096-6b832e7e8cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:30.925173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:30.926932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdf249-aca3-4c0a-9096-6b832e7e8cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:30.927478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdf249-aca3-4c0a-9096-6b832e7e8cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:30.929980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdf249-aca3-4c0a-9096-6b832e7e8cb0 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:30.946709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 460/907] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:30.952047 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf249-aca3-4c0a-9096-6b832e7e8cb0 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:30.972190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 448/908] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:30.998011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce416923-5113-4dbc-a9b8-a2e5cfe659b4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:31.019000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:31.072770 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf249-aca3-4c0a-9096-6b832e7e8cb0 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:31.110150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f63e7e-c58a-4925-b125-a81459398b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:31.110816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63e7e-c58a-4925-b125-a81459398b0a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:31.111100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63e7e-c58a-4925-b125-a81459398b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:31.111376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63e7e-c58a-4925-b125-a81459398b0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:31.119396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f63e7e-c58a-4925-b125-a81459398b0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:31.120855 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f63e7e-c58a-4925-b125-a81459398b0a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:31.122929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce416923-5113-4dbc-a9b8-a2e5cfe659b4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-a3f63e7e-c58a-4925-b125-a81459398b0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:31.135965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:31.136904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:31.138201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:31.138201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:31.138201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:31.138201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:31.138201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:31.138201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:31.138201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:31.138201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:31.138201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 461/909] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:31.143286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f63e7e-c58a-4925-b125-a81459398b0a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:31.168222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236a967-d2a2-4fe7-a2e9-90d22501f6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:31.169011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236a967-d2a2-4fe7-a2e9-90d22501f6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:31.169292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236a967-d2a2-4fe7-a2e9-90d22501f6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:31.169568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236a967-d2a2-4fe7-a2e9-90d22501f6c2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:31.170373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236a967-d2a2-4fe7-a2e9-90d22501f6c2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:31.171641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236a967-d2a2-4fe7-a2e9-90d22501f6c2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-3236a967-d2a2-4fe7-a2e9-90d22501f6c2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:31.184332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:31.185320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 08:03:31.186141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:31.190679 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 449/910] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:03:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:31.191515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236a967-d2a2-4fe7-a2e9-90d22501f6c2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:31.222558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:31.272064 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f63e7e-c58a-4925-b125-a81459398b0a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:31.295070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:31.300710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236a967-d2a2-4fe7-a2e9-90d22501f6c2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:31.310852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9024377-7ef9-4f23-92ae-c62f9f1f445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:31.311795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9024377-7ef9-4f23-92ae-c62f9f1f445f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:31.312323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9024377-7ef9-4f23-92ae-c62f9f1f445f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:31.312798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9024377-7ef9-4f23-92ae-c62f9f1f445f None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:31.313793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9024377-7ef9-4f23-92ae-c62f9f1f445f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:31.314311 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9024377-7ef9-4f23-92ae-c62f9f1f445f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:31.315991 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9024377-7ef9-4f23-92ae-c62f9f1f445f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:31.329032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 462/911] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:31.334491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9024377-7ef9-4f23-92ae-c62f9f1f445f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:31.342175 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06195c21-3680-499e-a772-80cf2a332c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:31.343123 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06195c21-3680-499e-a772-80cf2a332c20 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:31.343623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06195c21-3680-499e-a772-80cf2a332c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:31.344112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06195c21-3680-499e-a772-80cf2a332c20 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:31.345517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06195c21-3680-499e-a772-80cf2a332c20 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:31.346035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06195c21-3680-499e-a772-80cf2a332c20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:31.348063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06195c21-3680-499e-a772-80cf2a332c20 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:31.355541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 450/912] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:03:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:31.360849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06195c21-3680-499e-a772-80cf2a332c20 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:31.464536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9024377-7ef9-4f23-92ae-c62f9f1f445f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:31.466644 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:31.479230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06195c21-3680-499e-a772-80cf2a332c20 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:31.506612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac18c1-d9f8-4a95-9bea-add1a6658124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:31.508219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac18c1-d9f8-4a95-9bea-add1a6658124 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:31.508713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac18c1-d9f8-4a95-9bea-add1a6658124 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:31.509187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac18c1-d9f8-4a95-9bea-add1a6658124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:31.510205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac18c1-d9f8-4a95-9bea-add1a6658124 None admin] RBAC: Adding query filter params (role.id=ac51b321f0034a93ad0913c0302cdf6f, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=89cb97f51e6b4568a09e83cfbdf9e8c6) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:31.510748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac18c1-d9f8-4a95-9bea-add1a6658124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:31.512385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac18c1-d9f8-4a95-9bea-add1a6658124 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:31.517153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90b6a3-fccc-463d-b417-bb93445f02e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:31.517819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90b6a3-fccc-463d-b417-bb93445f02e3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:31.518103 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90b6a3-fccc-463d-b417-bb93445f02e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:31.518382 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90b6a3-fccc-463d-b417-bb93445f02e3 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:31.519122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90b6a3-fccc-463d-b417-bb93445f02e3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:31.519429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90b6a3-fccc-463d-b417-bb93445f02e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:31.520244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 463/913] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:31 2022] GET /identity/v3/role_assignments?user.id=89cb97f51e6b4568a09e83cfbdf9e8c6&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=ac51b321f0034a93ad0913c0302cdf6f => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:31.520785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90b6a3-fccc-463d-b417-bb93445f02e3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:31.535840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 451/914] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 08:03:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:31.541936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac18c1-d9f8-4a95-9bea-add1a6658124 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:31.588293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:31.665689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac18c1-d9f8-4a95-9bea-add1a6658124 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:31.705450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84078cbd-a67d-44f2-b784-51d181caa902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:31.706113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84078cbd-a67d-44f2-b784-51d181caa902 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:31.706394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84078cbd-a67d-44f2-b784-51d181caa902 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:31.706693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84078cbd-a67d-44f2-b784-51d181caa902 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:31.707450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84078cbd-a67d-44f2-b784-51d181caa902 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:31.708895 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84078cbd-a67d-44f2-b784-51d181caa902 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:31.732776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 464/915] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 08:03:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:03:32.006966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f03449-94cc-4919-a8ee-b065ab8a287f None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:32.008516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f03449-94cc-4919-a8ee-b065ab8a287f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:32.009017 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f03449-94cc-4919-a8ee-b065ab8a287f None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:32.010862 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 452/916] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:32.016506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc463613-8632-44b7-8c21-4efd8eb3a310 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:32.017341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc463613-8632-44b7-8c21-4efd8eb3a310 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:32.017841 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc463613-8632-44b7-8c21-4efd8eb3a310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:32.035327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-cc463613-8632-44b7-8c21-4efd8eb3a310 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:32.036857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-cc463613-8632-44b7-8c21-4efd8eb3a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:32.114333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 465/917] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:32.137790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f03449-94cc-4919-a8ee-b065ab8a287f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:32.232089 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929eeac-9c57-44c5-88d2-d0741479ed38 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:32.232729 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929eeac-9c57-44c5-88d2-d0741479ed38 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:32.233199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929eeac-9c57-44c5-88d2-d0741479ed38 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:32.234804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 466/918] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:03:32.240401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a04c5-c2fe-4596-a94e-b81e603a88ad None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:32.241085 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a04c5-c2fe-4596-a94e-b81e603a88ad None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:32.241636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a04c5-c2fe-4596-a94e-b81e603a88ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:32.244795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f03449-94cc-4919-a8ee-b065ab8a287f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:32.261101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-b56a04c5-c2fe-4596-a94e-b81e603a88ad None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:32.262649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b56a04c5-c2fe-4596-a94e-b81e603a88ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:32.278775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:32.290213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c903c26-da15-41ff-ad58-28e83ec062c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:32.291415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c903c26-da15-41ff-ad58-28e83ec062c8 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:32.291703 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c903c26-da15-41ff-ad58-28e83ec062c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:32.291982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c903c26-da15-41ff-ad58-28e83ec062c8 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:32.292895 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c903c26-da15-41ff-ad58-28e83ec062c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:32.294722 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c903c26-da15-41ff-ad58-28e83ec062c8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:32.315105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 453/919] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:03:32 2022] POST /identity/v3/services => generated 241 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:32.368747 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 467/920] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:32.387654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c903c26-da15-41ff-ad58-28e83ec062c8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:32.408266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:32.505006 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c903c26-da15-41ff-ad58-28e83ec062c8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:32.541840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205b70f-641e-48e0-9db3-2d0699136736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:32.542627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205b70f-641e-48e0-9db3-2d0699136736 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:32.542923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205b70f-641e-48e0-9db3-2d0699136736 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:32.543195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205b70f-641e-48e0-9db3-2d0699136736 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:32.543848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205b70f-641e-48e0-9db3-2d0699136736 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:32.545207 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205b70f-641e-48e0-9db3-2d0699136736 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-e205b70f-641e-48e0-9db3-2d0699136736 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:32.557404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:32.558371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 08:03:32.559243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:32.562688 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 454/921] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Jun 21 08:03:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:32.568220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a04c5-c2fe-4596-a94e-b81e603a88ad None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:32.682920 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a04c5-c2fe-4596-a94e-b81e603a88ad None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:32.719287 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4817d1-84ff-44be-9df0-ef95a14a6379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:32.720331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4817d1-84ff-44be-9df0-ef95a14a6379 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:32.720851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4817d1-84ff-44be-9df0-ef95a14a6379 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:32.721332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4817d1-84ff-44be-9df0-ef95a14a6379 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:32.722257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4817d1-84ff-44be-9df0-ef95a14a6379 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:32.722795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4817d1-84ff-44be-9df0-ef95a14a6379 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:32.724383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4817d1-84ff-44be-9df0-ef95a14a6379 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:32.730090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 468/922] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 08:03:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:32.735526 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205b70f-641e-48e0-9db3-2d0699136736 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:32.824305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:32.845682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205b70f-641e-48e0-9db3-2d0699136736 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:32.884900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacacf03-f705-4204-81e0-84bf820fe0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:32.885572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacacf03-f705-4204-81e0-84bf820fe0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:32.885860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacacf03-f705-4204-81e0-84bf820fe0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:32.886137 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacacf03-f705-4204-81e0-84bf820fe0d8 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:32.886887 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacacf03-f705-4204-81e0-84bf820fe0d8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:32.887198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacacf03-f705-4204-81e0-84bf820fe0d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:32.888578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacacf03-f705-4204-81e0-84bf820fe0d8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:32.894398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 455/923] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 08:03:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:32.900040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4817d1-84ff-44be-9df0-ef95a14a6379 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:32.915040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:33.015368 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4817d1-84ff-44be-9df0-ef95a14a6379 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:33.051161 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1e328-f62e-4112-bf2a-326de3394fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:33.051900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1e328-f62e-4112-bf2a-326de3394fb8 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:33.052097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1e328-f62e-4112-bf2a-326de3394fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:33.052377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1e328-f62e-4112-bf2a-326de3394fb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:33.053127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1e328-f62e-4112-bf2a-326de3394fb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:33.054561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1e328-f62e-4112-bf2a-326de3394fb8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:33.076287 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 469/924] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 08:03:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:33.616326 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444cda0-66de-437a-bca2-ada0b52e392f None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:33.617536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444cda0-66de-437a-bca2-ada0b52e392f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:33.617762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444cda0-66de-437a-bca2-ada0b52e392f None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:33.619385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 456/925] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:33.629439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e2ab8-4bb1-4a0b-a9fd-2e8de5d86077 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:33.629980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e2ab8-4bb1-4a0b-a9fd-2e8de5d86077 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:33.630493 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e2ab8-4bb1-4a0b-a9fd-2e8de5d86077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:33.648538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e26e2ab8-4bb1-4a0b-a9fd-2e8de5d86077 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:33.650041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e26e2ab8-4bb1-4a0b-a9fd-2e8de5d86077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:33.713329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:33.729712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 470/926] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:33.754291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444cda0-66de-437a-bca2-ada0b52e392f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:33.865331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444cda0-66de-437a-bca2-ada0b52e392f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:33.903949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49b919-71e9-449f-b067-2ee8cd9c7611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:33.905168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49b919-71e9-449f-b067-2ee8cd9c7611 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:33.905665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49b919-71e9-449f-b067-2ee8cd9c7611 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:33.906160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49b919-71e9-449f-b067-2ee8cd9c7611 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:33.918290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49b919-71e9-449f-b067-2ee8cd9c7611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-4c49b919-71e9-449f-b067-2ee8cd9c7611 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:33.930646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:33.931614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:33.932450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:33.932450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:33.932450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:33.932450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:33.932450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:33.932450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:33.932450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:33.932450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:33.932450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:33.932450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:33.932450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 08:03:33.932450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:33.935347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 457/927] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 21 08:03:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:33.941218 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06a782-e06a-4108-9612-f5ee48f48c14 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:33.941581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06a782-e06a-4108-9612-f5ee48f48c14 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:33.941939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06a782-e06a-4108-9612-f5ee48f48c14 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:33.943937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 471/928] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:33.944345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49b919-71e9-449f-b067-2ee8cd9c7611 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:33.948479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:33.950163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae0a21-cf07-4812-819c-7b10f6e76460 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:33.950708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae0a21-cf07-4812-819c-7b10f6e76460 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:33.951220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae0a21-cf07-4812-819c-7b10f6e76460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:33.968334 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-7bae0a21-cf07-4812-819c-7b10f6e76460 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:33.969809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-7bae0a21-cf07-4812-819c-7b10f6e76460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:34.046790 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 472/929] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:34.064166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae0a21-cf07-4812-819c-7b10f6e76460 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:34.069140 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49b919-71e9-449f-b067-2ee8cd9c7611 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:34.112462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfee2be-0da5-4595-a616-112e4f501a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:34.113914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfee2be-0da5-4595-a616-112e4f501a15 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:34.114393 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfee2be-0da5-4595-a616-112e4f501a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:34.114849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfee2be-0da5-4595-a616-112e4f501a15 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:34.116275 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfee2be-0da5-4595-a616-112e4f501a15 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:34.117496 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfee2be-0da5-4595-a616-112e4f501a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:34.119080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfee2be-0da5-4595-a616-112e4f501a15 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:34.130949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 458/930] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 08:03:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:34.137349 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfee2be-0da5-4595-a616-112e4f501a15 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:34.183426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae0a21-cf07-4812-819c-7b10f6e76460 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:34.213808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:34.215394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:34.233396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803f29d-ae74-4e45-b539-e453c42fc36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:34.234554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803f29d-ae74-4e45-b539-e453c42fc36b None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:34.235098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803f29d-ae74-4e45-b539-e453c42fc36b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:34.236484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803f29d-ae74-4e45-b539-e453c42fc36b None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:34.237573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803f29d-ae74-4e45-b539-e453c42fc36b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:34.239574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803f29d-ae74-4e45-b539-e453c42fc36b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:34.241584 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: WARNING keystone.server.flask.common [None req-f803f29d-ae74-4e45-b539-e453c42fc36b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 08:03:34.259699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfee2be-0da5-4595-a616-112e4f501a15 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:34.262902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.sql.core [None req-f803f29d-ae74-4e45-b539-e453c42fc36b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 08:03:34.262902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 08:03:34.262902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [parameters: {'id': '3a75bae3dacb4130bcd99160391bd998', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 08:03:34.262902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80269) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-f803f29d-ae74-4e45-b539-e453c42fc36b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3a75bae3dacb4130bcd99160391bd998.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3a75bae3dacb4130bcd99160391bd998. Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application conn.query(q) Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 08:03:34.271725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application result.read() Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 21 08:03:34.272553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application next(self.gen) Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application yield resource Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application next(self.gen) Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise self.value Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application session.commit() Jun 21 08:03:34.274061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self.session.flush() Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application compat.raise_( Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 08:03:34.275038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 08:03:34.275940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application conn.query(q) Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application result.read() Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 08:03:34.276714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [parameters: {'id': '3a75bae3dacb4130bcd99160391bd998', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:34.277579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:34.278352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:34.279645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:34.279645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 21 08:03:34.279645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 21 08:03:34.279645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:34.279645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:34.279645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 21 08:03:34.279645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 21 08:03:34.279645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3a75bae3dacb4130bcd99160391bd998. Jun 21 08:03:34.279645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:34.287291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 473/931] 10.222.0.36 () {60 vars in 1140 bytes} [Tue Jun 21 08:03:34 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:34.289413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803f29d-ae74-4e45-b539-e453c42fc36b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:34.298860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042d03f-e450-41a6-81e4-b307de6fbdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:34.299737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042d03f-e450-41a6-81e4-b307de6fbdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:34.300092 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042d03f-e450-41a6-81e4-b307de6fbdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:34.300445 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042d03f-e450-41a6-81e4-b307de6fbdd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:34.312633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042d03f-e450-41a6-81e4-b307de6fbdd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:34.314362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042d03f-e450-41a6-81e4-b307de6fbdd4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-4042d03f-e450-41a6-81e4-b307de6fbdd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:34.333512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:34.334442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:34.336099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:34.336099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:34.336099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:34.336099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:34.340226 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 459/932] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:34.341390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042d03f-e450-41a6-81e4-b307de6fbdd4 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:34.410971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803f29d-ae74-4e45-b539-e453c42fc36b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:34.449361 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4c48c-2cdf-40a1-a79f-296f7f9f6ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:34.450496 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4c48c-2cdf-40a1-a79f-296f7f9f6ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:34.451009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4c48c-2cdf-40a1-a79f-296f7f9f6ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:34.451488 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4c48c-2cdf-40a1-a79f-296f7f9f6ea1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:34.451594 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042d03f-e450-41a6-81e4-b307de6fbdd4 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:34.459338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4c48c-2cdf-40a1-a79f-296f7f9f6ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:34.461763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4c48c-2cdf-40a1-a79f-296f7f9f6ea1 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:34.469438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-36d4c48c-2cdf-40a1-a79f-296f7f9f6ea1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:34.480457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:34.481415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:34.482290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:34.482290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:34.482290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:34.482290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:34.482290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:34.482290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:34.482290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:34.482290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:34.489923 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 474/933] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:34.490768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4c48c-2cdf-40a1-a79f-296f7f9f6ea1 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:34.498918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8d58-c18c-47e5-867f-6b5bcac6a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:34.499422 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8d58-c18c-47e5-867f-6b5bcac6a292 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:34.499708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8d58-c18c-47e5-867f-6b5bcac6a292 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:34.499986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8d58-c18c-47e5-867f-6b5bcac6a292 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:34.500721 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b8d58-c18c-47e5-867f-6b5bcac6a292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:34.501032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b8d58-c18c-47e5-867f-6b5bcac6a292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:34.502442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b8d58-c18c-47e5-867f-6b5bcac6a292 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:34.520551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 460/934] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:34.522310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a71e5-7d38-4199-a788-9aafab4ad818 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:34.522944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a71e5-7d38-4199-a788-9aafab4ad818 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:34.523388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a71e5-7d38-4199-a788-9aafab4ad818 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:34.524808 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 461/935] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:34.525740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a71e5-7d38-4199-a788-9aafab4ad818 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:34.536869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:34.609369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4c48c-2cdf-40a1-a79f-296f7f9f6ea1 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:34.644713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a71e5-7d38-4199-a788-9aafab4ad818 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:34.645253 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba572139-fd7c-4a03-9709-72f1ef02078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:34.645659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba572139-fd7c-4a03-9709-72f1ef02078f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:34.645943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba572139-fd7c-4a03-9709-72f1ef02078f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:34.646331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba572139-fd7c-4a03-9709-72f1ef02078f None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:34.647230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba572139-fd7c-4a03-9709-72f1ef02078f None admin] RBAC: Adding query filter params (name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:34.647535 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba572139-fd7c-4a03-9709-72f1ef02078f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:34.649854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba572139-fd7c-4a03-9709-72f1ef02078f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:34.682736 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 475/936] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:34 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:34.682736 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48037f57-cdd2-4da8-bf94-2a4b6d8ea7ff None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:34.682736 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48037f57-cdd2-4da8-bf94-2a4b6d8ea7ff None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:34.682736 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48037f57-cdd2-4da8-bf94-2a4b6d8ea7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:34.692726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-48037f57-cdd2-4da8-bf94-2a4b6d8ea7ff None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:34.694201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743620d-e52c-443e-a764-5609a970be54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:34.694331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-48037f57-cdd2-4da8-bf94-2a4b6d8ea7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:34.695726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743620d-e52c-443e-a764-5609a970be54 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:34.696009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743620d-e52c-443e-a764-5609a970be54 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:34.696285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743620d-e52c-443e-a764-5609a970be54 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:34.707429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743620d-e52c-443e-a764-5609a970be54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:34.709817 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743620d-e52c-443e-a764-5609a970be54 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f743620d-e52c-443e-a764-5609a970be54 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:34.732608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:34.733629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:34.734588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:34.734588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:34.734588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:34.734588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:34.734588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:34.734588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:34.734588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:34.734588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:34.734588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 08:03:34.734588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:34.735173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 462/937] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 08:03:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:34.740613 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743620d-e52c-443e-a764-5609a970be54 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:34.781565 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 476/938] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:34.791030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:34.806943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48037f57-cdd2-4da8-bf94-2a4b6d8ea7ff None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:34.837545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:34.855891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743620d-e52c-443e-a764-5609a970be54 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:34.903776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f694aa4-498f-4b2b-8376-33b44d870038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:34.904361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f694aa4-498f-4b2b-8376-33b44d870038 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:34.904813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f694aa4-498f-4b2b-8376-33b44d870038 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:34.905274 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f694aa4-498f-4b2b-8376-33b44d870038 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:34.907877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f694aa4-498f-4b2b-8376-33b44d870038 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:34.907877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f694aa4-498f-4b2b-8376-33b44d870038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:34.910343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f694aa4-498f-4b2b-8376-33b44d870038 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:34.935572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 463/939] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 21 08:03:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:34.936717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48037f57-cdd2-4da8-bf94-2a4b6d8ea7ff None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:34.941264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f694aa4-498f-4b2b-8376-33b44d870038 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:34.987831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dc9b1-5405-4fdc-9423-860ea74260b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:34.988896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dc9b1-5405-4fdc-9423-860ea74260b0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:34.989184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dc9b1-5405-4fdc-9423-860ea74260b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:34.989460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dc9b1-5405-4fdc-9423-860ea74260b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:34.990122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dc9b1-5405-4fdc-9423-860ea74260b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:34.992062 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dc9b1-5405-4fdc-9423-860ea74260b0 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-9a9dc9b1-5405-4fdc-9423-860ea74260b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:35.005003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:35.006036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:35.006999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 477/940] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 08:03:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:35.014860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dc9b1-5405-4fdc-9423-860ea74260b0 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:35.059292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:35.066109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f694aa4-498f-4b2b-8376-33b44d870038 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:35.105049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3445-e605-42b7-b7fc-2243c91822a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:35.106255 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3445-e605-42b7-b7fc-2243c91822a3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:35.106867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3445-e605-42b7-b7fc-2243c91822a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:35.107455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3445-e605-42b7-b7fc-2243c91822a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:35.113130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:35.121490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db3445-e605-42b7-b7fc-2243c91822a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:35.123348 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db3445-e605-42b7-b7fc-2243c91822a3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:35.124571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dc9b1-5405-4fdc-9423-860ea74260b0 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-77db3445-e605-42b7-b7fc-2243c91822a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:35.143799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:35.144919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:35.145897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:35.145897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:35.145897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:35.145897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:35.148555 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 464/941] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:35.154157 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3445-e605-42b7-b7fc-2243c91822a3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:35.171210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b2270-e544-4bf1-b515-6b82a902c4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:35.173780 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b2270-e544-4bf1-b515-6b82a902c4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:35.174302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b2270-e544-4bf1-b515-6b82a902c4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:35.175592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b2270-e544-4bf1-b515-6b82a902c4e6 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:35.176537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b2270-e544-4bf1-b515-6b82a902c4e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:35.177808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b2270-e544-4bf1-b515-6b82a902c4e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:35.179629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b2270-e544-4bf1-b515-6b82a902c4e6 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:35.185310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 478/942] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 08:03:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:35.191366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b2270-e544-4bf1-b515-6b82a902c4e6 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:35.278283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3445-e605-42b7-b7fc-2243c91822a3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:35.307763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b2270-e544-4bf1-b515-6b82a902c4e6 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:35.315487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fc686-d765-405d-927a-f644b82b5092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:35.316149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc686-d765-405d-927a-f644b82b5092 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:35.316435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc686-d765-405d-927a-f644b82b5092 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:35.316711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc686-d765-405d-927a-f644b82b5092 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:35.317465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fc686-d765-405d-927a-f644b82b5092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:35.317743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fc686-d765-405d-927a-f644b82b5092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:35.319165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fc686-d765-405d-927a-f644b82b5092 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:35.332136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 465/943] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:35.333359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a75b8-7c9e-45e1-bbcb-9c01c3b2b3a9 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:35.333651 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a75b8-7c9e-45e1-bbcb-9c01c3b2b3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:35.333935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a75b8-7c9e-45e1-bbcb-9c01c3b2b3a9 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:35.339233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 466/944] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:35.339233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a75b8-7c9e-45e1-bbcb-9c01c3b2b3a9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:35.347742 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e00e7e-81d9-4e0e-a58a-0947f522273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:35.348408 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e00e7e-81d9-4e0e-a58a-0947f522273e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:35.348696 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e00e7e-81d9-4e0e-a58a-0947f522273e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:35.348972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e00e7e-81d9-4e0e-a58a-0947f522273e None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:35.349288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:35.349726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e00e7e-81d9-4e0e-a58a-0947f522273e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:35.350045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e00e7e-81d9-4e0e-a58a-0947f522273e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:35.351958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e00e7e-81d9-4e0e-a58a-0947f522273e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:35.357126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 479/945] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 08:03:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:35.358319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b794e24-d031-4449-b8a7-546565ae7e23 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:35.358606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b794e24-d031-4449-b8a7-546565ae7e23 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:35.358911 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b794e24-d031-4449-b8a7-546565ae7e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:35.375990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-3b794e24-d031-4449-b8a7-546565ae7e23 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:35.377176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-3b794e24-d031-4449-b8a7-546565ae7e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:35.390829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:35.450676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 480/946] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:35.451432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b794e24-d031-4449-b8a7-546565ae7e23 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:35.468402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a75b8-7c9e-45e1-bbcb-9c01c3b2b3a9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:35.506578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a239e-7a45-4913-a9ca-fea06443681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:35.508861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a239e-7a45-4913-a9ca-fea06443681d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:35.509354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a239e-7a45-4913-a9ca-fea06443681d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:35.509850 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a239e-7a45-4913-a9ca-fea06443681d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:35.517309 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a239e-7a45-4913-a9ca-fea06443681d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:35.518910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a239e-7a45-4913-a9ca-fea06443681d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b44a239e-7a45-4913-a9ca-fea06443681d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:35.535691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:35.536842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:35.537712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:35.537712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:35.537712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:35.537712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:35.537712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:35.537712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:35.537712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:35.537712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:35.537712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 467/947] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:35.537712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a239e-7a45-4913-a9ca-fea06443681d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:35.564549 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b794e24-d031-4449-b8a7-546565ae7e23 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:35.604608 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b89599-9cd0-4738-87f7-dec46706b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:35.605525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b89599-9cd0-4738-87f7-dec46706b937 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:35.605806 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b89599-9cd0-4738-87f7-dec46706b937 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:35.606089 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b89599-9cd0-4738-87f7-dec46706b937 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:35.606890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b89599-9cd0-4738-87f7-dec46706b937 None admin] RBAC: Adding query filter params (interface=public, service_id=9a9e21cc78314e7bbaf1959c93904f90, region_id=RegionOne) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:35.607196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b89599-9cd0-4738-87f7-dec46706b937 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:35.608558 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b89599-9cd0-4738-87f7-dec46706b937 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:35.614103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 481/948] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 08:03:35 2022] GET /identity/v3/endpoints?service_id=9a9e21cc78314e7bbaf1959c93904f90&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:35.614893 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b89599-9cd0-4738-87f7-dec46706b937 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:35.615310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:35.633728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:35.653815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a239e-7a45-4913-a9ca-fea06443681d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:35.690416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0fe38-bdd7-48ea-90df-00195c4cdc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:35.691236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0fe38-bdd7-48ea-90df-00195c4cdc81 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:35.691623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0fe38-bdd7-48ea-90df-00195c4cdc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:35.691912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0fe38-bdd7-48ea-90df-00195c4cdc81 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:35.692564 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0fe38-bdd7-48ea-90df-00195c4cdc81 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:35.693932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0fe38-bdd7-48ea-90df-00195c4cdc81 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-31c0fe38-bdd7-48ea-90df-00195c4cdc81 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:35.705882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:35.706866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:35.707715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 468/949] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:35.708991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0fe38-bdd7-48ea-90df-00195c4cdc81 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:35.732871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b89599-9cd0-4738-87f7-dec46706b937 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:35.770012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e024a45-28d9-4e87-91b5-eb597b126ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:35.770853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e024a45-28d9-4e87-91b5-eb597b126ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:35.771145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e024a45-28d9-4e87-91b5-eb597b126ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:35.771444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e024a45-28d9-4e87-91b5-eb597b126ee9 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:35.772198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e024a45-28d9-4e87-91b5-eb597b126ee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:35.772512 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e024a45-28d9-4e87-91b5-eb597b126ee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:35.774737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e024a45-28d9-4e87-91b5-eb597b126ee9 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:35.793371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 482/950] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:35.793371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e024a45-28d9-4e87-91b5-eb597b126ee9 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:35.816978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0fe38-bdd7-48ea-90df-00195c4cdc81 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:35.846231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:35.852478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f508307-25fa-444b-9c01-4229cffe2064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:35.853135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f508307-25fa-444b-9c01-4229cffe2064 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:35.853412 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f508307-25fa-444b-9c01-4229cffe2064 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:35.853680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f508307-25fa-444b-9c01-4229cffe2064 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:35.854354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f508307-25fa-444b-9c01-4229cffe2064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:35.855737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f508307-25fa-444b-9c01-4229cffe2064 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:35.861663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 469/951] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 08:03:35 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:03:35.862564 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f508307-25fa-444b-9c01-4229cffe2064 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:35.877816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:35.919204 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e024a45-28d9-4e87-91b5-eb597b126ee9 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:35.961726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec83e2f-2ef1-4f59-a011-24d6c8ab3d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:35.962649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec83e2f-2ef1-4f59-a011-24d6c8ab3d76 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:35.962791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec83e2f-2ef1-4f59-a011-24d6c8ab3d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:35.963025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec83e2f-2ef1-4f59-a011-24d6c8ab3d76 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:35.963681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec83e2f-2ef1-4f59-a011-24d6c8ab3d76 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:35.963982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec83e2f-2ef1-4f59-a011-24d6c8ab3d76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:35.965386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec83e2f-2ef1-4f59-a011-24d6c8ab3d76 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:35.975525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 483/952] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:35.976716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec83e2f-2ef1-4f59-a011-24d6c8ab3d76 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:36.036870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f508307-25fa-444b-9c01-4229cffe2064 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:36.078484 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3afbf5-e02c-4085-8cc6-1bb3d851600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:36.080253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3afbf5-e02c-4085-8cc6-1bb3d851600b None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:36.080253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3afbf5-e02c-4085-8cc6-1bb3d851600b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:36.080253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3afbf5-e02c-4085-8cc6-1bb3d851600b None admin] PATH_INFO: `/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/89cb97f51e6b4568a09e83cfbdf9e8c6/roles/ac51b321f0034a93ad0913c0302cdf6f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:36.083207 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3afbf5-e02c-4085-8cc6-1bb3d851600b None admin] RBAC: Authorizing `identity:create_grant(project_id=c279ceb26daa45ba821e6ffb1db4f4f0, user_id=89cb97f51e6b4568a09e83cfbdf9e8c6, role_id=ac51b321f0034a93ad0913c0302cdf6f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:36.084655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3afbf5-e02c-4085-8cc6-1bb3d851600b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:36.099857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec83e2f-2ef1-4f59-a011-24d6c8ab3d76 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:36.103564 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 470/953] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:03:35 2022] PUT /identity/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/89cb97f51e6b4568a09e83cfbdf9e8c6/roles/ac51b321f0034a93ad0913c0302cdf6f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:03:36.139371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b4c42-6700-49d6-b5f4-b60239d420fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:36.140108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b4c42-6700-49d6-b5f4-b60239d420fe None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:36.140389 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b4c42-6700-49d6-b5f4-b60239d420fe None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:36.140661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b4c42-6700-49d6-b5f4-b60239d420fe None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:36.141383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b4c42-6700-49d6-b5f4-b60239d420fe None admin] RBAC: Adding query filter params (type=compute) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:36.141698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b4c42-6700-49d6-b5f4-b60239d420fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:36.143183 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b4c42-6700-49d6-b5f4-b60239d420fe None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:36.145777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:36.149806 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 484/954] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:36.895619 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7754108-2695-404f-9ff3-8eae63f757ed None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:36.896136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7754108-2695-404f-9ff3-8eae63f757ed None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:36.896136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7754108-2695-404f-9ff3-8eae63f757ed None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:36.897633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 471/955] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:36.903236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e3592-d11c-46ce-8a60-75fdee5e6d01 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:36.903806 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e3592-d11c-46ce-8a60-75fdee5e6d01 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:36.904304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e3592-d11c-46ce-8a60-75fdee5e6d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:36.922215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-384e3592-d11c-46ce-8a60-75fdee5e6d01 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:36.923745 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-384e3592-d11c-46ce-8a60-75fdee5e6d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:36.995054 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 485/956] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:37.020537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7754108-2695-404f-9ff3-8eae63f757ed None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:37.086095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:37.133653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7754108-2695-404f-9ff3-8eae63f757ed None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:37.168513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485c09e-472b-45ad-b56a-9a266a93082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:37.169147 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485c09e-472b-45ad-b56a-9a266a93082e None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:37.169427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485c09e-472b-45ad-b56a-9a266a93082e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:37.169709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485c09e-472b-45ad-b56a-9a266a93082e None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:37.170458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485c09e-472b-45ad-b56a-9a266a93082e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:37.171908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485c09e-472b-45ad-b56a-9a266a93082e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:37.173302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: WARNING keystone.server.flask.common [None req-b485c09e-472b-45ad-b56a-9a266a93082e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 08:03:37.188686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.sql.core [None req-b485c09e-472b-45ad-b56a-9a266a93082e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 08:03:37.188686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 08:03:37.188686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [parameters: {'user_id': 'dea336133d67470197bb9a8117191d3f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 08:03:37.188686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80270) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b485c09e-472b-45ad-b56a-9a266a93082e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application conn.query(q) Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application result.read() Jun 21 08:03:37.205632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 08:03:37.206554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application next(self.gen) Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application yield resource Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application next(self.gen) Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise self.value Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application session.commit() Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 08:03:37.207835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.session.flush() Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application compat.raise_( Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 08:03:37.208876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 08:03:37.209810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application conn.query(q) Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application result.read() Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 08:03:37.211185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [parameters: {'user_id': 'dea336133d67470197bb9a8117191d3f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:37.212019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 21 08:03:37.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 21 08:03:37.217866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 21 08:03:37.217866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 21 08:03:37.217866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 08:03:37.217866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 08:03:37.217866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 08:03:37.217866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:37.217866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 472/957] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 21 08:03:37 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:37.223182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e3592-d11c-46ce-8a60-75fdee5e6d01 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:37.328005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e3592-d11c-46ce-8a60-75fdee5e6d01 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:37.359361 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:37.367946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c75dd-95f7-4cd9-87a0-6c7ff895a542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:37.368963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c75dd-95f7-4cd9-87a0-6c7ff895a542 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:37.369429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c75dd-95f7-4cd9-87a0-6c7ff895a542 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:37.369887 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c75dd-95f7-4cd9-87a0-6c7ff895a542 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:37.377575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c75dd-95f7-4cd9-87a0-6c7ff895a542 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:37.379289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c75dd-95f7-4cd9-87a0-6c7ff895a542 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-5e9c75dd-95f7-4cd9-87a0-6c7ff895a542 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:37.394210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:37.395195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:37.396193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:37.396193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:37.396193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:37.396193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:37.396193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:37.396193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:37.396193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:37.396193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:37.396193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 08:03:37.396193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:37.399194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 486/958] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:03:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:37.405268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485c09e-472b-45ad-b56a-9a266a93082e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:37.509809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485c09e-472b-45ad-b56a-9a266a93082e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:37.527148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:37.546237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c86172-66e1-4973-84e1-b5ea95c30bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:37.547421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c86172-66e1-4973-84e1-b5ea95c30bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:37.547704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c86172-66e1-4973-84e1-b5ea95c30bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:37.547979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c86172-66e1-4973-84e1-b5ea95c30bb8 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:37.548778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c86172-66e1-4973-84e1-b5ea95c30bb8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:37.549082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c86172-66e1-4973-84e1-b5ea95c30bb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:37.550735 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c86172-66e1-4973-84e1-b5ea95c30bb8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:37.592875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 473/959] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 08:03:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:38.035827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfff06-3b32-463d-81ce-408486c07d57 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.036199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfff06-3b32-463d-81ce-408486c07d57 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.036381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfff06-3b32-463d-81ce-408486c07d57 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.038124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 487/960] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:38.043517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787a191-63ba-47e1-8116-4ba6b1dbc4cb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.044010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787a191-63ba-47e1-8116-4ba6b1dbc4cb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.044091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787a191-63ba-47e1-8116-4ba6b1dbc4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.068668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d787a191-63ba-47e1-8116-4ba6b1dbc4cb None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:38.071510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d787a191-63ba-47e1-8116-4ba6b1dbc4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:38.142515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 474/961] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:38.165440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfff06-3b32-463d-81ce-408486c07d57 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:38.247566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283309b6-a0f4-43a1-95ae-8de4b5705a24 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.247925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283309b6-a0f4-43a1-95ae-8de4b5705a24 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.248189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283309b6-a0f4-43a1-95ae-8de4b5705a24 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.249519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 475/962] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:38.254400 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04dc9f-155b-454d-9c7b-1554c8c70f9a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.254716 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04dc9f-155b-454d-9c7b-1554c8c70f9a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.254999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04dc9f-155b-454d-9c7b-1554c8c70f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.272022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0c04dc9f-155b-454d-9c7b-1554c8c70f9a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:38.273182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfff06-3b32-463d-81ce-408486c07d57 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:38.273644 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0c04dc9f-155b-454d-9c7b-1554c8c70f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:38.309997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4720ebc-1b8e-4bf0-b7bd-cb57efe7e1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:38.310752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4720ebc-1b8e-4bf0-b7bd-cb57efe7e1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.311037 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4720ebc-1b8e-4bf0-b7bd-cb57efe7e1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.311316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4720ebc-1b8e-4bf0-b7bd-cb57efe7e1c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.311968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4720ebc-1b8e-4bf0-b7bd-cb57efe7e1c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:38.313347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4720ebc-1b8e-4bf0-b7bd-cb57efe7e1c0 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-f4720ebc-1b8e-4bf0-b7bd-cb57efe7e1c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:38.325443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:38.326540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:38.327439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 488/963] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 08:03:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:38.328262 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511fe9-30b0-4065-bae3-0e6b0ae0dc48 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.328262 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511fe9-30b0-4065-bae3-0e6b0ae0dc48 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.328426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511fe9-30b0-4065-bae3-0e6b0ae0dc48 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.329607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 489/964] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:38.332283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98511fe9-30b0-4065-bae3-0e6b0ae0dc48 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:38.345849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 476/965] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:38.352680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f9638-fd2e-41c7-994d-e395e57ff741 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.353130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f9638-fd2e-41c7-994d-e395e57ff741 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.353537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f9638-fd2e-41c7-994d-e395e57ff741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.373104 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5d1f9638-fd2e-41c7-994d-e395e57ff741 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:38.374422 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5d1f9638-fd2e-41c7-994d-e395e57ff741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:38.392863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:38.403281 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:38.439576 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98511fe9-30b0-4065-bae3-0e6b0ae0dc48 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:38.441384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 477/966] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:38.442101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f9638-fd2e-41c7-994d-e395e57ff741 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:38.478690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a612ca2-c933-4123-8760-0d3b371e2596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:38.479346 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a612ca2-c933-4123-8760-0d3b371e2596 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.479628 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a612ca2-c933-4123-8760-0d3b371e2596 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.479900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a612ca2-c933-4123-8760-0d3b371e2596 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.480596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a612ca2-c933-4123-8760-0d3b371e2596 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:38.480897 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a612ca2-c933-4123-8760-0d3b371e2596 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:38.482261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a612ca2-c933-4123-8760-0d3b371e2596 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:38.487112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 490/967] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 08:03:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:38.487844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a612ca2-c933-4123-8760-0d3b371e2596 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:38.543967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f9638-fd2e-41c7-994d-e395e57ff741 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:38.580483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d02ec-0de7-4927-b4ff-4e1e37af1960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:38.581281 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d02ec-0de7-4927-b4ff-4e1e37af1960 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.581570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d02ec-0de7-4927-b4ff-4e1e37af1960 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.581837 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d02ec-0de7-4927-b4ff-4e1e37af1960 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.591349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a612ca2-c933-4123-8760-0d3b371e2596 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:38.592460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d02ec-0de7-4927-b4ff-4e1e37af1960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-878d02ec-0de7-4927-b4ff-4e1e37af1960 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:38.600554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:38.601654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:38.602510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 478/968] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 21 08:03:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:38.603277 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d02ec-0de7-4927-b4ff-4e1e37af1960 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:38.611547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:38.629251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303b1fe-cfe3-4ed9-995e-bef873967fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:38.629927 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303b1fe-cfe3-4ed9-995e-bef873967fa1 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.630211 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303b1fe-cfe3-4ed9-995e-bef873967fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.630488 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303b1fe-cfe3-4ed9-995e-bef873967fa1 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.631233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303b1fe-cfe3-4ed9-995e-bef873967fa1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:38.632428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:38.633229 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303b1fe-cfe3-4ed9-995e-bef873967fa1 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:38.646607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 491/969] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:03:38 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:38.647476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303b1fe-cfe3-4ed9-995e-bef873967fa1 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:38.715480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d02ec-0de7-4927-b4ff-4e1e37af1960 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:38.763353 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fba611-5414-4355-85dd-ef5ca600411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:38.764026 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba611-5414-4355-85dd-ef5ca600411f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.764131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303b1fe-cfe3-4ed9-995e-bef873967fa1 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:38.764320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba611-5414-4355-85dd-ef5ca600411f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.764579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba611-5414-4355-85dd-ef5ca600411f None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.765302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fba611-5414-4355-85dd-ef5ca600411f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:38.765726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fba611-5414-4355-85dd-ef5ca600411f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:38.767307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fba611-5414-4355-85dd-ef5ca600411f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:38.778342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 479/970] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 08:03:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:38.779328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fba611-5414-4355-85dd-ef5ca600411f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:38.804966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a44869-eed3-41e3-94d8-a5d77e449602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:38.805638 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a44869-eed3-41e3-94d8-a5d77e449602 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.805922 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a44869-eed3-41e3-94d8-a5d77e449602 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.806199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a44869-eed3-41e3-94d8-a5d77e449602 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.806992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a44869-eed3-41e3-94d8-a5d77e449602 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:38.807303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a44869-eed3-41e3-94d8-a5d77e449602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:38.808674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a44869-eed3-41e3-94d8-a5d77e449602 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:38.818664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 492/971] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 08:03:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:38.824375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a44869-eed3-41e3-94d8-a5d77e449602 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:38.862345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:38.878910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:38.894885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fba611-5414-4355-85dd-ef5ca600411f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:38.931331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fe221-4c5c-4381-b351-7b7936c90f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:38.931943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a44869-eed3-41e3-94d8-a5d77e449602 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:38.932070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fe221-4c5c-4381-b351-7b7936c90f0e None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.932246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fe221-4c5c-4381-b351-7b7936c90f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.932510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fe221-4c5c-4381-b351-7b7936c90f0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:38.933242 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fe221-4c5c-4381-b351-7b7936c90f0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:38.935377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fe221-4c5c-4381-b351-7b7936c90f0e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:38.955871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 480/972] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 08:03:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:38.988158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d116253-a3f6-4e3e-9572-d560061ddf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:38.989219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d116253-a3f6-4e3e-9572-d560061ddf5b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:38.989494 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d116253-a3f6-4e3e-9572-d560061ddf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:38.989764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d116253-a3f6-4e3e-9572-d560061ddf5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:39.002089 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d116253-a3f6-4e3e-9572-d560061ddf5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:39.003592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d116253-a3f6-4e3e-9572-d560061ddf5b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-1d116253-a3f6-4e3e-9572-d560061ddf5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:39.024188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:39.025194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:39.026676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:39.026676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:39.026676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:39.026676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:39.026676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 493/973] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:39.031554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fe221-4c5c-4381-b351-7b7936c90f0e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:39.147368 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fe221-4c5c-4381-b351-7b7936c90f0e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:39.184239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b780d-fd34-4e87-8c0f-97b52d0d9ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:39.184913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b780d-fd34-4e87-8c0f-97b52d0d9ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:39.185197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b780d-fd34-4e87-8c0f-97b52d0d9ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:39.185473 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b780d-fd34-4e87-8c0f-97b52d0d9ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:39.186195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b780d-fd34-4e87-8c0f-97b52d0d9ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:39.186500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b780d-fd34-4e87-8c0f-97b52d0d9ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:39.187907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b780d-fd34-4e87-8c0f-97b52d0d9ac0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:39.205789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 481/974] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:39.207363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d116253-a3f6-4e3e-9572-d560061ddf5b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:39.297945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:39.315503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d116253-a3f6-4e3e-9572-d560061ddf5b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:39.351856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14c8f3-90ca-4e95-a275-ab90f6b1eb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:39.352662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14c8f3-90ca-4e95-a275-ab90f6b1eb13 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:39.352947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14c8f3-90ca-4e95-a275-ab90f6b1eb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:39.353223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14c8f3-90ca-4e95-a275-ab90f6b1eb13 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:39.360836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14c8f3-90ca-4e95-a275-ab90f6b1eb13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:39.362275 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14c8f3-90ca-4e95-a275-ab90f6b1eb13 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-6f14c8f3-90ca-4e95-a275-ab90f6b1eb13 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:39.378454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:39.379456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:39.385795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:39.385795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:39.385795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:39.385795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:39.385795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:39.385795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:39.385795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:39.385795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:39.385795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 08:03:39.385795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:39.385795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 494/975] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 08:03:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:39.388053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b780d-fd34-4e87-8c0f-97b52d0d9ac0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:39.391015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:39.496946 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b780d-fd34-4e87-8c0f-97b52d0d9ac0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:39.532255 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bf0e1-6682-45db-b66c-5e73e9cd0971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:39.532914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bf0e1-6682-45db-b66c-5e73e9cd0971 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:39.533194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bf0e1-6682-45db-b66c-5e73e9cd0971 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:39.533469 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bf0e1-6682-45db-b66c-5e73e9cd0971 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:39.534298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bf0e1-6682-45db-b66c-5e73e9cd0971 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:39.534604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bf0e1-6682-45db-b66c-5e73e9cd0971 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:39.536062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bf0e1-6682-45db-b66c-5e73e9cd0971 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:39.558648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 482/976] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 21 08:03:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:39.560367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14c8f3-90ca-4e95-a275-ab90f6b1eb13 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:39.670081 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14c8f3-90ca-4e95-a275-ab90f6b1eb13 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:39.705636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbb629-f305-4a2e-9d08-53fb084c0658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:39.706277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbb629-f305-4a2e-9d08-53fb084c0658 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:39.706558 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbb629-f305-4a2e-9d08-53fb084c0658 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:39.706859 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbb629-f305-4a2e-9d08-53fb084c0658 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:39.721399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:39.781756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbb629-f305-4a2e-9d08-53fb084c0658 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:39.783192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbb629-f305-4a2e-9d08-53fb084c0658 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:39.887325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 495/977] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:39 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:03:39.892923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bf0e1-6682-45db-b66c-5e73e9cd0971 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:39.957452 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:39.999809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bf0e1-6682-45db-b66c-5e73e9cd0971 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:40.035330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90840d30-ee0c-4aa7-8ca3-87600a659a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:40.036052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90840d30-ee0c-4aa7-8ca3-87600a659a8d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:40.036337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90840d30-ee0c-4aa7-8ca3-87600a659a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:40.036617 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90840d30-ee0c-4aa7-8ca3-87600a659a8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:40.047271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90840d30-ee0c-4aa7-8ca3-87600a659a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:40.048717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90840d30-ee0c-4aa7-8ca3-87600a659a8d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-90840d30-ee0c-4aa7-8ca3-87600a659a8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:40.067031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:40.067974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:40.073956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:40.073956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:40.073956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:40.073956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:40.073956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 483/978] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:40.075711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbb629-f305-4a2e-9d08-53fb084c0658 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:40.125708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:40.183118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbb629-f305-4a2e-9d08-53fb084c0658 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:40.216704 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dae861-0c7e-4cd3-97a9-754c07b744e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:40.217358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dae861-0c7e-4cd3-97a9-754c07b744e9 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:40.217641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dae861-0c7e-4cd3-97a9-754c07b744e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:40.217915 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dae861-0c7e-4cd3-97a9-754c07b744e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:40.218644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dae861-0c7e-4cd3-97a9-754c07b744e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:40.218956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dae861-0c7e-4cd3-97a9-754c07b744e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:40.220322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dae861-0c7e-4cd3-97a9-754c07b744e9 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:40.236047 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 496/979] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:40.237917 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90840d30-ee0c-4aa7-8ca3-87600a659a8d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:40.341729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90840d30-ee0c-4aa7-8ca3-87600a659a8d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:40.355196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:40.377276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec08457-1ef6-4b8f-914f-d4107b4ddc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:40.378059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec08457-1ef6-4b8f-914f-d4107b4ddc86 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:40.378334 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec08457-1ef6-4b8f-914f-d4107b4ddc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:40.378603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec08457-1ef6-4b8f-914f-d4107b4ddc86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:40.386069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec08457-1ef6-4b8f-914f-d4107b4ddc86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:40.387535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec08457-1ef6-4b8f-914f-d4107b4ddc86 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-6ec08457-1ef6-4b8f-914f-d4107b4ddc86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:40.401068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:40.401928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:40.402866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:40.402866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:40.402866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:40.402866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:40.402866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:40.402866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:40.402866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:40.402866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:40.406674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 484/980] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:40.408227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dae861-0c7e-4cd3-97a9-754c07b744e9 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:40.513527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dae861-0c7e-4cd3-97a9-754c07b744e9 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:40.515882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:40.548791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82e0c5-ec27-4923-88a9-69225ce3fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:40.549448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e0c5-ec27-4923-88a9-69225ce3fd5e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:40.549730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e0c5-ec27-4923-88a9-69225ce3fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:40.550005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e0c5-ec27-4923-88a9-69225ce3fd5e None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:40.550814 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82e0c5-ec27-4923-88a9-69225ce3fd5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:40.551124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82e0c5-ec27-4923-88a9-69225ce3fd5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:40.552553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82e0c5-ec27-4923-88a9-69225ce3fd5e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:40.571040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 497/981] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:40.576448 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec08457-1ef6-4b8f-914f-d4107b4ddc86 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:40.684947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec08457-1ef6-4b8f-914f-d4107b4ddc86 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:40.723055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c54ca-7f90-40fa-ad31-2784fa196222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:40.723706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c54ca-7f90-40fa-ad31-2784fa196222 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:40.724007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c54ca-7f90-40fa-ad31-2784fa196222 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:40.724253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c54ca-7f90-40fa-ad31-2784fa196222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:40.725080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c54ca-7f90-40fa-ad31-2784fa196222 None admin] RBAC: Adding query filter params (role.id=ac51b321f0034a93ad0913c0302cdf6f, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=89cb97f51e6b4568a09e83cfbdf9e8c6) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:40.725392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c54ca-7f90-40fa-ad31-2784fa196222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:40.727756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c54ca-7f90-40fa-ad31-2784fa196222 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:40.738747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 485/982] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:40 2022] GET /identity/v3/role_assignments?user.id=89cb97f51e6b4568a09e83cfbdf9e8c6&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=ac51b321f0034a93ad0913c0302cdf6f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:40.745466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eddf98-80db-41e5-bfb4-b74c46118be0 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:40.745822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eddf98-80db-41e5-bfb4-b74c46118be0 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:40.746103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eddf98-80db-41e5-bfb4-b74c46118be0 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:40.747760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 498/983] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:40.753579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514f757-2f88-4578-8b32-0a2849025ccc None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:40.753872 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514f757-2f88-4578-8b32-0a2849025ccc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:40.754155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514f757-2f88-4578-8b32-0a2849025ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:40.774133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4514f757-2f88-4578-8b32-0a2849025ccc None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:40.775404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4514f757-2f88-4578-8b32-0a2849025ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:40.809902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:40.858698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 486/984] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:40.878650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eddf98-80db-41e5-bfb4-b74c46118be0 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:40.990360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eddf98-80db-41e5-bfb4-b74c46118be0 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:41.027183 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21e10c-c100-4087-95c6-c6ca5ce6d512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:41.027979 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e10c-c100-4087-95c6-c6ca5ce6d512 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:41.028265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e10c-c100-4087-95c6-c6ca5ce6d512 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:41.028544 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e10c-c100-4087-95c6-c6ca5ce6d512 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:41.029198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21e10c-c100-4087-95c6-c6ca5ce6d512 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:41.030571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21e10c-c100-4087-95c6-c6ca5ce6d512 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-ae21e10c-c100-4087-95c6-c6ca5ce6d512 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:41.043898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:41.045033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:41.045894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 499/985] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:41.052514 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514f757-2f88-4578-8b32-0a2849025ccc None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:41.063910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3a1fc-ead8-4c65-a2ed-cd773c48a694 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:41.064566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3a1fc-ead8-4c65-a2ed-cd773c48a694 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:41.064855 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3a1fc-ead8-4c65-a2ed-cd773c48a694 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:41.066554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 500/986] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:03:41.072357 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161344b-93d1-4375-8bfc-a4a69349980c None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:41.072643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161344b-93d1-4375-8bfc-a4a69349980c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:41.072921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161344b-93d1-4375-8bfc-a4a69349980c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:41.099281 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e161344b-93d1-4375-8bfc-a4a69349980c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:41.100654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e161344b-93d1-4375-8bfc-a4a69349980c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:41.125292 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:41.166597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514f757-2f88-4578-8b32-0a2849025ccc None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:41.175675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 501/987] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:41.200244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161344b-93d1-4375-8bfc-a4a69349980c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:41.208695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a69cb8-b6e5-45f7-8070-4059f5263302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:41.209608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a69cb8-b6e5-45f7-8070-4059f5263302 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:41.210779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a69cb8-b6e5-45f7-8070-4059f5263302 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:41.211241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a69cb8-b6e5-45f7-8070-4059f5263302 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:41.212126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a69cb8-b6e5-45f7-8070-4059f5263302 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:41.212620 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a69cb8-b6e5-45f7-8070-4059f5263302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:41.214046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a69cb8-b6e5-45f7-8070-4059f5263302 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:41.219170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 487/988] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:41.224357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a69cb8-b6e5-45f7-8070-4059f5263302 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:41.262095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:41.310409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161344b-93d1-4375-8bfc-a4a69349980c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:41.339202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a69cb8-b6e5-45f7-8070-4059f5263302 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:41.347118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb87372-3c18-4ae7-bad6-cb8919e8f195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:41.347686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb87372-3c18-4ae7-bad6-cb8919e8f195 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:41.347961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb87372-3c18-4ae7-bad6-cb8919e8f195 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:41.348227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb87372-3c18-4ae7-bad6-cb8919e8f195 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:41.348877 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb87372-3c18-4ae7-bad6-cb8919e8f195 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:41.350239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb87372-3c18-4ae7-bad6-cb8919e8f195 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-3cb87372-3c18-4ae7-bad6-cb8919e8f195 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:41.363424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:41.364660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:41.365506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:41.370146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 502/989] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 08:03:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:41.371016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb87372-3c18-4ae7-bad6-cb8919e8f195 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:41.382423 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef183c-329b-45c8-b140-685bde863f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:41.383119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef183c-329b-45c8-b140-685bde863f26 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:41.383406 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef183c-329b-45c8-b140-685bde863f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:41.383695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef183c-329b-45c8-b140-685bde863f26 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:41.384390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef183c-329b-45c8-b140-685bde863f26 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:41.384697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef183c-329b-45c8-b140-685bde863f26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:41.386066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef183c-329b-45c8-b140-685bde863f26 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:41.391670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 488/990] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:41.398141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef183c-329b-45c8-b140-685bde863f26 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:41.403737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:41.484541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb87372-3c18-4ae7-bad6-cb8919e8f195 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:41.503676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:41.512182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef183c-329b-45c8-b140-685bde863f26 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:41.523493 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea7283-46e5-486c-8f14-3667c6fd951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:41.524147 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea7283-46e5-486c-8f14-3667c6fd951e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:41.524428 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea7283-46e5-486c-8f14-3667c6fd951e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:41.524705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea7283-46e5-486c-8f14-3667c6fd951e None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:41.525404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea7283-46e5-486c-8f14-3667c6fd951e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:41.525706 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea7283-46e5-486c-8f14-3667c6fd951e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:41.527097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea7283-46e5-486c-8f14-3667c6fd951e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:41.532187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 503/991] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 08:03:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:41.537419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea7283-46e5-486c-8f14-3667c6fd951e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:41.549997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eff9b-17ae-42a7-8978-360b530e8487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:41.550802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eff9b-17ae-42a7-8978-360b530e8487 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:41.550979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eff9b-17ae-42a7-8978-360b530e8487 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:41.551242 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eff9b-17ae-42a7-8978-360b530e8487 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:41.552029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eff9b-17ae-42a7-8978-360b530e8487 None admin] RBAC: Adding query filter params (interface=public, service_id=d7e0b86db55745ffbde7f8f171af2eb1, region_id=RegionOne) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:41.552345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eff9b-17ae-42a7-8978-360b530e8487 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:41.553786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eff9b-17ae-42a7-8978-360b530e8487 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:41.559476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 489/992] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 08:03:41 2022] GET /identity/v3/endpoints?service_id=d7e0b86db55745ffbde7f8f171af2eb1&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:41.564581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eff9b-17ae-42a7-8978-360b530e8487 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:41.641118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:41.661545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea7283-46e5-486c-8f14-3667c6fd951e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:41.672592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eff9b-17ae-42a7-8978-360b530e8487 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:41.699805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296acee9-63a1-473e-abe8-b4c06f182957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:41.700474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296acee9-63a1-473e-abe8-b4c06f182957 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:41.700758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296acee9-63a1-473e-abe8-b4c06f182957 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:41.701039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296acee9-63a1-473e-abe8-b4c06f182957 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:41.701743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296acee9-63a1-473e-abe8-b4c06f182957 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:41.702046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296acee9-63a1-473e-abe8-b4c06f182957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:41.703578 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296acee9-63a1-473e-abe8-b4c06f182957 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:41.708553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 504/993] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 08:03:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:41.710902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e14d6-432e-440d-bf18-27443406ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:41.711585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e14d6-432e-440d-bf18-27443406ef51 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:41.711872 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e14d6-432e-440d-bf18-27443406ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:41.712147 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e14d6-432e-440d-bf18-27443406ef51 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:41.712820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e14d6-432e-440d-bf18-27443406ef51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:41.714318 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e14d6-432e-440d-bf18-27443406ef51 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:41.715333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296acee9-63a1-473e-abe8-b4c06f182957 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:41.720792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 490/994] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 08:03:41 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:03:41.832525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296acee9-63a1-473e-abe8-b4c06f182957 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:41.869866 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8051d-1600-46a9-a5b4-01713fa76230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:41.870523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8051d-1600-46a9-a5b4-01713fa76230 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:41.870833 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8051d-1600-46a9-a5b4-01713fa76230 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:41.871113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8051d-1600-46a9-a5b4-01713fa76230 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:41.871917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8051d-1600-46a9-a5b4-01713fa76230 None admin] RBAC: Adding query filter params (interface=admin, service_id=9a9e21cc78314e7bbaf1959c93904f90, region_id=RegionOne) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:41.872222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8051d-1600-46a9-a5b4-01713fa76230 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:41.873587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8051d-1600-46a9-a5b4-01713fa76230 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:41.883118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 505/995] 10.222.0.36 () {56 vars in 1249 bytes} [Tue Jun 21 08:03:41 2022] GET /identity/v3/endpoints?service_id=9a9e21cc78314e7bbaf1959c93904f90&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:41.888786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e14d6-432e-440d-bf18-27443406ef51 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:41.916392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:41.996882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e14d6-432e-440d-bf18-27443406ef51 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:42.031213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe18c1f-ad87-4f88-b73c-45705b08484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:42.031863 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18c1f-ad87-4f88-b73c-45705b08484b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:42.032142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18c1f-ad87-4f88-b73c-45705b08484b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:42.032414 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18c1f-ad87-4f88-b73c-45705b08484b None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:42.033086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe18c1f-ad87-4f88-b73c-45705b08484b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:42.034434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe18c1f-ad87-4f88-b73c-45705b08484b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:42.041036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 491/996] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 08:03:41 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:03:42.939701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d300c-3114-4621-ae1e-ba513c85ea26 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:42.940212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d300c-3114-4621-ae1e-ba513c85ea26 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:42.940518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d300c-3114-4621-ae1e-ba513c85ea26 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:42.942644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 506/997] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:42.951510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5f79-fd25-4155-8e7a-495967d2ed05 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:42.952036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5f79-fd25-4155-8e7a-495967d2ed05 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:42.952240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5f79-fd25-4155-8e7a-495967d2ed05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:42.970049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-26ab5f79-fd25-4155-8e7a-495967d2ed05 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:42.971283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-26ab5f79-fd25-4155-8e7a-495967d2ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:43.056117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 492/998] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:43.082236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d300c-3114-4621-ae1e-ba513c85ea26 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:43.106476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:43.214830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d300c-3114-4621-ae1e-ba513c85ea26 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:43.251154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c70dc-e489-4f19-aa2d-b7c53f1d9ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:43.251941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c70dc-e489-4f19-aa2d-b7c53f1d9ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:43.252224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c70dc-e489-4f19-aa2d-b7c53f1d9ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:43.252500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c70dc-e489-4f19-aa2d-b7c53f1d9ea1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:43.253154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c70dc-e489-4f19-aa2d-b7c53f1d9ea1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:43.254525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c70dc-e489-4f19-aa2d-b7c53f1d9ea1 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-ea6c70dc-e489-4f19-aa2d-b7c53f1d9ea1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:43.266070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:43.267032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 08:03:43.267890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:43.270967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 507/999] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Jun 21 08:03:43 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:43.273612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab5f79-fd25-4155-8e7a-495967d2ed05 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:43.292939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:43.376784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab5f79-fd25-4155-8e7a-495967d2ed05 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:43.422215 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e280d1-022f-4e96-b628-d717b7d730c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:43.422915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e280d1-022f-4e96-b628-d717b7d730c1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:43.423201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e280d1-022f-4e96-b628-d717b7d730c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:43.423475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e280d1-022f-4e96-b628-d717b7d730c1 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:43.424185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e280d1-022f-4e96-b628-d717b7d730c1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:43.424489 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e280d1-022f-4e96-b628-d717b7d730c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:43.425850 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e280d1-022f-4e96-b628-d717b7d730c1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:43.432163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 493/1000] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:43.437821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c70dc-e489-4f19-aa2d-b7c53f1d9ea1 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:43.533635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:43.557294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c70dc-e489-4f19-aa2d-b7c53f1d9ea1 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:43.595133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee997ed-ed15-47c1-af41-4a72e96bb7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:43.595799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee997ed-ed15-47c1-af41-4a72e96bb7df None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:43.596078 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee997ed-ed15-47c1-af41-4a72e96bb7df None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:43.596350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee997ed-ed15-47c1-af41-4a72e96bb7df None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:43.597050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee997ed-ed15-47c1-af41-4a72e96bb7df None admin] RBAC: Adding query filter params (type=image) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:43.597351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee997ed-ed15-47c1-af41-4a72e96bb7df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:43.598734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee997ed-ed15-47c1-af41-4a72e96bb7df None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:43.610892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 508/1001] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:43.971386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d5216-17eb-4799-805a-aa23461089e2 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:43.971907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d5216-17eb-4799-805a-aa23461089e2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:43.971985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d5216-17eb-4799-805a-aa23461089e2 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:43.973365 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 494/1002] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:43.980905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e542d-644f-4894-a104-6cac18b591fe None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:43.981380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e542d-644f-4894-a104-6cac18b591fe None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:43.981886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e542d-644f-4894-a104-6cac18b591fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:44.000767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-172e542d-644f-4894-a104-6cac18b591fe None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:44.001933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-172e542d-644f-4894-a104-6cac18b591fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:44.071564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 509/1003] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:44.095115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d5216-17eb-4799-805a-aa23461089e2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:44.135842 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948a08c-c96b-4b5b-bf52-abcd490e3e0f None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:44.136175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948a08c-c96b-4b5b-bf52-abcd490e3e0f None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:44.136406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948a08c-c96b-4b5b-bf52-abcd490e3e0f None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:44.137917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 510/1004] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:03:44.142694 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d498-91b7-458f-b58c-6c2c749e26f6 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:44.142985 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d498-91b7-458f-b58c-6c2c749e26f6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:44.143267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d498-91b7-458f-b58c-6c2c749e26f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:44.160240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d743d498-91b7-458f-b58c-6c2c749e26f6 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:44.161424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d743d498-91b7-458f-b58c-6c2c749e26f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:44.183318 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:44.205215 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d5216-17eb-4799-805a-aa23461089e2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:44.234300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 511/1005] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:44.244086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7088f5-be9e-47a9-8ab9-2d3306b655d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:44.244918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7088f5-be9e-47a9-8ab9-2d3306b655d0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:44.245252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7088f5-be9e-47a9-8ab9-2d3306b655d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:44.245481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7088f5-be9e-47a9-8ab9-2d3306b655d0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:44.246230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7088f5-be9e-47a9-8ab9-2d3306b655d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:44.247624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7088f5-be9e-47a9-8ab9-2d3306b655d0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:44.258478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d498-91b7-458f-b58c-6c2c749e26f6 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-ff7088f5-be9e-47a9-8ab9-2d3306b655d0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:44.260435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:44.261446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:44.262304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 495/1006] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:44.264467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:44.267536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7088f5-be9e-47a9-8ab9-2d3306b655d0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:44.372022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d498-91b7-458f-b58c-6c2c749e26f6 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:44.378434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7088f5-be9e-47a9-8ab9-2d3306b655d0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:44.408076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd7967-7838-4048-854c-c80f16bd37ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:44.408891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd7967-7838-4048-854c-c80f16bd37ce None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:44.409209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd7967-7838-4048-854c-c80f16bd37ce None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:44.409438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd7967-7838-4048-854c-c80f16bd37ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:44.410088 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd7967-7838-4048-854c-c80f16bd37ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:44.411478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd7967-7838-4048-854c-c80f16bd37ce None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:44.412502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582a4fc-32bb-4984-88a6-9d0ec4f4969a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:44.413698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582a4fc-32bb-4984-88a6-9d0ec4f4969a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:44.413980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582a4fc-32bb-4984-88a6-9d0ec4f4969a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:44.414253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582a4fc-32bb-4984-88a6-9d0ec4f4969a None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:44.414986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582a4fc-32bb-4984-88a6-9d0ec4f4969a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:44.415288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582a4fc-32bb-4984-88a6-9d0ec4f4969a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:44.416627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582a4fc-32bb-4984-88a6-9d0ec4f4969a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:44.421541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 496/1007] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-56fd7967-7838-4048-854c-c80f16bd37ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:44.424249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:44.425227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:44.431497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 512/1008] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 08:03:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:44.432307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582a4fc-32bb-4984-88a6-9d0ec4f4969a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:44.432379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd7967-7838-4048-854c-c80f16bd37ce None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:44.441894 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:44.498403 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:44.536467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd7967-7838-4048-854c-c80f16bd37ce None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:44.536822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582a4fc-32bb-4984-88a6-9d0ec4f4969a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:44.570343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25020348-9aff-4631-b167-d4a34d136e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:44.571031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25020348-9aff-4631-b167-d4a34d136e23 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:44.571314 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25020348-9aff-4631-b167-d4a34d136e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:44.571588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25020348-9aff-4631-b167-d4a34d136e23 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:44.572291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25020348-9aff-4631-b167-d4a34d136e23 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:44.572596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25020348-9aff-4631-b167-d4a34d136e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:44.573966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25020348-9aff-4631-b167-d4a34d136e23 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:44.579044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 497/1009] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 08:03:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:44.585107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25020348-9aff-4631-b167-d4a34d136e23 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:44.588361 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737e096-b0f9-42c9-8d4e-473ee3648ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:44.589246 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737e096-b0f9-42c9-8d4e-473ee3648ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:44.589717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737e096-b0f9-42c9-8d4e-473ee3648ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:44.590167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737e096-b0f9-42c9-8d4e-473ee3648ca3 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:44.591089 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737e096-b0f9-42c9-8d4e-473ee3648ca3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:44.591586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737e096-b0f9-42c9-8d4e-473ee3648ca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:44.593133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737e096-b0f9-42c9-8d4e-473ee3648ca3 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:44.598526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 513/1010] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 08:03:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:44.604123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737e096-b0f9-42c9-8d4e-473ee3648ca3 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:44.661587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:44.694681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25020348-9aff-4631-b167-d4a34d136e23 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:44.718598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737e096-b0f9-42c9-8d4e-473ee3648ca3 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:44.730231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5f12-7d7c-4ec9-b120-82f43541db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:44.730934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5f12-7d7c-4ec9-b120-82f43541db3b None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:44.731213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5f12-7d7c-4ec9-b120-82f43541db3b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:44.731486 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5f12-7d7c-4ec9-b120-82f43541db3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:44.732245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5f12-7d7c-4ec9-b120-82f43541db3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:44.733659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5f12-7d7c-4ec9-b120-82f43541db3b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:44.753686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:44.766652 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 498/1011] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 08:03:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:03:44.774129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348c767-3435-4925-b780-dc0239141ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:44.774973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c767-3435-4925-b780-dc0239141ace None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:44.775331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c767-3435-4925-b780-dc0239141ace None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:44.775686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c767-3435-4925-b780-dc0239141ace None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:44.776503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348c767-3435-4925-b780-dc0239141ace None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:44.776888 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348c767-3435-4925-b780-dc0239141ace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:44.778404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348c767-3435-4925-b780-dc0239141ace None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:44.784691 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 514/1012] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 08:03:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:44.791030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5f12-7d7c-4ec9-b120-82f43541db3b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:44.901411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5f12-7d7c-4ec9-b120-82f43541db3b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:44.930115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:44.942120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75d7b9-c613-41e2-be21-c1667b86411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:44.942810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75d7b9-c613-41e2-be21-c1667b86411b None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:44.943094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75d7b9-c613-41e2-be21-c1667b86411b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:44.943373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75d7b9-c613-41e2-be21-c1667b86411b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:44.944892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75d7b9-c613-41e2-be21-c1667b86411b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:44.946320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75d7b9-c613-41e2-be21-c1667b86411b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:44.962276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 499/1013] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 08:03:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:03:45.698011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ea81-f1ec-40a9-bc40-fcf1884c24c6 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:45.698529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ea81-f1ec-40a9-bc40-fcf1884c24c6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:45.698607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ea81-f1ec-40a9-bc40-fcf1884c24c6 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:45.700150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 515/1014] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:45.705052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7559-cc61-4ae6-a772-9f1628825a00 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:45.705451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7559-cc61-4ae6-a772-9f1628825a00 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:45.705613 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7559-cc61-4ae6-a772-9f1628825a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:45.722426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-87bf7559-cc61-4ae6-a772-9f1628825a00 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:45.723651 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-87bf7559-cc61-4ae6-a772-9f1628825a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:45.796135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 500/1015] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:45 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:45.819576 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816ea81-f1ec-40a9-bc40-fcf1884c24c6 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:45.921470 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816ea81-f1ec-40a9-bc40-fcf1884c24c6 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:45.957716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557efa0-6319-47d2-9f62-a72ec4eabf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:45.958381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557efa0-6319-47d2-9f62-a72ec4eabf95 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:45.958761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557efa0-6319-47d2-9f62-a72ec4eabf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:45.958971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557efa0-6319-47d2-9f62-a72ec4eabf95 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:45.960257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557efa0-6319-47d2-9f62-a72ec4eabf95 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:45.961809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557efa0-6319-47d2-9f62-a72ec4eabf95 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:45.976872 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 516/1016] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:03:45 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:46.989730 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b4c8-49d7-4b63-bd23-0ac4bab38231 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:46.990273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b4c8-49d7-4b63-bd23-0ac4bab38231 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:46.990273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b4c8-49d7-4b63-bd23-0ac4bab38231 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:46.992827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 501/1017] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:46.998110 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415d8b-c298-489b-953a-50380df039ad None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:46.998498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415d8b-c298-489b-953a-50380df039ad None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:46.998706 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415d8b-c298-489b-953a-50380df039ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:47.016257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-13415d8b-c298-489b-953a-50380df039ad None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:47.017434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-13415d8b-c298-489b-953a-50380df039ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:47.060280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeff0e-2f1a-4026-b14b-cb2d248fade9 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:47.060623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeff0e-2f1a-4026-b14b-cb2d248fade9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:47.060855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeff0e-2f1a-4026-b14b-cb2d248fade9 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:47.062365 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 502/1018] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:03:47.067266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced84a4-1c03-4fce-b2b5-923c319950db None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:47.067557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced84a4-1c03-4fce-b2b5-923c319950db None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:47.067841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced84a4-1c03-4fce-b2b5-923c319950db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:47.070646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:47.085990 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9ced84a4-1c03-4fce-b2b5-923c319950db None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:47.087238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9ced84a4-1c03-4fce-b2b5-923c319950db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:47.103426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 517/1019] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:47.127705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415d8b-c298-489b-953a-50380df039ad None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:47.160669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 503/1020] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:47.183983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced84a4-1c03-4fce-b2b5-923c319950db None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:47.231501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:47.232212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415d8b-c298-489b-953a-50380df039ad None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:47.271919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10d2fa-7499-46b0-857e-7daeee3d918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:47.272704 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d2fa-7499-46b0-857e-7daeee3d918a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:47.272989 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d2fa-7499-46b0-857e-7daeee3d918a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:47.273268 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10d2fa-7499-46b0-857e-7daeee3d918a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:47.283501 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10d2fa-7499-46b0-857e-7daeee3d918a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:47.288758 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced84a4-1c03-4fce-b2b5-923c319950db None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-3f10d2fa-7499-46b0-857e-7daeee3d918a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:47.292174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:47.293098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:47.293969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 518/1021] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 21 08:03:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:47.299131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10d2fa-7499-46b0-857e-7daeee3d918a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:47.326202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a8ef2-15bb-4960-8466-06dc1ba5be77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:47.327001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a8ef2-15bb-4960-8466-06dc1ba5be77 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:47.327290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a8ef2-15bb-4960-8466-06dc1ba5be77 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:47.327568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a8ef2-15bb-4960-8466-06dc1ba5be77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:47.328745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a8ef2-15bb-4960-8466-06dc1ba5be77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:47.330175 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a8ef2-15bb-4960-8466-06dc1ba5be77 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:47.331975 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 504/1022] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:47.336001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:47.337835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a8ef2-15bb-4960-8466-06dc1ba5be77 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:47.408426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10d2fa-7499-46b0-857e-7daeee3d918a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:47.445992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af6030-ffd6-4db6-8532-05a141dc5945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:47.446688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af6030-ffd6-4db6-8532-05a141dc5945 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:47.446980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af6030-ffd6-4db6-8532-05a141dc5945 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:47.447252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af6030-ffd6-4db6-8532-05a141dc5945 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:47.448040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af6030-ffd6-4db6-8532-05a141dc5945 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:47.448348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af6030-ffd6-4db6-8532-05a141dc5945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:47.449714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a8ef2-15bb-4960-8466-06dc1ba5be77 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:47.449852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af6030-ffd6-4db6-8532-05a141dc5945 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:47.458282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 519/1023] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 08:03:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:47.464515 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af6030-ffd6-4db6-8532-05a141dc5945 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:47.470280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:47.493770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55be9bd-e8b1-46ad-adc4-5d8ac959ece2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:47.494424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55be9bd-e8b1-46ad-adc4-5d8ac959ece2 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:47.494736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55be9bd-e8b1-46ad-adc4-5d8ac959ece2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:47.495020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55be9bd-e8b1-46ad-adc4-5d8ac959ece2 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:47.495717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55be9bd-e8b1-46ad-adc4-5d8ac959ece2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:47.497156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55be9bd-e8b1-46ad-adc4-5d8ac959ece2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:47.524029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 505/1024] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:03:47 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:03:47.583347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:47.588831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af6030-ffd6-4db6-8532-05a141dc5945 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:47.628124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef2e36-9def-439a-9600-a543256fadd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:47.629133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef2e36-9def-439a-9600-a543256fadd5 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:47.629424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef2e36-9def-439a-9600-a543256fadd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:47.629700 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef2e36-9def-439a-9600-a543256fadd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:47.642064 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef2e36-9def-439a-9600-a543256fadd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:47.643568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef2e36-9def-439a-9600-a543256fadd5 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-29ef2e36-9def-439a-9600-a543256fadd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:47.663643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:47.664703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:47.665582 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:47.665582 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:47.665582 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:47.665582 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:47.666953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 520/1025] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:47.670695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55be9bd-e8b1-46ad-adc4-5d8ac959ece2 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:47.779834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55be9bd-e8b1-46ad-adc4-5d8ac959ece2 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:47.814181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc8384-ff20-4e4f-83c0-3dbbb23855f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:47.814889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc8384-ff20-4e4f-83c0-3dbbb23855f5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:47.815176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc8384-ff20-4e4f-83c0-3dbbb23855f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:47.815453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc8384-ff20-4e4f-83c0-3dbbb23855f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:47.816174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc8384-ff20-4e4f-83c0-3dbbb23855f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:47.816481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc8384-ff20-4e4f-83c0-3dbbb23855f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:47.817850 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc8384-ff20-4e4f-83c0-3dbbb23855f5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:47.834285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 506/1026] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:47.836070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef2e36-9def-439a-9600-a543256fadd5 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:47.939374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef2e36-9def-439a-9600-a543256fadd5 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:47.976944 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62e5ee-05fb-440a-9267-b1ca158627b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:47.977902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62e5ee-05fb-440a-9267-b1ca158627b4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:47.978338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62e5ee-05fb-440a-9267-b1ca158627b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:47.978748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62e5ee-05fb-440a-9267-b1ca158627b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:47.987422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62e5ee-05fb-440a-9267-b1ca158627b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:47.989287 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62e5ee-05fb-440a-9267-b1ca158627b4 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-2c62e5ee-05fb-440a-9267-b1ca158627b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:48.004248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:48.005643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:48.011210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:48.011210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:48.011210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:48.011210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:48.011210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:48.011210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:48.011210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:48.011210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:48.011210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:03:48.011210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:48.011210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 521/1027] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 08:03:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:48.014010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc8384-ff20-4e4f-83c0-3dbbb23855f5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:48.029594 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e08c4-4ab5-4028-b5ec-30fab121d0aa None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:48.029954 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e08c4-4ab5-4028-b5ec-30fab121d0aa None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:48.030271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e08c4-4ab5-4028-b5ec-30fab121d0aa None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:48.031782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 522/1028] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:03:48.036395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87804831-8d68-455e-a0cf-083a54fbdad4 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:48.036679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87804831-8d68-455e-a0cf-083a54fbdad4 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:48.036949 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87804831-8d68-455e-a0cf-083a54fbdad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:48.041978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:48.054384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-87804831-8d68-455e-a0cf-083a54fbdad4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:48.056176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-87804831-8d68-455e-a0cf-083a54fbdad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:48.059198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:48.127493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc8384-ff20-4e4f-83c0-3dbbb23855f5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:48.132408 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 523/1029] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:48.155073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87804831-8d68-455e-a0cf-083a54fbdad4 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:48.163360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791e293-da5b-4520-8785-9d050e98164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:48.164023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791e293-da5b-4520-8785-9d050e98164d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:48.164304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791e293-da5b-4520-8785-9d050e98164d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:48.164586 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791e293-da5b-4520-8785-9d050e98164d None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:48.165425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791e293-da5b-4520-8785-9d050e98164d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:48.165734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791e293-da5b-4520-8785-9d050e98164d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:48.167195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791e293-da5b-4520-8785-9d050e98164d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:48.184901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 507/1030] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 08:03:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:48.190230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791e293-da5b-4520-8785-9d050e98164d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:48.263513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87804831-8d68-455e-a0cf-083a54fbdad4 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:48.277018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:48.298922 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791e293-da5b-4520-8785-9d050e98164d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:48.304694 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32794659-1c89-4dda-bd5b-9c156904a479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:48.305484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32794659-1c89-4dda-bd5b-9c156904a479 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:48.305769 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32794659-1c89-4dda-bd5b-9c156904a479 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:48.306048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32794659-1c89-4dda-bd5b-9c156904a479 None admin] PATH_INFO: `/v3/services/image` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:48.306740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32794659-1c89-4dda-bd5b-9c156904a479 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:48.308123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32794659-1c89-4dda-bd5b-9c156904a479 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-32794659-1c89-4dda-bd5b-9c156904a479 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:48.320302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:48.321304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:48.322323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 524/1031] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Jun 21 08:03:48 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:48.327433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32794659-1c89-4dda-bd5b-9c156904a479 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:48.331948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:48.339864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd3fca-bdd2-4a1d-b82c-90696d61a7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:48.340503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd3fca-bdd2-4a1d-b82c-90696d61a7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:48.340786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd3fca-bdd2-4a1d-b82c-90696d61a7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:48.341062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd3fca-bdd2-4a1d-b82c-90696d61a7b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:48.414146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd3fca-bdd2-4a1d-b82c-90696d61a7b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:48.415898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd3fca-bdd2-4a1d-b82c-90696d61a7b1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:48.434924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32794659-1c89-4dda-bd5b-9c156904a479 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:48.474084 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cd49c-4ad2-478d-af7e-68d4a8f8c29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:48.475570 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cd49c-4ad2-478d-af7e-68d4a8f8c29e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:48.475881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cd49c-4ad2-478d-af7e-68d4a8f8c29e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:48.476118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cd49c-4ad2-478d-af7e-68d4a8f8c29e None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:48.476824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cd49c-4ad2-478d-af7e-68d4a8f8c29e None admin] RBAC: Adding query filter params (name=image) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:48.477127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cd49c-4ad2-478d-af7e-68d4a8f8c29e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:48.478497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cd49c-4ad2-478d-af7e-68d4a8f8c29e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:48.483748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 525/1032] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:48.489094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cd49c-4ad2-478d-af7e-68d4a8f8c29e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:48.513717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:48.540837 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 508/1033] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:48 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 08:03:48.541651 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd3fca-bdd2-4a1d-b82c-90696d61a7b1 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:48.556956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:48.593103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cd49c-4ad2-478d-af7e-68d4a8f8c29e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:48.629258 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635bb33-feb4-46de-a0e8-cca70f730c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:48.629920 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635bb33-feb4-46de-a0e8-cca70f730c89 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:48.630205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635bb33-feb4-46de-a0e8-cca70f730c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:48.630537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635bb33-feb4-46de-a0e8-cca70f730c89 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:48.631304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635bb33-feb4-46de-a0e8-cca70f730c89 None admin] RBAC: Adding query filter params (type=image) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:48.631645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635bb33-feb4-46de-a0e8-cca70f730c89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:48.633015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635bb33-feb4-46de-a0e8-cca70f730c89 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:48.638042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 526/1034] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:48.643838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635bb33-feb4-46de-a0e8-cca70f730c89 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:48.667602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd3fca-bdd2-4a1d-b82c-90696d61a7b1 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:48.704252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b711a-e8c6-4b6a-96ae-8ec78c90cf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:48.705058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b711a-e8c6-4b6a-96ae-8ec78c90cf59 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:48.705339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b711a-e8c6-4b6a-96ae-8ec78c90cf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:48.705614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b711a-e8c6-4b6a-96ae-8ec78c90cf59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:48.717676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b711a-e8c6-4b6a-96ae-8ec78c90cf59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:48.719165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b711a-e8c6-4b6a-96ae-8ec78c90cf59 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-7c1b711a-e8c6-4b6a-96ae-8ec78c90cf59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:48.738192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:48.739825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:48.742330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:48.742330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:48.742330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:48.742330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:48.742330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 509/1035] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:48.745887 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b711a-e8c6-4b6a-96ae-8ec78c90cf59 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:48.753310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635bb33-feb4-46de-a0e8-cca70f730c89 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:48.780964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:48.788788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:48.794780 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba008f-da60-4ae7-82b6-ad5c696852f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:48.795512 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba008f-da60-4ae7-82b6-ad5c696852f7 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:48.795714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba008f-da60-4ae7-82b6-ad5c696852f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:48.795988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba008f-da60-4ae7-82b6-ad5c696852f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:48.796776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba008f-da60-4ae7-82b6-ad5c696852f7 None admin] RBAC: Adding query filter params (interface=public, service_id=4eefb90ab8aa489c8021ee2da9bea52b, region_id=RegionOne) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:48.797087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba008f-da60-4ae7-82b6-ad5c696852f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:48.798451 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba008f-da60-4ae7-82b6-ad5c696852f7 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:48.809773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 527/1036] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 08:03:48 2022] GET /identity/v3/endpoints?service_id=4eefb90ab8aa489c8021ee2da9bea52b&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:48.810387 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba008f-da60-4ae7-82b6-ad5c696852f7 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:48.853833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b711a-e8c6-4b6a-96ae-8ec78c90cf59 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:48.890822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fd091-d953-47a6-8da8-d1869c73413b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:48.891481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fd091-d953-47a6-8da8-d1869c73413b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:48.891762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fd091-d953-47a6-8da8-d1869c73413b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:48.892036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fd091-d953-47a6-8da8-d1869c73413b None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:48.892753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fd091-d953-47a6-8da8-d1869c73413b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:48.893056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fd091-d953-47a6-8da8-d1869c73413b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:48.894412 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fd091-d953-47a6-8da8-d1869c73413b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:48.910744 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 510/1037] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:48.911723 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fd091-d953-47a6-8da8-d1869c73413b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:48.923516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba008f-da60-4ae7-82b6-ad5c696852f7 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:48.962293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa48eed-6924-4c6c-8d69-318ab808484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:48.963135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa48eed-6924-4c6c-8d69-318ab808484b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:48.963420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa48eed-6924-4c6c-8d69-318ab808484b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:48.963697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa48eed-6924-4c6c-8d69-318ab808484b None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:48.964380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa48eed-6924-4c6c-8d69-318ab808484b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:48.965735 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa48eed-6924-4c6c-8d69-318ab808484b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:48.972620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 528/1038] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 08:03:48 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:03:49.019842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:49.029309 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fd091-d953-47a6-8da8-d1869c73413b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:49.067591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e408a64-e3fb-4f40-83e1-a0ec38108d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:49.068313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e408a64-e3fb-4f40-83e1-a0ec38108d3c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:49.068603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e408a64-e3fb-4f40-83e1-a0ec38108d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:49.069600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e408a64-e3fb-4f40-83e1-a0ec38108d3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:49.077518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e408a64-e3fb-4f40-83e1-a0ec38108d3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:49.079021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e408a64-e3fb-4f40-83e1-a0ec38108d3c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-8e408a64-e3fb-4f40-83e1-a0ec38108d3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:49.094552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:49.095523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:49.096405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:49.096405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:49.096405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:49.096405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:49.096405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:49.096405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:49.096405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:49.096405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:49.099059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 511/1039] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:49.102156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa48eed-6924-4c6c-8d69-318ab808484b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:49.172435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:49.215681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa48eed-6924-4c6c-8d69-318ab808484b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:49.251707 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf8475-9e9d-4047-afa5-e3d09f7a000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:49.252424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf8475-9e9d-4047-afa5-e3d09f7a000d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:49.252712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf8475-9e9d-4047-afa5-e3d09f7a000d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:49.252990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf8475-9e9d-4047-afa5-e3d09f7a000d None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:49.253777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf8475-9e9d-4047-afa5-e3d09f7a000d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:49.254087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf8475-9e9d-4047-afa5-e3d09f7a000d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:49.255676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf8475-9e9d-4047-afa5-e3d09f7a000d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:49.268190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 529/1040] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:49.274602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e408a64-e3fb-4f40-83e1-a0ec38108d3c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:49.376962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e408a64-e3fb-4f40-83e1-a0ec38108d3c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:49.411292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75a336-fdba-466f-b277-322051434415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:49.411935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75a336-fdba-466f-b277-322051434415 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:49.412212 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75a336-fdba-466f-b277-322051434415 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:49.412511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75a336-fdba-466f-b277-322051434415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:49.413464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75a336-fdba-466f-b277-322051434415 None admin] RBAC: Adding query filter params (role.id=ac51b321f0034a93ad0913c0302cdf6f, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=c0956402a9bb4a9384111b36d5251749) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:49.413774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75a336-fdba-466f-b277-322051434415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:49.415327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75a336-fdba-466f-b277-322051434415 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:49.426711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 512/1041] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:49 2022] GET /identity/v3/role_assignments?user.id=c0956402a9bb4a9384111b36d5251749&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=ac51b321f0034a93ad0913c0302cdf6f => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:49.638512 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3472718-9069-484c-a2b8-f04f098430bb None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:49.638832 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3472718-9069-484c-a2b8-f04f098430bb None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:49.639015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3472718-9069-484c-a2b8-f04f098430bb None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:49.640632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 530/1042] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:49.646057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921424-3ca6-4a73-801f-61f1f6b64f09 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:49.646345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921424-3ca6-4a73-801f-61f1f6b64f09 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:49.646650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921424-3ca6-4a73-801f-61f1f6b64f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:49.663815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8f921424-3ca6-4a73-801f-61f1f6b64f09 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:49.664989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8f921424-3ca6-4a73-801f-61f1f6b64f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:49.679640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:49.735477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 513/1043] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:49.765224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3472718-9069-484c-a2b8-f04f098430bb None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:49.873867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3472718-9069-484c-a2b8-f04f098430bb None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:49.894071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:49.909245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f30854-bba6-4100-8b8b-dabca30223c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:49.910026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f30854-bba6-4100-8b8b-dabca30223c1 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:49.910306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f30854-bba6-4100-8b8b-dabca30223c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:49.910576 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f30854-bba6-4100-8b8b-dabca30223c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:49.911781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f30854-bba6-4100-8b8b-dabca30223c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:49.913911 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f30854-bba6-4100-8b8b-dabca30223c1 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:49.915739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 531/1044] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:49.921286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921424-3ca6-4a73-801f-61f1f6b64f09 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:50.021688 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921424-3ca6-4a73-801f-61f1f6b64f09 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:50.057525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a642df-f0b4-4969-8816-0e91720d0705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:50.058202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a642df-f0b4-4969-8816-0e91720d0705 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:50.058486 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a642df-f0b4-4969-8816-0e91720d0705 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:50.058798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a642df-f0b4-4969-8816-0e91720d0705 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:50.059524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a642df-f0b4-4969-8816-0e91720d0705 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:50.060957 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a642df-f0b4-4969-8816-0e91720d0705 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:50.090646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 514/1045] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:03:49 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:03:51.031092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d426c85-18cd-4f7c-bbbf-69fd6bb893c8 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:51.031659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d426c85-18cd-4f7c-bbbf-69fd6bb893c8 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:51.031659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d426c85-18cd-4f7c-bbbf-69fd6bb893c8 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:51.033144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 532/1046] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:51.038830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710e661-8dcf-4db5-bf80-79fbaed399c5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:51.039252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710e661-8dcf-4db5-bf80-79fbaed399c5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:51.039394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710e661-8dcf-4db5-bf80-79fbaed399c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:51.045405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:51.057047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f710e661-8dcf-4db5-bf80-79fbaed399c5 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:51.058390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f710e661-8dcf-4db5-bf80-79fbaed399c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:51.127164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 515/1047] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:51.150896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d426c85-18cd-4f7c-bbbf-69fd6bb893c8 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:51.268123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d426c85-18cd-4f7c-bbbf-69fd6bb893c8 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:51.304520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4a2b0-2cf6-4eb0-bbd3-c7fe4fb49ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:51.305237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4a2b0-2cf6-4eb0-bbd3-c7fe4fb49ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:51.305519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4a2b0-2cf6-4eb0-bbd3-c7fe4fb49ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:51.305794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4a2b0-2cf6-4eb0-bbd3-c7fe4fb49ee4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:51.306448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4a2b0-2cf6-4eb0-bbd3-c7fe4fb49ee4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:51.307847 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4a2b0-2cf6-4eb0-bbd3-c7fe4fb49ee4 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-e7e4a2b0-2cf6-4eb0-bbd3-c7fe4fb49ee4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:51.319981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:51.320995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 08:03:51.321839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:51.326106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 533/1048] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Jun 21 08:03:51 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:51.327125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710e661-8dcf-4db5-bf80-79fbaed399c5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:51.429588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710e661-8dcf-4db5-bf80-79fbaed399c5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:51.464302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9df7d-4b5a-4fbe-9541-6f836133e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:51.464958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9df7d-4b5a-4fbe-9541-6f836133e8db None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:51.465241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9df7d-4b5a-4fbe-9541-6f836133e8db None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:51.465516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9df7d-4b5a-4fbe-9541-6f836133e8db None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:51.466214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9df7d-4b5a-4fbe-9541-6f836133e8db None admin] RBAC: Adding query filter params (name=image) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:51.466516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9df7d-4b5a-4fbe-9541-6f836133e8db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:51.467902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9df7d-4b5a-4fbe-9541-6f836133e8db None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:51.468967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:51.482659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 516/1049] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:51.482659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9df7d-4b5a-4fbe-9541-6f836133e8db None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:51.482912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d496-7d4d-4e79-919d-fb4e842142f8 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:51.482912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d496-7d4d-4e79-919d-fb4e842142f8 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:51.482912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d496-7d4d-4e79-919d-fb4e842142f8 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:51.483346 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 534/1050] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:51.488146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9e2f5-e690-4cdf-8545-369f457d7c68 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:51.488686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9e2f5-e690-4cdf-8545-369f457d7c68 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:51.488962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9e2f5-e690-4cdf-8545-369f457d7c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:51.506763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f7b9e2f5-e690-4cdf-8545-369f457d7c68 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:51.507954 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f7b9e2f5-e690-4cdf-8545-369f457d7c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:51.558687 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:51.586877 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 535/1051] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:51.595364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9df7d-4b5a-4fbe-9541-6f836133e8db None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:51.609899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9e2f5-e690-4cdf-8545-369f457d7c68 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:51.634673 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516afba-00d8-471a-9403-737f75d3541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:51.635339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516afba-00d8-471a-9403-737f75d3541f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:51.635623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516afba-00d8-471a-9403-737f75d3541f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:51.635904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516afba-00d8-471a-9403-737f75d3541f None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:51.636610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516afba-00d8-471a-9403-737f75d3541f None admin] RBAC: Adding query filter params (type=image) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:51.636924 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516afba-00d8-471a-9403-737f75d3541f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:51.638333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516afba-00d8-471a-9403-737f75d3541f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:51.643565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 517/1052] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:51.650576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516afba-00d8-471a-9403-737f75d3541f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:51.719353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9e2f5-e690-4cdf-8545-369f457d7c68 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:51.725994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:51.756707 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb59d93-6897-45bf-b0d3-0cfa82b06101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:51.757513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb59d93-6897-45bf-b0d3-0cfa82b06101 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:51.757788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb59d93-6897-45bf-b0d3-0cfa82b06101 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:51.758062 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb59d93-6897-45bf-b0d3-0cfa82b06101 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:51.769519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb59d93-6897-45bf-b0d3-0cfa82b06101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:51.769758 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516afba-00d8-471a-9403-737f75d3541f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-efb59d93-6897-45bf-b0d3-0cfa82b06101 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:51.779860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:51.781023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:51.781882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 536/1053] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 21 08:03:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:51.786926 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb59d93-6897-45bf-b0d3-0cfa82b06101 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:51.809426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f84e1b-373b-403a-b60e-6e86c1f7a6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:51.810008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f84e1b-373b-403a-b60e-6e86c1f7a6cc None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:51.810294 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f84e1b-373b-403a-b60e-6e86c1f7a6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:51.810573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f84e1b-373b-403a-b60e-6e86c1f7a6cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:51.811345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f84e1b-373b-403a-b60e-6e86c1f7a6cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:51.812708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f84e1b-373b-403a-b60e-6e86c1f7a6cc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:51.833219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 518/1054] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 08:03:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:03:51.836359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:51.903422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb59d93-6897-45bf-b0d3-0cfa82b06101 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:51.946745 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b688a9-37e1-4eff-8994-0346bafedf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:51.947427 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b688a9-37e1-4eff-8994-0346bafedf96 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:51.947714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b688a9-37e1-4eff-8994-0346bafedf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:51.947992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b688a9-37e1-4eff-8994-0346bafedf96 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:51.948756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b688a9-37e1-4eff-8994-0346bafedf96 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:51.949068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b688a9-37e1-4eff-8994-0346bafedf96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:51.950475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b688a9-37e1-4eff-8994-0346bafedf96 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:51.960359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 537/1055] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 08:03:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:51.967202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f84e1b-373b-403a-b60e-6e86c1f7a6cc None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:52.076819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f84e1b-373b-403a-b60e-6e86c1f7a6cc None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:52.094391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:52.113235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd90d85-7b0a-4213-99e1-4bd352d74b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:52.114283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90d85-7b0a-4213-99e1-4bd352d74b1f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:52.114568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90d85-7b0a-4213-99e1-4bd352d74b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:52.114884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90d85-7b0a-4213-99e1-4bd352d74b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:52.125791 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd90d85-7b0a-4213-99e1-4bd352d74b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:52.127276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd90d85-7b0a-4213-99e1-4bd352d74b1f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-1bd90d85-7b0a-4213-99e1-4bd352d74b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:52.144963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:52.145885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:52.147301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:52.147301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:52.147301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:52.147301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:52.147301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 519/1056] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:52.152675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b688a9-37e1-4eff-8994-0346bafedf96 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:52.191173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8435eef-c828-4f7c-a762-a1bb7d3fe6f1 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:52.191493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8435eef-c828-4f7c-a762-a1bb7d3fe6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:52.191738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8435eef-c828-4f7c-a762-a1bb7d3fe6f1 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:52.193254 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 520/1057] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:52.198355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5e519-51a8-4a8b-bfcb-306cd1a286a8 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:52.198675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5e519-51a8-4a8b-bfcb-306cd1a286a8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:52.198945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5e519-51a8-4a8b-bfcb-306cd1a286a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:52.217091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5fa5e519-51a8-4a8b-bfcb-306cd1a286a8 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:52.218276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5fa5e519-51a8-4a8b-bfcb-306cd1a286a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:52.258433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:52.261422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b688a9-37e1-4eff-8994-0346bafedf96 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:52.295576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 521/1058] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:52.301125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdf51d-9826-47ea-aa68-2327fa2ff4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:52.301789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdf51d-9826-47ea-aa68-2327fa2ff4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:52.302069 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdf51d-9826-47ea-aa68-2327fa2ff4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:52.302343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdf51d-9826-47ea-aa68-2327fa2ff4e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:52.303639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdf51d-9826-47ea-aa68-2327fa2ff4e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:52.303954 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdf51d-9826-47ea-aa68-2327fa2ff4e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:52.305410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdf51d-9826-47ea-aa68-2327fa2ff4e9 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:52.317506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 538/1059] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:52.323041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdf51d-9826-47ea-aa68-2327fa2ff4e9 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:52.323323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5e519-51a8-4a8b-bfcb-306cd1a286a8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:52.428562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:52.428736 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdf51d-9826-47ea-aa68-2327fa2ff4e9 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:52.432183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5e519-51a8-4a8b-bfcb-306cd1a286a8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:52.465710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8e5f8-15ff-4f88-b954-8748a0eeb4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:52.466491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8e5f8-15ff-4f88-b954-8748a0eeb4be None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:52.466804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8e5f8-15ff-4f88-b954-8748a0eeb4be None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:52.467077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8e5f8-15ff-4f88-b954-8748a0eeb4be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:52.468685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b121-48a0-4c04-a67d-d33f5e931f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:52.469453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b121-48a0-4c04-a67d-d33f5e931f6e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:52.469720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b121-48a0-4c04-a67d-d33f5e931f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:52.470138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b121-48a0-4c04-a67d-d33f5e931f6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:52.477928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95b121-48a0-4c04-a67d-d33f5e931f6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:52.478717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8e5f8-15ff-4f88-b954-8748a0eeb4be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:52.479437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95b121-48a0-4c04-a67d-d33f5e931f6e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-2aa8e5f8-15ff-4f88-b954-8748a0eeb4be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:52.486342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:52.487272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:52.488184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 539/1060] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:52.494720 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8e5f8-15ff-4f88-b954-8748a0eeb4be None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-9b95b121-48a0-4c04-a67d-d33f5e931f6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:52.494931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:52.495825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:52.496766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:52.496766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:52.496766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:52.496766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:52.496766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:52.496766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:52.496766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:52.496766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:52.496766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:03:52.496766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:52.496766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 522/1061] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 08:03:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:52.501432 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b121-48a0-4c04-a67d-d33f5e931f6e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:52.523669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:52.608690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8e5f8-15ff-4f88-b954-8748a0eeb4be None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:52.616505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b121-48a0-4c04-a67d-d33f5e931f6e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:52.648677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6142e-1071-4835-85cb-c1bb13dca5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:52.649376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6142e-1071-4835-85cb-c1bb13dca5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:52.649611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6142e-1071-4835-85cb-c1bb13dca5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:52.649882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6142e-1071-4835-85cb-c1bb13dca5d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:52.650655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6142e-1071-4835-85cb-c1bb13dca5d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:52.651449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6142e-1071-4835-85cb-c1bb13dca5d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:52.652856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6142e-1071-4835-85cb-c1bb13dca5d6 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:52.656266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ac63f-679c-4837-9e15-feb2f4a846ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:52.656934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ac63f-679c-4837-9e15-feb2f4a846ec None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:52.657218 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ac63f-679c-4837-9e15-feb2f4a846ec None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:52.657495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ac63f-679c-4837-9e15-feb2f4a846ec None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:52.658338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ac63f-679c-4837-9e15-feb2f4a846ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:52.658665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ac63f-679c-4837-9e15-feb2f4a846ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:52.660088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ac63f-679c-4837-9e15-feb2f4a846ec None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:52.662061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 540/1062] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:03:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:52.667984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6142e-1071-4835-85cb-c1bb13dca5d6 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:52.684437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 523/1063] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 08:03:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:52.685361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ac63f-679c-4837-9e15-feb2f4a846ec None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:52.705479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:52.759159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:52.778937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6142e-1071-4835-85cb-c1bb13dca5d6 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:52.794848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ac63f-679c-4837-9e15-feb2f4a846ec None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:52.816741 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95a8ce-6188-4a71-9b32-a96c3224a075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:52.817766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95a8ce-6188-4a71-9b32-a96c3224a075 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:52.818055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95a8ce-6188-4a71-9b32-a96c3224a075 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:52.818336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95a8ce-6188-4a71-9b32-a96c3224a075 None admin] PATH_INFO: `/v3/users/ff6ac4f5db2a496180a33d9c3b4bff6a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:52.831540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490dbac-9f6d-4911-87f7-7bf0d457dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:52.832426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490dbac-9f6d-4911-87f7-7bf0d457dcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:52.832664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95a8ce-6188-4a71-9b32-a96c3224a075 None admin] RBAC: Authorizing `identity:get_user(user_id=ff6ac4f5db2a496180a33d9c3b4bff6a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:52.832783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490dbac-9f6d-4911-87f7-7bf0d457dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:52.832971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490dbac-9f6d-4911-87f7-7bf0d457dcf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:52.834110 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95a8ce-6188-4a71-9b32-a96c3224a075 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:52.841300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 541/1064] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:03:52 2022] GET /identity/v3/users/ff6ac4f5db2a496180a33d9c3b4bff6a => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:52.842052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95a8ce-6188-4a71-9b32-a96c3224a075 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:52.844348 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490dbac-9f6d-4911-87f7-7bf0d457dcf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:52.846030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490dbac-9f6d-4911-87f7-7bf0d457dcf1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-7490dbac-9f6d-4911-87f7-7bf0d457dcf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:52.864600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:52.866247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:52.867199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:52.867199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:52.867199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:52.867199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:52.867199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 524/1065] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:52.871973 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490dbac-9f6d-4911-87f7-7bf0d457dcf1 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:52.947068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:52.950412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95a8ce-6188-4a71-9b32-a96c3224a075 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:52.983131 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490dbac-9f6d-4911-87f7-7bf0d457dcf1 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:52.989944 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac3c1-da25-4cc4-8935-d9c8a89bc662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:52.991166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac3c1-da25-4cc4-8935-d9c8a89bc662 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:52.991446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac3c1-da25-4cc4-8935-d9c8a89bc662 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:52.991724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac3c1-da25-4cc4-8935-d9c8a89bc662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:53.003464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:53.023182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a68036-9160-4b84-9273-332d4328d665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:53.023857 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68036-9160-4b84-9273-332d4328d665 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:53.024141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68036-9160-4b84-9273-332d4328d665 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:53.024416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68036-9160-4b84-9273-332d4328d665 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:53.025155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a68036-9160-4b84-9273-332d4328d665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:53.025458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a68036-9160-4b84-9273-332d4328d665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:53.026863 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a68036-9160-4b84-9273-332d4328d665 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:53.038988 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 525/1066] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:53.044429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a68036-9160-4b84-9273-332d4328d665 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:53.070500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dac3c1-da25-4cc4-8935-d9c8a89bc662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:53.071997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dac3c1-da25-4cc4-8935-d9c8a89bc662 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:53.154696 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a68036-9160-4b84-9273-332d4328d665 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:53.186836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 542/1067] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:03:53.187892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac3c1-da25-4cc4-8935-d9c8a89bc662 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:53.201060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:53.208307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6d892-2128-49f1-9252-889de030b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:53.209238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6d892-2128-49f1-9252-889de030b54f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:53.209526 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6d892-2128-49f1-9252-889de030b54f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:53.209801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6d892-2128-49f1-9252-889de030b54f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:53.216585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6d892-2128-49f1-9252-889de030b54f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:53.218048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6d892-2128-49f1-9252-889de030b54f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:53.232079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-b3d6d892-2128-49f1-9252-889de030b54f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:53.232855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:53.233868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:53.235118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:53.235118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:53.235118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:53.235118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:53.235118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:53.235118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:53.235118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:53.235118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:53.235118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 526/1068] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:53.241203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6d892-2128-49f1-9252-889de030b54f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:53.301495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac3c1-da25-4cc4-8935-d9c8a89bc662 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:53.344213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1ff29-8586-4a3f-a32e-463548f9831f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:53.345075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1ff29-8586-4a3f-a32e-463548f9831f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:53.345354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1ff29-8586-4a3f-a32e-463548f9831f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:53.345627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1ff29-8586-4a3f-a32e-463548f9831f None admin] PATH_INFO: `/v3/projects/dc76256c544e46d9a50ebca5cd24745b` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:53.346858 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1ff29-8586-4a3f-a32e-463548f9831f None admin] RBAC: Authorizing `identity:get_project(project_id=dc76256c544e46d9a50ebca5cd24745b)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:53.348302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1ff29-8586-4a3f-a32e-463548f9831f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:53.351290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 543/1069] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:03:53 2022] GET /identity/v3/projects/dc76256c544e46d9a50ebca5cd24745b => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:53.359597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1ff29-8586-4a3f-a32e-463548f9831f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:53.361839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6d892-2128-49f1-9252-889de030b54f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:53.406598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30128ade-bead-40dd-96ae-ec320548283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:53.407674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30128ade-bead-40dd-96ae-ec320548283d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:53.408253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30128ade-bead-40dd-96ae-ec320548283d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:53.408748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30128ade-bead-40dd-96ae-ec320548283d None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:53.410203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30128ade-bead-40dd-96ae-ec320548283d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:53.410776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30128ade-bead-40dd-96ae-ec320548283d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:53.413103 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30128ade-bead-40dd-96ae-ec320548283d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:53.429136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 527/1070] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:53.435131 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30128ade-bead-40dd-96ae-ec320548283d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:53.480324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1ff29-8586-4a3f-a32e-463548f9831f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:53.491093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:53.504206 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:53.526476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e0721-c3d5-4395-a993-67c07d1ce72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:53.527609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e0721-c3d5-4395-a993-67c07d1ce72b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:53.527997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e0721-c3d5-4395-a993-67c07d1ce72b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:53.528365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e0721-c3d5-4395-a993-67c07d1ce72b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:53.529307 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e0721-c3d5-4395-a993-67c07d1ce72b None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=dc76256c544e46d9a50ebca5cd24745b, user.id=ff6ac4f5db2a496180a33d9c3b4bff6a) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:53.529729 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e0721-c3d5-4395-a993-67c07d1ce72b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:53.531326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e0721-c3d5-4395-a993-67c07d1ce72b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:53.550686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 544/1071] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:53 2022] GET /identity/v3/role_assignments?user.id=ff6ac4f5db2a496180a33d9c3b4bff6a&scope.project.id=dc76256c544e46d9a50ebca5cd24745b&role.id=6fcc322b483a475399974562c1e5bd43 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:53.577215 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30128ade-bead-40dd-96ae-ec320548283d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:53.616642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63187537-7e6e-4a37-819c-fc499b865276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:53.617623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63187537-7e6e-4a37-819c-fc499b865276 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:53.617903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63187537-7e6e-4a37-819c-fc499b865276 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:53.618179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63187537-7e6e-4a37-819c-fc499b865276 None admin] PATH_INFO: `/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/c0956402a9bb4a9384111b36d5251749/roles/ac51b321f0034a93ad0913c0302cdf6f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:53.620557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63187537-7e6e-4a37-819c-fc499b865276 None admin] RBAC: Authorizing `identity:create_grant(project_id=c279ceb26daa45ba821e6ffb1db4f4f0, user_id=c0956402a9bb4a9384111b36d5251749, role_id=ac51b321f0034a93ad0913c0302cdf6f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:53.622029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63187537-7e6e-4a37-819c-fc499b865276 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:53.642671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 528/1072] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:03:53 2022] PUT /identity/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/c0956402a9bb4a9384111b36d5251749/roles/ac51b321f0034a93ad0913c0302cdf6f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:03:53.976520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c168d-683b-42b4-9f44-75d64920fe2b None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:53.976901 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c168d-683b-42b4-9f44-75d64920fe2b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:53.977071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c168d-683b-42b4-9f44-75d64920fe2b None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:53.978644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 545/1073] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:53.984016 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa3329-818c-40eb-8a54-4ce1a3495c98 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:53.984308 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa3329-818c-40eb-8a54-4ce1a3495c98 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:53.984587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa3329-818c-40eb-8a54-4ce1a3495c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:54.002232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-97fa3329-818c-40eb-8a54-4ce1a3495c98 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:54.003447 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-97fa3329-818c-40eb-8a54-4ce1a3495c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:54.073000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 529/1074] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:54.096303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c168d-683b-42b4-9f44-75d64920fe2b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:54.202120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c168d-683b-42b4-9f44-75d64920fe2b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:54.236475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304abce3-90c0-4664-b0ef-55285f943881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:54.237052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304abce3-90c0-4664-b0ef-55285f943881 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:54.237335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304abce3-90c0-4664-b0ef-55285f943881 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:54.237610 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304abce3-90c0-4664-b0ef-55285f943881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:54.280768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:54.309732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304abce3-90c0-4664-b0ef-55285f943881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:54.311252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304abce3-90c0-4664-b0ef-55285f943881 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:54.410675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 546/1075] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:03:54.416790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa3329-818c-40eb-8a54-4ce1a3495c98 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:54.457835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:54.517290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa3329-818c-40eb-8a54-4ce1a3495c98 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:54.551784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12a3d2-5e59-4acb-98d4-3916fd995bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:54.552566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12a3d2-5e59-4acb-98d4-3916fd995bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:54.552887 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12a3d2-5e59-4acb-98d4-3916fd995bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:54.554209 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12a3d2-5e59-4acb-98d4-3916fd995bb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:54.566706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12a3d2-5e59-4acb-98d4-3916fd995bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:54.568202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12a3d2-5e59-4acb-98d4-3916fd995bb0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-1d12a3d2-5e59-4acb-98d4-3916fd995bb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:54.592747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:54.593704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:54.599454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:54.599454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:54.599454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:54.599454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:54.599454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 530/1076] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:54.601609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304abce3-90c0-4664-b0ef-55285f943881 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:54.677352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:54.713549 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304abce3-90c0-4664-b0ef-55285f943881 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:54.749740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c845ab-52c7-471e-80fb-e122759aed29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:54.750426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c845ab-52c7-471e-80fb-e122759aed29 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:54.750738 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c845ab-52c7-471e-80fb-e122759aed29 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:54.751022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c845ab-52c7-471e-80fb-e122759aed29 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:54.751849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c845ab-52c7-471e-80fb-e122759aed29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:54.752166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c845ab-52c7-471e-80fb-e122759aed29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:54.753596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c845ab-52c7-471e-80fb-e122759aed29 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:54.774752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 547/1077] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:55.629311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e1750-796a-4848-8930-58138a7a92ba None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:55.629876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e1750-796a-4848-8930-58138a7a92ba None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:55.629876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e1750-796a-4848-8930-58138a7a92ba None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:55.632135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 531/1078] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:55.637653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85745976-bd83-4ec8-ae85-3a56eb960f46 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:55.638102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85745976-bd83-4ec8-ae85-3a56eb960f46 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:55.638329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85745976-bd83-4ec8-ae85-3a56eb960f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:55.655461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-85745976-bd83-4ec8-ae85-3a56eb960f46 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:55.656621 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-85745976-bd83-4ec8-ae85-3a56eb960f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:55.677026 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69053051-fd3d-4253-a8d3-c6c2306ee328 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:55.677305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69053051-fd3d-4253-a8d3-c6c2306ee328 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:55.677581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69053051-fd3d-4253-a8d3-c6c2306ee328 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:55.679007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 532/1079] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:55.683721 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da86bec-d646-4beb-95cb-efa220f669bd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:55.684012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da86bec-d646-4beb-95cb-efa220f669bd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:55.684289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da86bec-d646-4beb-95cb-efa220f669bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:55.701928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8da86bec-d646-4beb-95cb-efa220f669bd None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:55.703156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8da86bec-d646-4beb-95cb-efa220f669bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:55.724266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 548/1080] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:55.747078 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85745976-bd83-4ec8-ae85-3a56eb960f46 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:55.770351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 533/1081] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:03:55.794667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da86bec-d646-4beb-95cb-efa220f669bd None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:55.807881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:55.820893 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:55.847107 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85745976-bd83-4ec8-ae85-3a56eb960f46 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:55.883982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbf1d6-42a5-4404-8988-0c46279d1ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:55.884768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbf1d6-42a5-4404-8988-0c46279d1ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:55.885051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbf1d6-42a5-4404-8988-0c46279d1ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:55.885325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbf1d6-42a5-4404-8988-0c46279d1ad4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:55.896179 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbf1d6-42a5-4404-8988-0c46279d1ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:55.903254 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da86bec-d646-4beb-95cb-efa220f669bd None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-c9fbf1d6-42a5-4404-8988-0c46279d1ad4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:55.903805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:55.904839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:55.905677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 549/1082] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:55.911208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbf1d6-42a5-4404-8988-0c46279d1ad4 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:55.937136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00198-b6bb-439c-bc45-21ce40ebcd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:55.937958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00198-b6bb-439c-bc45-21ce40ebcd6d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:55.938242 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00198-b6bb-439c-bc45-21ce40ebcd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:55.938515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00198-b6bb-439c-bc45-21ce40ebcd6d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:55.948987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00198-b6bb-439c-bc45-21ce40ebcd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-d7f00198-b6bb-439c-bc45-21ce40ebcd6d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:55.957208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:55.958257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:55.959934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 534/1083] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 21 08:03:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:55.964849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00198-b6bb-439c-bc45-21ce40ebcd6d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:56.012773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbf1d6-42a5-4404-8988-0c46279d1ad4 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:56.034436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:56.045191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:56.046330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697391dd-ad22-4d73-9d79-e87a51b5bcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:56.047020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697391dd-ad22-4d73-9d79-e87a51b5bcea None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:56.047298 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697391dd-ad22-4d73-9d79-e87a51b5bcea None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:56.047573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697391dd-ad22-4d73-9d79-e87a51b5bcea None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:56.048317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697391dd-ad22-4d73-9d79-e87a51b5bcea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:56.048619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697391dd-ad22-4d73-9d79-e87a51b5bcea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:56.049985 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697391dd-ad22-4d73-9d79-e87a51b5bcea None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:56.058708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 550/1084] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:03:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:56.063906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00198-b6bb-439c-bc45-21ce40ebcd6d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:56.064280 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697391dd-ad22-4d73-9d79-e87a51b5bcea None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:56.101373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066ce22-5068-4527-80e8-96537d04b440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:56.101943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066ce22-5068-4527-80e8-96537d04b440 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:56.102223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066ce22-5068-4527-80e8-96537d04b440 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:56.102495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066ce22-5068-4527-80e8-96537d04b440 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:56.103255 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066ce22-5068-4527-80e8-96537d04b440 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:56.103566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066ce22-5068-4527-80e8-96537d04b440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:56.104911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066ce22-5068-4527-80e8-96537d04b440 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:56.112827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 535/1085] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 08:03:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:56.119289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066ce22-5068-4527-80e8-96537d04b440 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:56.172050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697391dd-ad22-4d73-9d79-e87a51b5bcea None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:56.205658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbb3a1-5700-41d5-a4e0-a29a601ce97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:56.206523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbb3a1-5700-41d5-a4e0-a29a601ce97c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:56.206875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbb3a1-5700-41d5-a4e0-a29a601ce97c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:56.207151 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbb3a1-5700-41d5-a4e0-a29a601ce97c None admin] PATH_INFO: `/v3/users/ff6ac4f5db2a496180a33d9c3b4bff6a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:56.208359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbb3a1-5700-41d5-a4e0-a29a601ce97c None admin] RBAC: Authorizing `identity:get_user(user_id=ff6ac4f5db2a496180a33d9c3b4bff6a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:56.210271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbb3a1-5700-41d5-a4e0-a29a601ce97c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:56.211937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 551/1086] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:03:56 2022] GET /identity/v3/users/ff6ac4f5db2a496180a33d9c3b4bff6a => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:56.217466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbb3a1-5700-41d5-a4e0-a29a601ce97c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:56.225980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066ce22-5068-4527-80e8-96537d04b440 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:56.259883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6fa7f-3815-4ff9-8ec4-0869f96fafaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:56.260665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6fa7f-3815-4ff9-8ec4-0869f96fafaa None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:56.260946 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6fa7f-3815-4ff9-8ec4-0869f96fafaa None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:56.261219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6fa7f-3815-4ff9-8ec4-0869f96fafaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:56.271240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:56.271896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6fa7f-3815-4ff9-8ec4-0869f96fafaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:56.273336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6fa7f-3815-4ff9-8ec4-0869f96fafaa None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:56.275843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-54e6fa7f-3815-4ff9-8ec4-0869f96fafaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:56.291305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:56.292429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:56.293540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:56.293540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:56.293540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:56.293540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:56.294107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 536/1087] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:56.298092 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6fa7f-3815-4ff9-8ec4-0869f96fafaa None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:56.320493 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbb3a1-5700-41d5-a4e0-a29a601ce97c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:56.356034 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd8f35-67ab-4f2d-93da-d35ea8286d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:56.357081 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd8f35-67ab-4f2d-93da-d35ea8286d6b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:56.357362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd8f35-67ab-4f2d-93da-d35ea8286d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:56.357644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd8f35-67ab-4f2d-93da-d35ea8286d6b None admin] PATH_INFO: `/v3/projects/dc76256c544e46d9a50ebca5cd24745b` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:56.358842 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd8f35-67ab-4f2d-93da-d35ea8286d6b None admin] RBAC: Authorizing `identity:get_project(project_id=dc76256c544e46d9a50ebca5cd24745b)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:56.360269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd8f35-67ab-4f2d-93da-d35ea8286d6b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:56.367099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 552/1088] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:03:56 2022] GET /identity/v3/projects/dc76256c544e46d9a50ebca5cd24745b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:56.368936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd8f35-67ab-4f2d-93da-d35ea8286d6b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:56.398788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6fa7f-3815-4ff9-8ec4-0869f96fafaa None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:56.431875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad6a3b-a724-4693-8fd0-0135bd8346ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:56.432533 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad6a3b-a724-4693-8fd0-0135bd8346ad None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:56.432814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad6a3b-a724-4693-8fd0-0135bd8346ad None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:56.433088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad6a3b-a724-4693-8fd0-0135bd8346ad None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:56.434612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad6a3b-a724-4693-8fd0-0135bd8346ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:56.434612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad6a3b-a724-4693-8fd0-0135bd8346ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:56.435996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad6a3b-a724-4693-8fd0-0135bd8346ad None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:56.453174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 537/1089] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:56.458754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad6a3b-a724-4693-8fd0-0135bd8346ad None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:56.470958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd8f35-67ab-4f2d-93da-d35ea8286d6b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:56.491514 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:56.506847 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c41d5d-7499-49b9-91b3-971c4922ec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:56.507868 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c41d5d-7499-49b9-91b3-971c4922ec8e None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:56.508145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c41d5d-7499-49b9-91b3-971c4922ec8e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:56.508417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c41d5d-7499-49b9-91b3-971c4922ec8e None admin] PATH_INFO: `/v3/projects/dc76256c544e46d9a50ebca5cd24745b/users/ff6ac4f5db2a496180a33d9c3b4bff6a/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:56.510368 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c41d5d-7499-49b9-91b3-971c4922ec8e None admin] RBAC: Authorizing `identity:create_grant(project_id=dc76256c544e46d9a50ebca5cd24745b, user_id=ff6ac4f5db2a496180a33d9c3b4bff6a, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:56.511826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c41d5d-7499-49b9-91b3-971c4922ec8e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:56.526463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 553/1090] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:03:56 2022] PUT /identity/v3/projects/dc76256c544e46d9a50ebca5cd24745b/users/ff6ac4f5db2a496180a33d9c3b4bff6a/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:03:56.533807 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:56.586523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad6a3b-a724-4693-8fd0-0135bd8346ad None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:56.624094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01106c-1c54-4571-a2fe-04c7422c8c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:56.624802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01106c-1c54-4571-a2fe-04c7422c8c9e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:56.625085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01106c-1c54-4571-a2fe-04c7422c8c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:56.625360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01106c-1c54-4571-a2fe-04c7422c8c9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:56.634654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01106c-1c54-4571-a2fe-04c7422c8c9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:56.636134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01106c-1c54-4571-a2fe-04c7422c8c9e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-bc01106c-1c54-4571-a2fe-04c7422c8c9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:03:56.652110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:56.653196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:56.654153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:56.654153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:56.654153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:03:56.654153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:03:56.654153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:03:56.654153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:03:56.654153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:03:56.654153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:03:56.654153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 08:03:56.654153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:56.654153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 538/1091] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 08:03:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:03:56.659458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c41d5d-7499-49b9-91b3-971c4922ec8e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:56.761109 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c41d5d-7499-49b9-91b3-971c4922ec8e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:56.816968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74d82c-1064-44d8-8769-987da9d640ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:56.817635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74d82c-1064-44d8-8769-987da9d640ab None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:56.817918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74d82c-1064-44d8-8769-987da9d640ab None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:56.818194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74d82c-1064-44d8-8769-987da9d640ab None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:56.819742 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74d82c-1064-44d8-8769-987da9d640ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:56.820051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74d82c-1064-44d8-8769-987da9d640ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:56.821483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74d82c-1064-44d8-8769-987da9d640ab None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:56.839254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 554/1092] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 08:03:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:56.844894 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01106c-1c54-4571-a2fe-04c7422c8c9e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:56.944547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01106c-1c54-4571-a2fe-04c7422c8c9e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:56.960543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:56.978986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb336b8f-6eb5-4053-baa4-3c5179ebd009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:56.979631 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb336b8f-6eb5-4053-baa4-3c5179ebd009 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:56.979914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb336b8f-6eb5-4053-baa4-3c5179ebd009 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:56.980193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb336b8f-6eb5-4053-baa4-3c5179ebd009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:57.046168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb336b8f-6eb5-4053-baa4-3c5179ebd009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:57.047653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb336b8f-6eb5-4053-baa4-3c5179ebd009 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:57.143369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 539/1093] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 08:03:57.149646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74d82c-1064-44d8-8769-987da9d640ab None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:57.188251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:57.250255 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74d82c-1064-44d8-8769-987da9d640ab None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:57.284657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924b253-8e5a-4078-bb20-7379e98a0039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:57.285443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924b253-8e5a-4078-bb20-7379e98a0039 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:57.285727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924b253-8e5a-4078-bb20-7379e98a0039 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:57.286002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924b253-8e5a-4078-bb20-7379e98a0039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:57.296171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924b253-8e5a-4078-bb20-7379e98a0039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:57.297614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924b253-8e5a-4078-bb20-7379e98a0039 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-b924b253-8e5a-4078-bb20-7379e98a0039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:03:57.315192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:57.316283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:57.317186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:03:57.317186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:03:57.317186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:03:57.317186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:57.317186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 555/1094] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:57.322550 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb336b8f-6eb5-4053-baa4-3c5179ebd009 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:57.339642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:57.420066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb336b8f-6eb5-4053-baa4-3c5179ebd009 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:57.454327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f2191-a9cf-4546-95e9-54d1d3da1d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:57.455012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f2191-a9cf-4546-95e9-54d1d3da1d34 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:57.455303 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f2191-a9cf-4546-95e9-54d1d3da1d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:57.455578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f2191-a9cf-4546-95e9-54d1d3da1d34 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:57.456294 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f2191-a9cf-4546-95e9-54d1d3da1d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:57.456598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f2191-a9cf-4546-95e9-54d1d3da1d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:57.457953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f2191-a9cf-4546-95e9-54d1d3da1d34 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:57.469316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 540/1095] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:57.474702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924b253-8e5a-4078-bb20-7379e98a0039 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:57.562455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:57.573912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924b253-8e5a-4078-bb20-7379e98a0039 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:57.610057 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b253d5-202f-41b2-90f2-69ba714dfc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:57.610873 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b253d5-202f-41b2-90f2-69ba714dfc27 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:57.611168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b253d5-202f-41b2-90f2-69ba714dfc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:57.611448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b253d5-202f-41b2-90f2-69ba714dfc27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:57.618504 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b253d5-202f-41b2-90f2-69ba714dfc27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:57.619974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b253d5-202f-41b2-90f2-69ba714dfc27 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-49b253d5-202f-41b2-90f2-69ba714dfc27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:03:57.633665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:57.634739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:57.635667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:03:57.635667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:03:57.635667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:03:57.635667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:03:57.635667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:03:57.635667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:03:57.635667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:03:57.635667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:03:57.635667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 556/1096] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:57.640682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f2191-a9cf-4546-95e9-54d1d3da1d34 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:57.721362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:57.745483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f2191-a9cf-4546-95e9-54d1d3da1d34 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:57.777611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db8b48-e1d1-4c09-9817-da0930d67fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:57.778257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db8b48-e1d1-4c09-9817-da0930d67fab None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:57.778561 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db8b48-e1d1-4c09-9817-da0930d67fab None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:57.778865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db8b48-e1d1-4c09-9817-da0930d67fab None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:57.779649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db8b48-e1d1-4c09-9817-da0930d67fab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:57.779958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db8b48-e1d1-4c09-9817-da0930d67fab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:57.781390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db8b48-e1d1-4c09-9817-da0930d67fab None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:57.793759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 541/1097] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:03:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:57.799606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b253d5-202f-41b2-90f2-69ba714dfc27 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:57.906391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b253d5-202f-41b2-90f2-69ba714dfc27 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:57.938576 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a358c-8059-4493-b170-e16265d38bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:57.939242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a358c-8059-4493-b170-e16265d38bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:57.939524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a358c-8059-4493-b170-e16265d38bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:57.939798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a358c-8059-4493-b170-e16265d38bc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:57.940614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a358c-8059-4493-b170-e16265d38bc0 None admin] RBAC: Adding query filter params (role.id=ac51b321f0034a93ad0913c0302cdf6f, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=c0956402a9bb4a9384111b36d5251749) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:57.940923 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a358c-8059-4493-b170-e16265d38bc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:57.942341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a358c-8059-4493-b170-e16265d38bc0 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:57.948629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 557/1098] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:57 2022] GET /identity/v3/role_assignments?user.id=c0956402a9bb4a9384111b36d5251749&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=ac51b321f0034a93ad0913c0302cdf6f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:03:58.631339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d7009-295a-4c72-bdec-db30e4d82339 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:58.632211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d7009-295a-4c72-bdec-db30e4d82339 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:58.632489 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d7009-295a-4c72-bdec-db30e4d82339 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:58.633874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 542/1099] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:03:58.639355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816789d-2135-413e-aa6d-ba49869dcd7b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:58.639720 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816789d-2135-413e-aa6d-ba49869dcd7b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:58.640073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816789d-2135-413e-aa6d-ba49869dcd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:58.658343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-2816789d-2135-413e-aa6d-ba49869dcd7b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:03:58.659637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2816789d-2135-413e-aa6d-ba49869dcd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:03:58.669731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:58.731412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 558/1100] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:03:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:03:58.757125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d7009-295a-4c72-bdec-db30e4d82339 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:58.867651 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d7009-295a-4c72-bdec-db30e4d82339 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:58.902225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaf122-cf21-4357-8cb9-4b47a6886d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:58.903027 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaf122-cf21-4357-8cb9-4b47a6886d37 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:58.903309 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaf122-cf21-4357-8cb9-4b47a6886d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:58.903578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaf122-cf21-4357-8cb9-4b47a6886d37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:58.906178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:58.914243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfaf122-cf21-4357-8cb9-4b47a6886d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-fcfaf122-cf21-4357-8cb9-4b47a6886d37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:03:58.921788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:03:58.922918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:03:58.923821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 543/1101] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:03:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:03:58.929624 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816789d-2135-413e-aa6d-ba49869dcd7b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:59.025239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816789d-2135-413e-aa6d-ba49869dcd7b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:59.057911 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3be6bc-0581-4f61-9929-e9939b33c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:59.058560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3be6bc-0581-4f61-9929-e9939b33c5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:59.058869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3be6bc-0581-4f61-9929-e9939b33c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:59.059142 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3be6bc-0581-4f61-9929-e9939b33c5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:59.059875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3be6bc-0581-4f61-9929-e9939b33c5a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:59.060180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3be6bc-0581-4f61-9929-e9939b33c5a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:59.061536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3be6bc-0581-4f61-9929-e9939b33c5a5 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:59.070006 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 559/1102] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:03:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:59.075623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaf122-cf21-4357-8cb9-4b47a6886d37 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:59.178331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaf122-cf21-4357-8cb9-4b47a6886d37 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:59.215966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857c3d4-2b31-4c1b-87b5-da8fa231a7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:59.216819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857c3d4-2b31-4c1b-87b5-da8fa231a7fb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:59.217099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857c3d4-2b31-4c1b-87b5-da8fa231a7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:59.217374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857c3d4-2b31-4c1b-87b5-da8fa231a7fb None admin] PATH_INFO: `/v3/users/ff6ac4f5db2a496180a33d9c3b4bff6a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:59.218555 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857c3d4-2b31-4c1b-87b5-da8fa231a7fb None admin] RBAC: Authorizing `identity:get_user(user_id=ff6ac4f5db2a496180a33d9c3b4bff6a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:59.220012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857c3d4-2b31-4c1b-87b5-da8fa231a7fb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:59.221645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 544/1103] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:03:59 2022] GET /identity/v3/users/ff6ac4f5db2a496180a33d9c3b4bff6a => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:59.227989 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3be6bc-0581-4f61-9929-e9939b33c5a5 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:59.237028 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:59.325829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3be6bc-0581-4f61-9929-e9939b33c5a5 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:59.358270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d69ed-25d4-4d27-8e37-70c3985d0ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:59.358925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d69ed-25d4-4d27-8e37-70c3985d0ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:59.359206 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d69ed-25d4-4d27-8e37-70c3985d0ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:59.359480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d69ed-25d4-4d27-8e37-70c3985d0ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:59.423883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d69ed-25d4-4d27-8e37-70c3985d0ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:59.425308 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d69ed-25d4-4d27-8e37-70c3985d0ba0 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:59.433730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:59.531988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 560/1104] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:03:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:03:59.538479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857c3d4-2b31-4c1b-87b5-da8fa231a7fb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:59.599038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:59.637330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857c3d4-2b31-4c1b-87b5-da8fa231a7fb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:59.671083 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec0020-fdce-4699-8267-2c29f32b3c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:59.671899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0020-fdce-4699-8267-2c29f32b3c4f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:59.672182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0020-fdce-4699-8267-2c29f32b3c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:59.672454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0020-fdce-4699-8267-2c29f32b3c4f None admin] PATH_INFO: `/v3/projects/dc76256c544e46d9a50ebca5cd24745b` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:59.673630 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec0020-fdce-4699-8267-2c29f32b3c4f None admin] RBAC: Authorizing `identity:get_project(project_id=dc76256c544e46d9a50ebca5cd24745b)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:59.675090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec0020-fdce-4699-8267-2c29f32b3c4f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:59.676769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 545/1105] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:03:59 2022] GET /identity/v3/projects/dc76256c544e46d9a50ebca5cd24745b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:03:59.682849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d69ed-25d4-4d27-8e37-70c3985d0ba0 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:03:59.779542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d69ed-25d4-4d27-8e37-70c3985d0ba0 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:03:59.787736 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:03:59.813792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbb7e2-3ffd-4263-9cc8-14789e3f1987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:03:59.814427 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbb7e2-3ffd-4263-9cc8-14789e3f1987 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:03:59.814730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbb7e2-3ffd-4263-9cc8-14789e3f1987 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:03:59.815005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbb7e2-3ffd-4263-9cc8-14789e3f1987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:03:59.815818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbb7e2-3ffd-4263-9cc8-14789e3f1987 None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=dc76256c544e46d9a50ebca5cd24745b, user.id=ff6ac4f5db2a496180a33d9c3b4bff6a) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:03:59.816123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbb7e2-3ffd-4263-9cc8-14789e3f1987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:03:59.817541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbb7e2-3ffd-4263-9cc8-14789e3f1987 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:03:59.823394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 561/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:03:59 2022] GET /identity/v3/role_assignments?user.id=ff6ac4f5db2a496180a33d9c3b4bff6a&scope.project.id=dc76256c544e46d9a50ebca5cd24745b&role.id=6fcc322b483a475399974562c1e5bd43 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:01.859146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16d2c9-363c-42b8-8333-f27463c6d912 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:01.859705 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16d2c9-363c-42b8-8333-f27463c6d912 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:01.859705 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16d2c9-363c-42b8-8333-f27463c6d912 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:01.860978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 546/1107] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:01.866467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cfb4d-f272-453c-98fc-7ea59758128d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:01.866898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cfb4d-f272-453c-98fc-7ea59758128d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:01.867047 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cfb4d-f272-453c-98fc-7ea59758128d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:01.883262 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-fc4cfb4d-f272-453c-98fc-7ea59758128d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:01.884419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-fc4cfb4d-f272-453c-98fc-7ea59758128d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:01.948967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 562/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:01.974000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16d2c9-363c-42b8-8333-f27463c6d912 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:02.075556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16d2c9-363c-42b8-8333-f27463c6d912 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:02.104720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:02.109918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d86a06-3b51-4e67-97bd-d7a56bd6f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:02.110653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d86a06-3b51-4e67-97bd-d7a56bd6f1bd None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:02.110938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d86a06-3b51-4e67-97bd-d7a56bd6f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:02.111211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d86a06-3b51-4e67-97bd-d7a56bd6f1bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:02.112362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d86a06-3b51-4e67-97bd-d7a56bd6f1bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:02.114036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d86a06-3b51-4e67-97bd-d7a56bd6f1bd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:02.115949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 547/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:04:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:02.121662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cfb4d-f272-453c-98fc-7ea59758128d None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:02.215869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:02.219043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cfb4d-f272-453c-98fc-7ea59758128d None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:02.256433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df799-9588-4c38-9735-8fbec521d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:02.257256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df799-9588-4c38-9735-8fbec521d84b None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:02.257660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df799-9588-4c38-9735-8fbec521d84b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:02.258071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df799-9588-4c38-9735-8fbec521d84b None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:02.259007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916df799-9588-4c38-9735-8fbec521d84b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:02.260453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916df799-9588-4c38-9735-8fbec521d84b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:02.280980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 563/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:04:02 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:04:04.346035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dc795-f2bb-460b-85c3-a46a88f403f9 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:04.346604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dc795-f2bb-460b-85c3-a46a88f403f9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:04.346604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dc795-f2bb-460b-85c3-a46a88f403f9 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:04.347984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 548/1111] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:04.353141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293e3d9-8e4f-4687-b7c2-a78d1afc7585 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:04.353574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293e3d9-8e4f-4687-b7c2-a78d1afc7585 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:04.353683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293e3d9-8e4f-4687-b7c2-a78d1afc7585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:04.371600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-c293e3d9-8e4f-4687-b7c2-a78d1afc7585 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:04.372778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c293e3d9-8e4f-4687-b7c2-a78d1afc7585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:04.439590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 564/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:04.462945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7dc795-f2bb-460b-85c3-a46a88f403f9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:04.560639 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7dc795-f2bb-460b-85c3-a46a88f403f9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:04.594718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeddcd5-5498-473b-ba82-d0d02427a143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:04.595550 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeddcd5-5498-473b-ba82-d0d02427a143 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:04.595830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeddcd5-5498-473b-ba82-d0d02427a143 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:04.596153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeddcd5-5498-473b-ba82-d0d02427a143 None admin] PATH_INFO: `/v3/roles/8d803b40a63540ba80e3039f16774d46` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:04.597546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeddcd5-5498-473b-ba82-d0d02427a143 None admin] RBAC: Authorizing `identity:get_role(role_id=8d803b40a63540ba80e3039f16774d46)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:04.598922 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeddcd5-5498-473b-ba82-d0d02427a143 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:04.600410 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 549/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:04:04 2022] GET /identity/v3/roles/8d803b40a63540ba80e3039f16774d46 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:04.606073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293e3d9-8e4f-4687-b7c2-a78d1afc7585 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:04.687061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:04.702429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293e3d9-8e4f-4687-b7c2-a78d1afc7585 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:04.735657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0735c1f-33bf-4f01-92de-fddae3cd9568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:04.736502 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0735c1f-33bf-4f01-92de-fddae3cd9568 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:04.736776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0735c1f-33bf-4f01-92de-fddae3cd9568 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:04.737043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0735c1f-33bf-4f01-92de-fddae3cd9568 None admin] PATH_INFO: `/v3/users/11e00670aa6d47a89098fa3b7fc33cac` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:04.750387 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0735c1f-33bf-4f01-92de-fddae3cd9568 None admin] RBAC: Authorizing `identity:get_user(user_id=11e00670aa6d47a89098fa3b7fc33cac)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:04.751846 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0735c1f-33bf-4f01-92de-fddae3cd9568 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:04.753464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 565/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:04:04 2022] GET /identity/v3/users/11e00670aa6d47a89098fa3b7fc33cac => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:04.759809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeddcd5-5498-473b-ba82-d0d02427a143 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:04.824571 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:04.855977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeddcd5-5498-473b-ba82-d0d02427a143 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:04.888430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdc599-8787-499f-94de-8eff1a79f8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:04.889049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdc599-8787-499f-94de-8eff1a79f8eb None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:04.889326 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdc599-8787-499f-94de-8eff1a79f8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:04.889597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdc599-8787-499f-94de-8eff1a79f8eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:04.953592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdc599-8787-499f-94de-8eff1a79f8eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:04.955054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdc599-8787-499f-94de-8eff1a79f8eb None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:05.016224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:05.049511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 550/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:04:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:04:05.056003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0735c1f-33bf-4f01-92de-fddae3cd9568 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:05.157874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0735c1f-33bf-4f01-92de-fddae3cd9568 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:05.194958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b7c46-7be1-4121-bbed-8d9ab940897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:05.195800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7c46-7be1-4121-bbed-8d9ab940897f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:05.196083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7c46-7be1-4121-bbed-8d9ab940897f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:05.196359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7c46-7be1-4121-bbed-8d9ab940897f None admin] PATH_INFO: `/v3/projects/dc76256c544e46d9a50ebca5cd24745b` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:05.197527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b7c46-7be1-4121-bbed-8d9ab940897f None admin] RBAC: Authorizing `identity:get_project(project_id=dc76256c544e46d9a50ebca5cd24745b)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:05.198983 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b7c46-7be1-4121-bbed-8d9ab940897f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:05.200676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 566/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:04:05 2022] GET /identity/v3/projects/dc76256c544e46d9a50ebca5cd24745b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:05.206898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdc599-8787-499f-94de-8eff1a79f8eb None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:05.304860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdc599-8787-499f-94de-8eff1a79f8eb None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:05.337581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e258f-2a7c-4927-80e2-6ba9370e1ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:05.338212 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e258f-2a7c-4927-80e2-6ba9370e1ecc None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:05.338495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e258f-2a7c-4927-80e2-6ba9370e1ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:05.338802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e258f-2a7c-4927-80e2-6ba9370e1ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:05.339629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e258f-2a7c-4927-80e2-6ba9370e1ecc None admin] RBAC: Adding query filter params (role.id=8d803b40a63540ba80e3039f16774d46, scope.project.id=dc76256c544e46d9a50ebca5cd24745b, user.id=11e00670aa6d47a89098fa3b7fc33cac) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:05.339944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e258f-2a7c-4927-80e2-6ba9370e1ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:05.341367 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e258f-2a7c-4927-80e2-6ba9370e1ecc None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:05.346673 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 551/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:04:05 2022] GET /identity/v3/role_assignments?user.id=11e00670aa6d47a89098fa3b7fc33cac&scope.project.id=dc76256c544e46d9a50ebca5cd24745b&role.id=8d803b40a63540ba80e3039f16774d46 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:07.342295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8ee02-1624-4783-b5f5-67d62745ed9d None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:07.342887 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8ee02-1624-4783-b5f5-67d62745ed9d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:07.342887 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8ee02-1624-4783-b5f5-67d62745ed9d None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:07.344248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 567/1118] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:07.349444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852f82a-89c0-44cc-84d6-e4ec6a3c0840 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:07.349894 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852f82a-89c0-44cc-84d6-e4ec6a3c0840 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:07.350156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852f82a-89c0-44cc-84d6-e4ec6a3c0840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:07.367368 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a852f82a-89c0-44cc-84d6-e4ec6a3c0840 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:07.368574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a852f82a-89c0-44cc-84d6-e4ec6a3c0840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:07.393865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:07.434085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 552/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:07.456740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8ee02-1624-4783-b5f5-67d62745ed9d None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:07.472142 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:07.558688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8ee02-1624-4783-b5f5-67d62745ed9d None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:07.593267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ee6dc-c5f4-4580-90c9-58410b3b1c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:07.594048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ee6dc-c5f4-4580-90c9-58410b3b1c3b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:07.594327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ee6dc-c5f4-4580-90c9-58410b3b1c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:07.594596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ee6dc-c5f4-4580-90c9-58410b3b1c3b None admin] PATH_INFO: `/v3/roles/8d803b40a63540ba80e3039f16774d46` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:07.596094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ee6dc-c5f4-4580-90c9-58410b3b1c3b None admin] RBAC: Authorizing `identity:get_role(role_id=8d803b40a63540ba80e3039f16774d46)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:07.597470 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ee6dc-c5f4-4580-90c9-58410b3b1c3b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:07.598877 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 568/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:04:07 2022] GET /identity/v3/roles/8d803b40a63540ba80e3039f16774d46 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:07.604804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852f82a-89c0-44cc-84d6-e4ec6a3c0840 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:07.701394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852f82a-89c0-44cc-84d6-e4ec6a3c0840 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:07.734069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb400840-47e8-4460-8255-56a818287701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:07.734937 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb400840-47e8-4460-8255-56a818287701 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:07.735216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb400840-47e8-4460-8255-56a818287701 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:07.735487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb400840-47e8-4460-8255-56a818287701 None admin] PATH_INFO: `/v3/users/11e00670aa6d47a89098fa3b7fc33cac` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:07.736676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb400840-47e8-4460-8255-56a818287701 None admin] RBAC: Authorizing `identity:get_user(user_id=11e00670aa6d47a89098fa3b7fc33cac)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:07.738092 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb400840-47e8-4460-8255-56a818287701 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:07.740143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 553/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:04:07 2022] GET /identity/v3/users/11e00670aa6d47a89098fa3b7fc33cac => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:04:07.745926 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ee6dc-c5f4-4580-90c9-58410b3b1c3b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:07.827301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:07.846778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ee6dc-c5f4-4580-90c9-58410b3b1c3b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:07.880797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0da3c-d7b4-4518-bdc1-9515decedf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:07.881633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0da3c-d7b4-4518-bdc1-9515decedf50 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:07.881909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0da3c-d7b4-4518-bdc1-9515decedf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:07.882178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0da3c-d7b4-4518-bdc1-9515decedf50 None admin] PATH_INFO: `/v3/projects/dc76256c544e46d9a50ebca5cd24745b` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:07.884528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0da3c-d7b4-4518-bdc1-9515decedf50 None admin] RBAC: Authorizing `identity:get_project(project_id=dc76256c544e46d9a50ebca5cd24745b)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:07.885984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0da3c-d7b4-4518-bdc1-9515decedf50 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:07.887694 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 569/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:04:07 2022] GET /identity/v3/projects/dc76256c544e46d9a50ebca5cd24745b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:07.893551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb400840-47e8-4460-8255-56a818287701 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:07.923867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:07.992858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb400840-47e8-4460-8255-56a818287701 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:08.026005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45345827-7eed-4219-b8fc-371edc798539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:08.026902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45345827-7eed-4219-b8fc-371edc798539 None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:08.027188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45345827-7eed-4219-b8fc-371edc798539 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:08.027463 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45345827-7eed-4219-b8fc-371edc798539 None admin] PATH_INFO: `/v3/projects/dc76256c544e46d9a50ebca5cd24745b/users/11e00670aa6d47a89098fa3b7fc33cac/roles/8d803b40a63540ba80e3039f16774d46` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:08.029660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45345827-7eed-4219-b8fc-371edc798539 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc76256c544e46d9a50ebca5cd24745b, user_id=11e00670aa6d47a89098fa3b7fc33cac, role_id=8d803b40a63540ba80e3039f16774d46)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:08.031130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45345827-7eed-4219-b8fc-371edc798539 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:08.045580 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 554/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:04:07 2022] PUT /identity/v3/projects/dc76256c544e46d9a50ebca5cd24745b/users/11e00670aa6d47a89098fa3b7fc33cac/roles/8d803b40a63540ba80e3039f16774d46 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:04:10.106209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071a7f3-dbd5-4dc8-9ed3-935cb9d88261 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:10.106777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071a7f3-dbd5-4dc8-9ed3-935cb9d88261 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:10.106777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071a7f3-dbd5-4dc8-9ed3-935cb9d88261 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:10.108134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 570/1124] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:10.113453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe59d8-77ca-4589-9228-fc5c1100336b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:10.113904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe59d8-77ca-4589-9228-fc5c1100336b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:10.114003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe59d8-77ca-4589-9228-fc5c1100336b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:10.131100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a9fe59d8-77ca-4589-9228-fc5c1100336b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:10.132264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a9fe59d8-77ca-4589-9228-fc5c1100336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:10.197541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 555/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:04:10.221642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071a7f3-dbd5-4dc8-9ed3-935cb9d88261 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:10.321378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071a7f3-dbd5-4dc8-9ed3-935cb9d88261 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:10.355581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ff40c-db24-425e-ac33-a5f312d1a344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:10.356473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff40c-db24-425e-ac33-a5f312d1a344 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:10.356702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff40c-db24-425e-ac33-a5f312d1a344 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:10.356972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff40c-db24-425e-ac33-a5f312d1a344 None admin] PATH_INFO: `/v3/roles/8d803b40a63540ba80e3039f16774d46` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:10.358420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ff40c-db24-425e-ac33-a5f312d1a344 None admin] RBAC: Authorizing `identity:get_role(role_id=8d803b40a63540ba80e3039f16774d46)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:10.359829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ff40c-db24-425e-ac33-a5f312d1a344 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:10.361226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 571/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:04:10 2022] GET /identity/v3/roles/8d803b40a63540ba80e3039f16774d46 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:10.367377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe59d8-77ca-4589-9228-fc5c1100336b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:10.388414 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:10.463374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe59d8-77ca-4589-9228-fc5c1100336b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:10.495429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7838e5c-0125-4852-93cc-cf011818527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:10.496266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7838e5c-0125-4852-93cc-cf011818527a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:10.496544 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7838e5c-0125-4852-93cc-cf011818527a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:10.496821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7838e5c-0125-4852-93cc-cf011818527a None admin] PATH_INFO: `/v3/users/11e00670aa6d47a89098fa3b7fc33cac` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:10.497982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7838e5c-0125-4852-93cc-cf011818527a None admin] RBAC: Authorizing `identity:get_user(user_id=11e00670aa6d47a89098fa3b7fc33cac)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:10.499416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7838e5c-0125-4852-93cc-cf011818527a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:10.501022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 556/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:04:10 2022] GET /identity/v3/users/11e00670aa6d47a89098fa3b7fc33cac => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:10.506682 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ff40c-db24-425e-ac33-a5f312d1a344 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:10.525421 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:10.606651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ff40c-db24-425e-ac33-a5f312d1a344 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:10.640753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350683b4-449a-440a-a0e5-b915333ae8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:10.641414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350683b4-449a-440a-a0e5-b915333ae8ce None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:10.641693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350683b4-449a-440a-a0e5-b915333ae8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:10.641969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350683b4-449a-440a-a0e5-b915333ae8ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:10.706543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350683b4-449a-440a-a0e5-b915333ae8ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:10.708150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350683b4-449a-440a-a0e5-b915333ae8ce None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:10.724353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:10.805541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 572/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:04:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:04:10.811250 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7838e5c-0125-4852-93cc-cf011818527a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:10.896528 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:10.909035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7838e5c-0125-4852-93cc-cf011818527a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:10.943145 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bd519-52cc-4b43-9f1b-171fc89a427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:10.943987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bd519-52cc-4b43-9f1b-171fc89a427e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:10.944270 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bd519-52cc-4b43-9f1b-171fc89a427e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:10.944541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bd519-52cc-4b43-9f1b-171fc89a427e None admin] PATH_INFO: `/v3/projects/dc76256c544e46d9a50ebca5cd24745b` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:10.945762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bd519-52cc-4b43-9f1b-171fc89a427e None admin] RBAC: Authorizing `identity:get_project(project_id=dc76256c544e46d9a50ebca5cd24745b)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:10.947213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bd519-52cc-4b43-9f1b-171fc89a427e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:10.948891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 557/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:04:10 2022] GET /identity/v3/projects/dc76256c544e46d9a50ebca5cd24745b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:10.954891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350683b4-449a-440a-a0e5-b915333ae8ce None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:11.054014 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350683b4-449a-440a-a0e5-b915333ae8ce None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:11.072142 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:11.091167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8c69a-4df8-4012-927f-467e5d649f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:11.091815 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8c69a-4df8-4012-927f-467e5d649f25 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:11.092100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8c69a-4df8-4012-927f-467e5d649f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:11.092378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8c69a-4df8-4012-927f-467e5d649f25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:11.093203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8c69a-4df8-4012-927f-467e5d649f25 None admin] RBAC: Adding query filter params (role.id=8d803b40a63540ba80e3039f16774d46, scope.project.id=dc76256c544e46d9a50ebca5cd24745b, user.id=11e00670aa6d47a89098fa3b7fc33cac) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:11.093518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8c69a-4df8-4012-927f-467e5d649f25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:11.094981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8c69a-4df8-4012-927f-467e5d649f25 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:11.100688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 573/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:04:10 2022] GET /identity/v3/role_assignments?user.id=11e00670aa6d47a89098fa3b7fc33cac&scope.project.id=dc76256c544e46d9a50ebca5cd24745b&role.id=8d803b40a63540ba80e3039f16774d46 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:13.133047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae35d48-7b53-4a1b-a411-5df0033668cd None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:13.133602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae35d48-7b53-4a1b-a411-5df0033668cd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:13.133602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae35d48-7b53-4a1b-a411-5df0033668cd None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:13.135001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 558/1131] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:13.140282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd789a-696a-4584-8e7c-c01032e20318 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:13.140659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd789a-696a-4584-8e7c-c01032e20318 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:13.140829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd789a-696a-4584-8e7c-c01032e20318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:13.157458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-96bd789a-696a-4584-8e7c-c01032e20318 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:13.158638 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-96bd789a-696a-4584-8e7c-c01032e20318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:13.225578 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 574/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:13.254112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae35d48-7b53-4a1b-a411-5df0033668cd None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:13.353511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae35d48-7b53-4a1b-a411-5df0033668cd None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:13.386383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26515c-2392-43e3-8712-d6d100b11397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:13.387116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26515c-2392-43e3-8712-d6d100b11397 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:13.387400 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26515c-2392-43e3-8712-d6d100b11397 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:13.387672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26515c-2392-43e3-8712-d6d100b11397 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:13.388846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26515c-2392-43e3-8712-d6d100b11397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:13.390271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26515c-2392-43e3-8712-d6d100b11397 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:13.391886 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 559/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:04:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:13.397816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd789a-696a-4584-8e7c-c01032e20318 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:13.492244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd789a-696a-4584-8e7c-c01032e20318 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:13.502543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:13.533645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a49ef-86b0-41b0-937a-47de97b3838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:13.534302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a49ef-86b0-41b0-937a-47de97b3838e None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:13.534581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a49ef-86b0-41b0-937a-47de97b3838e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:13.534882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a49ef-86b0-41b0-937a-47de97b3838e None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:13.535978 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a49ef-86b0-41b0-937a-47de97b3838e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:13.537433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a49ef-86b0-41b0-937a-47de97b3838e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:13.577438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 575/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:04:13 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:04:15.674387 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4785ea-d669-42a5-9844-1e52dac24ce6 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:15.674982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4785ea-d669-42a5-9844-1e52dac24ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:15.674982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4785ea-d669-42a5-9844-1e52dac24ce6 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:15.676314 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 560/1135] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:15.682061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee7016-9985-406b-9570-5629f9683aa3 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:15.682479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee7016-9985-406b-9570-5629f9683aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:15.682651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee7016-9985-406b-9570-5629f9683aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:15.699152 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-60ee7016-9985-406b-9570-5629f9683aa3 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:15.700330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-60ee7016-9985-406b-9570-5629f9683aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:15.765028 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 576/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:15.789573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4785ea-d669-42a5-9844-1e52dac24ce6 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:15.813710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:15.889612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4785ea-d669-42a5-9844-1e52dac24ce6 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:15.922349 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0e526-5407-4b97-a2ff-c0008827181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:15.923137 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0e526-5407-4b97-a2ff-c0008827181b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:15.923415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0e526-5407-4b97-a2ff-c0008827181b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:15.923685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0e526-5407-4b97-a2ff-c0008827181b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:15.924842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0e526-5407-4b97-a2ff-c0008827181b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:15.926256 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0e526-5407-4b97-a2ff-c0008827181b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:15.927874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 561/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:04:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:15.933581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee7016-9985-406b-9570-5629f9683aa3 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:16.020550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:16.030326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee7016-9985-406b-9570-5629f9683aa3 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:16.063603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54816586-0802-4ba7-92fa-01649a5236cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:16.064260 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54816586-0802-4ba7-92fa-01649a5236cc None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:16.064544 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54816586-0802-4ba7-92fa-01649a5236cc None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:16.064819 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54816586-0802-4ba7-92fa-01649a5236cc None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:16.065518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54816586-0802-4ba7-92fa-01649a5236cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:16.066971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54816586-0802-4ba7-92fa-01649a5236cc None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:16.087129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 577/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:04:15 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:04:18.155105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996dadd-667c-4a85-844f-1c3b3dc6a26c None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:18.155668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996dadd-667c-4a85-844f-1c3b3dc6a26c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:18.155668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996dadd-667c-4a85-844f-1c3b3dc6a26c None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:18.157013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 562/1139] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:18.162261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3585af-d967-44c4-b612-6a981aedf46b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:18.162652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3585af-d967-44c4-b612-6a981aedf46b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:18.162850 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3585af-d967-44c4-b612-6a981aedf46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:18.181957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-5f3585af-d967-44c4-b612-6a981aedf46b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:18.183156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-5f3585af-d967-44c4-b612-6a981aedf46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:18.247921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 578/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:18.271191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996dadd-667c-4a85-844f-1c3b3dc6a26c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:18.360820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:18.371614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996dadd-667c-4a85-844f-1c3b3dc6a26c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:18.404736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f919b4d-059d-41b4-8ec1-4361af93241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:18.405549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f919b4d-059d-41b4-8ec1-4361af93241c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:18.405783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f919b4d-059d-41b4-8ec1-4361af93241c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:18.406058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f919b4d-059d-41b4-8ec1-4361af93241c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:18.416534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f919b4d-059d-41b4-8ec1-4361af93241c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-9f919b4d-059d-41b4-8ec1-4361af93241c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:04:18.424046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:04:18.425173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:04:18.426279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 563/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:04:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:04:18.431189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3585af-d967-44c4-b612-6a981aedf46b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:18.505190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:18.527432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3585af-d967-44c4-b612-6a981aedf46b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:18.560700 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c338a-1fff-4ce6-9beb-bb49f17da1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:18.561414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c338a-1fff-4ce6-9beb-bb49f17da1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:18.561695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c338a-1fff-4ce6-9beb-bb49f17da1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:18.561966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c338a-1fff-4ce6-9beb-bb49f17da1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:18.562727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c338a-1fff-4ce6-9beb-bb49f17da1e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:18.563032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c338a-1fff-4ce6-9beb-bb49f17da1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:18.564406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c338a-1fff-4ce6-9beb-bb49f17da1e0 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:18.573495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 579/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:04:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:18.579187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f919b4d-059d-41b4-8ec1-4361af93241c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:18.677295 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f919b4d-059d-41b4-8ec1-4361af93241c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:18.710594 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53a2b5-369b-4084-9958-d2f6fd4f1db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:18.711630 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a2b5-369b-4084-9958-d2f6fd4f1db3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:18.711913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a2b5-369b-4084-9958-d2f6fd4f1db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:18.712188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a2b5-369b-4084-9958-d2f6fd4f1db3 None admin] PATH_INFO: `/v3/users/143c85a141234741a98c1bf813855d66` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:18.725018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53a2b5-369b-4084-9958-d2f6fd4f1db3 None admin] RBAC: Authorizing `identity:get_user(user_id=143c85a141234741a98c1bf813855d66)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:18.727676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53a2b5-369b-4084-9958-d2f6fd4f1db3 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:18.729314 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 564/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:04:18 2022] GET /identity/v3/users/143c85a141234741a98c1bf813855d66 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:18.735099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c338a-1fff-4ce6-9beb-bb49f17da1e0 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:18.833115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c338a-1fff-4ce6-9beb-bb49f17da1e0 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:18.865963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf37c1-bebf-470d-a9be-08ebe358048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:18.866714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf37c1-bebf-470d-a9be-08ebe358048d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:18.866999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf37c1-bebf-470d-a9be-08ebe358048d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:18.867279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf37c1-bebf-470d-a9be-08ebe358048d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:18.877332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:18.933697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf37c1-bebf-470d-a9be-08ebe358048d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:18.935109 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf37c1-bebf-470d-a9be-08ebe358048d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:19.030880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 580/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:04:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:04:19.036708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53a2b5-369b-4084-9958-d2f6fd4f1db3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:19.049317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:19.134291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53a2b5-369b-4084-9958-d2f6fd4f1db3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:19.168561 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf02e8-fc96-4fac-ab07-1528d3048019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:19.169405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf02e8-fc96-4fac-ab07-1528d3048019 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:19.169687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf02e8-fc96-4fac-ab07-1528d3048019 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:19.169970 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf02e8-fc96-4fac-ab07-1528d3048019 None admin] PATH_INFO: `/v3/projects/d61f22552cfd429ebdbfc1097d6052be` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:19.171179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf02e8-fc96-4fac-ab07-1528d3048019 None admin] RBAC: Authorizing `identity:get_project(project_id=d61f22552cfd429ebdbfc1097d6052be)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:19.172607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf02e8-fc96-4fac-ab07-1528d3048019 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:19.174308 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 565/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:04:19 2022] GET /identity/v3/projects/d61f22552cfd429ebdbfc1097d6052be => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:19.180633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf37c1-bebf-470d-a9be-08ebe358048d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:19.221945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:19.280217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf37c1-bebf-470d-a9be-08ebe358048d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:19.312699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164e67b-fd42-420c-ad00-66f17d5ca8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:19.313334 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164e67b-fd42-420c-ad00-66f17d5ca8bf None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:19.313614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164e67b-fd42-420c-ad00-66f17d5ca8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:19.313886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164e67b-fd42-420c-ad00-66f17d5ca8bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:19.314726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164e67b-fd42-420c-ad00-66f17d5ca8bf None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=d61f22552cfd429ebdbfc1097d6052be, user.id=143c85a141234741a98c1bf813855d66) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:19.315036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164e67b-fd42-420c-ad00-66f17d5ca8bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:19.316452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164e67b-fd42-420c-ad00-66f17d5ca8bf None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:19.321835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 581/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:04:19 2022] GET /identity/v3/role_assignments?user.id=143c85a141234741a98c1bf813855d66&scope.project.id=d61f22552cfd429ebdbfc1097d6052be&role.id=6fcc322b483a475399974562c1e5bd43 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:04:21.393032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048488e-bf48-4e7c-a8c7-96d6d9884d8e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:21.393600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048488e-bf48-4e7c-a8c7-96d6d9884d8e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:21.393600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048488e-bf48-4e7c-a8c7-96d6d9884d8e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:21.394979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 566/1147] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:21.400761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afb733-56dc-4e65-9857-544ecdd522eb None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:21.401158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afb733-56dc-4e65-9857-544ecdd522eb None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:21.401320 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afb733-56dc-4e65-9857-544ecdd522eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:21.418574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f5afb733-56dc-4e65-9857-544ecdd522eb None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:21.419785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f5afb733-56dc-4e65-9857-544ecdd522eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:21.484768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 582/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:21.507711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048488e-bf48-4e7c-a8c7-96d6d9884d8e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:21.585613 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:21.608197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048488e-bf48-4e7c-a8c7-96d6d9884d8e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:21.640853 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625fc4-11cc-4ae3-a461-3f0874315267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:21.641620 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625fc4-11cc-4ae3-a461-3f0874315267 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:21.641897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625fc4-11cc-4ae3-a461-3f0874315267 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:21.642167 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625fc4-11cc-4ae3-a461-3f0874315267 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:21.652709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db625fc4-11cc-4ae3-a461-3f0874315267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-db625fc4-11cc-4ae3-a461-3f0874315267 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:04:21.660087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:04:21.661201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:04:21.662197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 567/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:04:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:04:21.667709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afb733-56dc-4e65-9857-544ecdd522eb None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:21.700280 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:21.763931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afb733-56dc-4e65-9857-544ecdd522eb None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:21.796659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce3fa0-ebdb-4f6c-b5ea-1e642e64720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:21.797390 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce3fa0-ebdb-4f6c-b5ea-1e642e64720a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:21.797674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce3fa0-ebdb-4f6c-b5ea-1e642e64720a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:21.797946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce3fa0-ebdb-4f6c-b5ea-1e642e64720a None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:21.798760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce3fa0-ebdb-4f6c-b5ea-1e642e64720a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:21.799070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce3fa0-ebdb-4f6c-b5ea-1e642e64720a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:21.800434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce3fa0-ebdb-4f6c-b5ea-1e642e64720a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:21.808551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 583/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:04:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:21.814266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625fc4-11cc-4ae3-a461-3f0874315267 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:21.913325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625fc4-11cc-4ae3-a461-3f0874315267 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:21.945360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b6c9a-3bd6-424f-a026-802fc6b38352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:21.946195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b6c9a-3bd6-424f-a026-802fc6b38352 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:21.946472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b6c9a-3bd6-424f-a026-802fc6b38352 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:21.946775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b6c9a-3bd6-424f-a026-802fc6b38352 None admin] PATH_INFO: `/v3/users/143c85a141234741a98c1bf813855d66` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:21.947941 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b6c9a-3bd6-424f-a026-802fc6b38352 None admin] RBAC: Authorizing `identity:get_user(user_id=143c85a141234741a98c1bf813855d66)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:21.949356 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b6c9a-3bd6-424f-a026-802fc6b38352 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:21.951001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 568/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:04:21 2022] GET /identity/v3/users/143c85a141234741a98c1bf813855d66 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:21.956715 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce3fa0-ebdb-4f6c-b5ea-1e642e64720a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:22.051346 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:22.058307 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce3fa0-ebdb-4f6c-b5ea-1e642e64720a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:22.091435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf4d4e-731e-47e4-842a-acec6adc35b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:22.092271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf4d4e-731e-47e4-842a-acec6adc35b3 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:22.092553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf4d4e-731e-47e4-842a-acec6adc35b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:22.092828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf4d4e-731e-47e4-842a-acec6adc35b3 None admin] PATH_INFO: `/v3/projects/d61f22552cfd429ebdbfc1097d6052be` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:22.094000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf4d4e-731e-47e4-842a-acec6adc35b3 None admin] RBAC: Authorizing `identity:get_project(project_id=d61f22552cfd429ebdbfc1097d6052be)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:22.095457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf4d4e-731e-47e4-842a-acec6adc35b3 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:22.097138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 584/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:04:21 2022] GET /identity/v3/projects/d61f22552cfd429ebdbfc1097d6052be => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:22.103652 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b6c9a-3bd6-424f-a026-802fc6b38352 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:22.112741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:22.201182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b6c9a-3bd6-424f-a026-802fc6b38352 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:22.233621 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0daaa-6009-4ea9-bf29-4a0849e00dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:22.234483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0daaa-6009-4ea9-bf29-4a0849e00dfd None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:22.234790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0daaa-6009-4ea9-bf29-4a0849e00dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:22.235065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0daaa-6009-4ea9-bf29-4a0849e00dfd None admin] PATH_INFO: `/v3/projects/d61f22552cfd429ebdbfc1097d6052be/users/143c85a141234741a98c1bf813855d66/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:22.236982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0daaa-6009-4ea9-bf29-4a0849e00dfd None admin] RBAC: Authorizing `identity:create_grant(project_id=d61f22552cfd429ebdbfc1097d6052be, user_id=143c85a141234741a98c1bf813855d66, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:22.238682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0daaa-6009-4ea9-bf29-4a0849e00dfd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:22.251995 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 569/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:04:22 2022] PUT /identity/v3/projects/d61f22552cfd429ebdbfc1097d6052be/users/143c85a141234741a98c1bf813855d66/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:04:24.279291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b6d3-9ae9-49e4-8a0e-9c4b2c8057e8 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:24.279824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b6d3-9ae9-49e4-8a0e-9c4b2c8057e8 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:24.279824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b6d3-9ae9-49e4-8a0e-9c4b2c8057e8 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:24.281205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 585/1154] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:24.286428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b23ecf-fe64-4a4c-88e7-b77791915117 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:24.286825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b23ecf-fe64-4a4c-88e7-b77791915117 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:24.287023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b23ecf-fe64-4a4c-88e7-b77791915117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:24.303383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b1b23ecf-fe64-4a4c-88e7-b77791915117 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:24.305108 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b1b23ecf-fe64-4a4c-88e7-b77791915117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:24.362565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:24.372252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 570/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:24.396394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b6d3-9ae9-49e4-8a0e-9c4b2c8057e8 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:24.495483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b6d3-9ae9-49e4-8a0e-9c4b2c8057e8 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:24.527967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef6828-a53f-4f7f-912b-fa09a60edc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:24.528731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef6828-a53f-4f7f-912b-fa09a60edc36 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:24.529014 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef6828-a53f-4f7f-912b-fa09a60edc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:24.529289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef6828-a53f-4f7f-912b-fa09a60edc36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:24.539186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef6828-a53f-4f7f-912b-fa09a60edc36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-00ef6828-a53f-4f7f-912b-fa09a60edc36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:04:24.546633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:04:24.547714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:04:24.548863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 586/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:04:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:04:24.554086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b23ecf-fe64-4a4c-88e7-b77791915117 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:24.650883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b23ecf-fe64-4a4c-88e7-b77791915117 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:24.684084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959831fa-f809-4c73-ac50-b8e1edd29b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:24.684728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959831fa-f809-4c73-ac50-b8e1edd29b2c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:24.685007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959831fa-f809-4c73-ac50-b8e1edd29b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:24.685278 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959831fa-f809-4c73-ac50-b8e1edd29b2c None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:24.686008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959831fa-f809-4c73-ac50-b8e1edd29b2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:24.686308 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959831fa-f809-4c73-ac50-b8e1edd29b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:24.687692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959831fa-f809-4c73-ac50-b8e1edd29b2c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:24.695682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 571/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:04:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:04:24.701386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef6828-a53f-4f7f-912b-fa09a60edc36 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:24.727828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:24.802081 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef6828-a53f-4f7f-912b-fa09a60edc36 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:24.835662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e3606-05f5-4b85-94e7-a45100cfb75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:24.836514 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e3606-05f5-4b85-94e7-a45100cfb75f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:24.836794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e3606-05f5-4b85-94e7-a45100cfb75f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:24.837069 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e3606-05f5-4b85-94e7-a45100cfb75f None admin] PATH_INFO: `/v3/users/143c85a141234741a98c1bf813855d66` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:24.838254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e3606-05f5-4b85-94e7-a45100cfb75f None admin] RBAC: Authorizing `identity:get_user(user_id=143c85a141234741a98c1bf813855d66)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:24.839711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e3606-05f5-4b85-94e7-a45100cfb75f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:24.841319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 587/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:04:24 2022] GET /identity/v3/users/143c85a141234741a98c1bf813855d66 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:24.847075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959831fa-f809-4c73-ac50-b8e1edd29b2c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:24.904596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:24.946487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959831fa-f809-4c73-ac50-b8e1edd29b2c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:24.978883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfaa2a-ee28-4ece-aa2f-4e3258f18558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:24.979524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfaa2a-ee28-4ece-aa2f-4e3258f18558 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:24.979810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfaa2a-ee28-4ece-aa2f-4e3258f18558 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:24.980090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfaa2a-ee28-4ece-aa2f-4e3258f18558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:25.045880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfaa2a-ee28-4ece-aa2f-4e3258f18558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:25.047346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfaa2a-ee28-4ece-aa2f-4e3258f18558 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:25.101275 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:25.142604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 572/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:04:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:04:25.148511 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e3606-05f5-4b85-94e7-a45100cfb75f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:25.237826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:25.248820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e3606-05f5-4b85-94e7-a45100cfb75f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:25.285215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ac32f-2052-4546-9ff8-c55007cbc1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:25.286064 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ac32f-2052-4546-9ff8-c55007cbc1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:25.286347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ac32f-2052-4546-9ff8-c55007cbc1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:25.286639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ac32f-2052-4546-9ff8-c55007cbc1c2 None admin] PATH_INFO: `/v3/projects/d61f22552cfd429ebdbfc1097d6052be` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:25.287828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ac32f-2052-4546-9ff8-c55007cbc1c2 None admin] RBAC: Authorizing `identity:get_project(project_id=d61f22552cfd429ebdbfc1097d6052be)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:25.289351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ac32f-2052-4546-9ff8-c55007cbc1c2 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:25.291114 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 588/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:04:25 2022] GET /identity/v3/projects/d61f22552cfd429ebdbfc1097d6052be => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:25.297198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfaa2a-ee28-4ece-aa2f-4e3258f18558 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:25.393700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfaa2a-ee28-4ece-aa2f-4e3258f18558 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:25.426563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6daa4-fd95-4497-93c9-0acb0606784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:25.427224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6daa4-fd95-4497-93c9-0acb0606784a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:25.427503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6daa4-fd95-4497-93c9-0acb0606784a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:25.427775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6daa4-fd95-4497-93c9-0acb0606784a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:25.429168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6daa4-fd95-4497-93c9-0acb0606784a None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=d61f22552cfd429ebdbfc1097d6052be, user.id=143c85a141234741a98c1bf813855d66) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:25.429589 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6daa4-fd95-4497-93c9-0acb0606784a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:25.431050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6daa4-fd95-4497-93c9-0acb0606784a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:25.436714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 573/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:04:25 2022] GET /identity/v3/role_assignments?user.id=143c85a141234741a98c1bf813855d66&scope.project.id=d61f22552cfd429ebdbfc1097d6052be&role.id=6fcc322b483a475399974562c1e5bd43 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:27.500269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc9f7-7eac-4860-990f-6d874bf2d2e7 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:27.500796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc9f7-7eac-4860-990f-6d874bf2d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:27.500796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc9f7-7eac-4860-990f-6d874bf2d2e7 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:27.502174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 589/1162] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:27.507360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7de48-ca44-44ef-9690-dda4e6d7ad37 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:27.507802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7de48-ca44-44ef-9690-dda4e6d7ad37 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:27.507897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7de48-ca44-44ef-9690-dda4e6d7ad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:27.525476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b1a7de48-ca44-44ef-9690-dda4e6d7ad37 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:27.526665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b1a7de48-ca44-44ef-9690-dda4e6d7ad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:27.542439 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:27.592412 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 574/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:27.615103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc9f7-7eac-4860-990f-6d874bf2d2e7 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:27.714990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc9f7-7eac-4860-990f-6d874bf2d2e7 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:27.748147 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7785af-dca3-4ef1-ba9e-92d712b4a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:27.748773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7785af-dca3-4ef1-ba9e-92d712b4a80e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:27.749058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7785af-dca3-4ef1-ba9e-92d712b4a80e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:27.749335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7785af-dca3-4ef1-ba9e-92d712b4a80e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:27.776929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:27.816774 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7785af-dca3-4ef1-ba9e-92d712b4a80e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:27.818205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7785af-dca3-4ef1-ba9e-92d712b4a80e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:27.912471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 590/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:04:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:04:27.919150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7de48-ca44-44ef-9690-dda4e6d7ad37 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:28.013424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7de48-ca44-44ef-9690-dda4e6d7ad37 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:28.046276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe250257-2a7e-4e46-8822-029163ff2e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:28.047025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe250257-2a7e-4e46-8822-029163ff2e4c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:28.047324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe250257-2a7e-4e46-8822-029163ff2e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:28.047579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe250257-2a7e-4e46-8822-029163ff2e4c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:28.054117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe250257-2a7e-4e46-8822-029163ff2e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:28.055564 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe250257-2a7e-4e46-8822-029163ff2e4c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-fe250257-2a7e-4e46-8822-029163ff2e4c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:04:28.069362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:04:28.070547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:04:28.071795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 575/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 08:04:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:04:28.076575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7785af-dca3-4ef1-ba9e-92d712b4a80e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:28.133480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:28.173843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7785af-dca3-4ef1-ba9e-92d712b4a80e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:28.206419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562d05f-744f-4992-bf2f-068ddd8e8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:28.207092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562d05f-744f-4992-bf2f-068ddd8e8703 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:28.207373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562d05f-744f-4992-bf2f-068ddd8e8703 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:28.207648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562d05f-744f-4992-bf2f-068ddd8e8703 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:28.208359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562d05f-744f-4992-bf2f-068ddd8e8703 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:28.208661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562d05f-744f-4992-bf2f-068ddd8e8703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:28.210533 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562d05f-744f-4992-bf2f-068ddd8e8703 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:28.217655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 591/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 08:04:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:30.254177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1f727-b766-4ea8-b553-0bce44eea974 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:30.254838 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1f727-b766-4ea8-b553-0bce44eea974 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:30.254838 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1f727-b766-4ea8-b553-0bce44eea974 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:30.256118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 576/1167] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:30.261469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7397bdc-2a5c-4e6c-b5de-de88b51eec49 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:30.261850 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7397bdc-2a5c-4e6c-b5de-de88b51eec49 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:30.262029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7397bdc-2a5c-4e6c-b5de-de88b51eec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:30.279361 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-c7397bdc-2a5c-4e6c-b5de-de88b51eec49 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:30.280541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c7397bdc-2a5c-4e6c-b5de-de88b51eec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:30.346739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 592/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:30.370920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1f727-b766-4ea8-b553-0bce44eea974 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:30.386101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:30.469806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1f727-b766-4ea8-b553-0bce44eea974 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:30.502396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b376e-92d1-48a0-934e-3b13a0b73fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:30.503052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b376e-92d1-48a0-934e-3b13a0b73fe1 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:30.503331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b376e-92d1-48a0-934e-3b13a0b73fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:30.503600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b376e-92d1-48a0-934e-3b13a0b73fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:30.504380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b376e-92d1-48a0-934e-3b13a0b73fe1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:30.505679 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b376e-92d1-48a0-934e-3b13a0b73fe1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:30.519573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 577/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Tue Jun 21 08:04:30 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:04:32.568909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6472ac-1224-4f96-a603-b61dacbeea65 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:32.569482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6472ac-1224-4f96-a603-b61dacbeea65 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:32.569482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6472ac-1224-4f96-a603-b61dacbeea65 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:32.571472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 593/1170] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:32.576683 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04dbd7-fb7f-4509-9d22-57ce41c8d2dd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:32.577098 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04dbd7-fb7f-4509-9d22-57ce41c8d2dd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:32.577247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04dbd7-fb7f-4509-9d22-57ce41c8d2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:32.593665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-cb04dbd7-fb7f-4509-9d22-57ce41c8d2dd None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:32.594903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cb04dbd7-fb7f-4509-9d22-57ce41c8d2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:32.660225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 578/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 08:04:32.683936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6472ac-1224-4f96-a603-b61dacbeea65 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:32.738902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:32.783684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6472ac-1224-4f96-a603-b61dacbeea65 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:32.816412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861e6dd-ab34-44f2-934d-d60ffe8d7dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:32.817248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861e6dd-ab34-44f2-934d-d60ffe8d7dcd None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:32.817528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861e6dd-ab34-44f2-934d-d60ffe8d7dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:32.817798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861e6dd-ab34-44f2-934d-d60ffe8d7dcd None admin] PATH_INFO: `/v3/domains/7c60b44d36014292b7521bd3635a218e` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:32.828626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861e6dd-ab34-44f2-934d-d60ffe8d7dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=7c60b44d36014292b7521bd3635a218e)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:32.829998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861e6dd-ab34-44f2-934d-d60ffe8d7dcd None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:32.831633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 594/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Tue Jun 21 08:04:32 2022] GET /identity/v3/domains/7c60b44d36014292b7521bd3635a218e => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:32.837877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04dbd7-fb7f-4509-9d22-57ce41c8d2dd None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:32.840090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:32.936036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04dbd7-fb7f-4509-9d22-57ce41c8d2dd None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:32.968063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c792ed-da62-402b-b963-7842283a1bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:32.968711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c792ed-da62-402b-b963-7842283a1bc9 None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:32.968996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c792ed-da62-402b-b963-7842283a1bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:32.969273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c792ed-da62-402b-b963-7842283a1bc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:32.969975 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c792ed-da62-402b-b963-7842283a1bc9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:32.971430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c792ed-da62-402b-b963-7842283a1bc9 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:32.997263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 579/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:04:32 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:04:35.065632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3022a-4009-4114-aed6-143c334bc390 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:35.066202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3022a-4009-4114-aed6-143c334bc390 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:35.066202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3022a-4009-4114-aed6-143c334bc390 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:35.067583 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 595/1174] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:35.073398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dec5c1-170d-4131-aeb1-cadb99d6ceff None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:35.073826 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dec5c1-170d-4131-aeb1-cadb99d6ceff None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:35.073962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dec5c1-170d-4131-aeb1-cadb99d6ceff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:35.090473 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-61dec5c1-170d-4131-aeb1-cadb99d6ceff None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:35.091680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-61dec5c1-170d-4131-aeb1-cadb99d6ceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:35.140264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:35.158203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 580/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:35.183372 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3022a-4009-4114-aed6-143c334bc390 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:35.280596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3022a-4009-4114-aed6-143c334bc390 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:35.294427 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:35.314161 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b58bc0-3001-486e-a9b9-b489d0e5bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:35.315027 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b58bc0-3001-486e-a9b9-b489d0e5bf79 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:35.315311 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b58bc0-3001-486e-a9b9-b489d0e5bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:35.315582 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b58bc0-3001-486e-a9b9-b489d0e5bf79 None admin] PATH_INFO: `/v3/domains/7c60b44d36014292b7521bd3635a218e` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:35.316779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b58bc0-3001-486e-a9b9-b489d0e5bf79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7c60b44d36014292b7521bd3635a218e)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:35.318149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b58bc0-3001-486e-a9b9-b489d0e5bf79 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:35.320466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 596/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Tue Jun 21 08:04:35 2022] GET /identity/v3/domains/7c60b44d36014292b7521bd3635a218e => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:35.326048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dec5c1-170d-4131-aeb1-cadb99d6ceff None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:35.422459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dec5c1-170d-4131-aeb1-cadb99d6ceff None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:35.455606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40c951-64d8-45ae-a0e7-48880afea53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:35.456259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40c951-64d8-45ae-a0e7-48880afea53e None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:35.456544 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40c951-64d8-45ae-a0e7-48880afea53e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:35.456822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40c951-64d8-45ae-a0e7-48880afea53e None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:35.457536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40c951-64d8-45ae-a0e7-48880afea53e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:35.458985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40c951-64d8-45ae-a0e7-48880afea53e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:35.479130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 581/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:04:35 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:04:37.572499 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd768c87-d6f2-4c9b-9c0f-98e502d31fff None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:37.572945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd768c87-d6f2-4c9b-9c0f-98e502d31fff None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:37.573045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd768c87-d6f2-4c9b-9c0f-98e502d31fff None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:37.574414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 597/1178] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:37.579586 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f80de-f1c3-4908-980f-5f628ddb64ec None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:37.580014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f80de-f1c3-4908-980f-5f628ddb64ec None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:37.580146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f80de-f1c3-4908-980f-5f628ddb64ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:37.597040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-df4f80de-f1c3-4908-980f-5f628ddb64ec None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:37.598223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-df4f80de-f1c3-4908-980f-5f628ddb64ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:37.632100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:37.666312 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 582/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:37.690034 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd768c87-d6f2-4c9b-9c0f-98e502d31fff None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:37.789917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd768c87-d6f2-4c9b-9c0f-98e502d31fff None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:37.823452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6895813-c9f6-44c1-a644-26b468f3b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:37.824167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6895813-c9f6-44c1-a644-26b468f3b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:37.824453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6895813-c9f6-44c1-a644-26b468f3b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:37.824731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6895813-c9f6-44c1-a644-26b468f3b0e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:37.835000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6895813-c9f6-44c1-a644-26b468f3b0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-c6895813-c9f6-44c1-a644-26b468f3b0e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:04:37.842532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:04:37.843723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:04:37.844798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 598/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:04:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:04:37.849590 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f80de-f1c3-4908-980f-5f628ddb64ec None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:37.945096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f80de-f1c3-4908-980f-5f628ddb64ec None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:37.977584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ea711-9408-4b19-9b7e-23b423a8160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:37.978227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ea711-9408-4b19-9b7e-23b423a8160f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:37.978507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ea711-9408-4b19-9b7e-23b423a8160f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:37.978812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ea711-9408-4b19-9b7e-23b423a8160f None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:37.979546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ea711-9408-4b19-9b7e-23b423a8160f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:37.979849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ea711-9408-4b19-9b7e-23b423a8160f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:37.981207 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ea711-9408-4b19-9b7e-23b423a8160f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:37.989321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 583/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:04:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:37.995569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6895813-c9f6-44c1-a644-26b468f3b0e7 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:38.039452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:38.094761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6895813-c9f6-44c1-a644-26b468f3b0e7 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:38.128464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4049c-69ab-432a-898f-a6ade0bc7077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:38.129315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4049c-69ab-432a-898f-a6ade0bc7077 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:38.129593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4049c-69ab-432a-898f-a6ade0bc7077 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:38.129862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4049c-69ab-432a-898f-a6ade0bc7077 None admin] PATH_INFO: `/v3/users/1c619165842f4b4494b0c47f47c735f5` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:38.143167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4049c-69ab-432a-898f-a6ade0bc7077 None admin] RBAC: Authorizing `identity:get_user(user_id=1c619165842f4b4494b0c47f47c735f5)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:38.144589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4049c-69ab-432a-898f-a6ade0bc7077 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:38.146208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 599/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:04:37 2022] GET /identity/v3/users/1c619165842f4b4494b0c47f47c735f5 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:38.152045 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ea711-9408-4b19-9b7e-23b423a8160f None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:38.183244 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:38.253472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ea711-9408-4b19-9b7e-23b423a8160f None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:38.286911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ded1a-3366-499c-88d3-39448f5d9c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:38.288089 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ded1a-3366-499c-88d3-39448f5d9c63 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:38.288089 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ded1a-3366-499c-88d3-39448f5d9c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:38.288089 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ded1a-3366-499c-88d3-39448f5d9c63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:38.353369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ded1a-3366-499c-88d3-39448f5d9c63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:38.354763 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ded1a-3366-499c-88d3-39448f5d9c63 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:38.383614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:38.449188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 584/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:04:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:04:38.455203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4049c-69ab-432a-898f-a6ade0bc7077 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:38.552824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:38.555880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4049c-69ab-432a-898f-a6ade0bc7077 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:38.589666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed1c68-bf68-4609-b877-e30d9d98dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:38.590512 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed1c68-bf68-4609-b877-e30d9d98dd04 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:38.590822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed1c68-bf68-4609-b877-e30d9d98dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:38.591094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed1c68-bf68-4609-b877-e30d9d98dd04 None admin] PATH_INFO: `/v3/projects/6d9c496e56164c98869a3fdd158c5f6b` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:38.592248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed1c68-bf68-4609-b877-e30d9d98dd04 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9c496e56164c98869a3fdd158c5f6b)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:38.593662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed1c68-bf68-4609-b877-e30d9d98dd04 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:38.595375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 600/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:04:38 2022] GET /identity/v3/projects/6d9c496e56164c98869a3fdd158c5f6b => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:38.602113 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ded1a-3366-499c-88d3-39448f5d9c63 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:38.698862 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ded1a-3366-499c-88d3-39448f5d9c63 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:38.727498 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:38.732698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687799ca-2c80-429e-ad6a-e8548608f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:38.733333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687799ca-2c80-429e-ad6a-e8548608f87f None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:38.733616 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687799ca-2c80-429e-ad6a-e8548608f87f None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:38.733893 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687799ca-2c80-429e-ad6a-e8548608f87f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:38.734750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687799ca-2c80-429e-ad6a-e8548608f87f None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=6d9c496e56164c98869a3fdd158c5f6b, user.id=1c619165842f4b4494b0c47f47c735f5) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:38.735062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687799ca-2c80-429e-ad6a-e8548608f87f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:38.736478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687799ca-2c80-429e-ad6a-e8548608f87f None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:38.742753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 585/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:04:38 2022] GET /identity/v3/role_assignments?user.id=1c619165842f4b4494b0c47f47c735f5&scope.project.id=6d9c496e56164c98869a3fdd158c5f6b&role.id=6fcc322b483a475399974562c1e5bd43 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:40.738262 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a94d7-3a0e-4646-a941-3ccbaff5985d None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:40.738812 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a94d7-3a0e-4646-a941-3ccbaff5985d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:40.738927 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a94d7-3a0e-4646-a941-3ccbaff5985d None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:40.740202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 601/1186] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:40.745865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe7369-31ce-4956-8402-c79a65dad3a4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:40.746268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe7369-31ce-4956-8402-c79a65dad3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:40.746412 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe7369-31ce-4956-8402-c79a65dad3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:40.763363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2bbe7369-31ce-4956-8402-c79a65dad3a4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:40.764526 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2bbe7369-31ce-4956-8402-c79a65dad3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:40.828255 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 586/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:40.851310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a94d7-3a0e-4646-a941-3ccbaff5985d None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:40.951171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a94d7-3a0e-4646-a941-3ccbaff5985d None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:40.987124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66ec99-316b-4667-a738-c6ba28d711a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:40.987903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66ec99-316b-4667-a738-c6ba28d711a0 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:40.988448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66ec99-316b-4667-a738-c6ba28d711a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:40.988721 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66ec99-316b-4667-a738-c6ba28d711a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:40.999150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66ec99-316b-4667-a738-c6ba28d711a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-7f66ec99-316b-4667-a738-c6ba28d711a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:04:41.007286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:04:41.008374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:04:41.009595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 602/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:04:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:04:41.014606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe7369-31ce-4956-8402-c79a65dad3a4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:41.110905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe7369-31ce-4956-8402-c79a65dad3a4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:41.136223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:41.145009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d1e9-1272-4b12-b384-af126240a9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:41.145663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d1e9-1272-4b12-b384-af126240a9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:41.145947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d1e9-1272-4b12-b384-af126240a9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:41.146222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d1e9-1272-4b12-b384-af126240a9a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:41.147560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577d1e9-1272-4b12-b384-af126240a9a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:41.147867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577d1e9-1272-4b12-b384-af126240a9a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:41.149232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577d1e9-1272-4b12-b384-af126240a9a4 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:41.157072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 587/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:04:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:41.162807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66ec99-316b-4667-a738-c6ba28d711a0 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:41.190418 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:41.266464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66ec99-316b-4667-a738-c6ba28d711a0 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:41.298929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c8e1e-232e-4439-917d-2c253e5a299c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:41.299774 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c8e1e-232e-4439-917d-2c253e5a299c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:41.300053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c8e1e-232e-4439-917d-2c253e5a299c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:41.300324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c8e1e-232e-4439-917d-2c253e5a299c None admin] PATH_INFO: `/v3/users/1c619165842f4b4494b0c47f47c735f5` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:41.301479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c8e1e-232e-4439-917d-2c253e5a299c None admin] RBAC: Authorizing `identity:get_user(user_id=1c619165842f4b4494b0c47f47c735f5)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:41.302932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c8e1e-232e-4439-917d-2c253e5a299c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:41.304542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 603/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:04:41 2022] GET /identity/v3/users/1c619165842f4b4494b0c47f47c735f5 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:41.310246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d1e9-1272-4b12-b384-af126240a9a4 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:41.407682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d1e9-1272-4b12-b384-af126240a9a4 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:41.439315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a7de1-c14c-43d7-970d-65d559b38276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:41.440153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7de1-c14c-43d7-970d-65d559b38276 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:41.440435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7de1-c14c-43d7-970d-65d559b38276 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:41.440710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7de1-c14c-43d7-970d-65d559b38276 None admin] PATH_INFO: `/v3/projects/6d9c496e56164c98869a3fdd158c5f6b` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:41.441878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a7de1-c14c-43d7-970d-65d559b38276 None admin] RBAC: Authorizing `identity:get_project(project_id=6d9c496e56164c98869a3fdd158c5f6b)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:41.443324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a7de1-c14c-43d7-970d-65d559b38276 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:41.445651 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 588/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:04:41 2022] GET /identity/v3/projects/6d9c496e56164c98869a3fdd158c5f6b => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:04:41.451543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c8e1e-232e-4439-917d-2c253e5a299c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:41.544393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:41.550330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c8e1e-232e-4439-917d-2c253e5a299c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:41.583575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e603c72-6de2-46be-a7bb-fa2ca7545434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:41.584474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e603c72-6de2-46be-a7bb-fa2ca7545434 None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:41.584755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e603c72-6de2-46be-a7bb-fa2ca7545434 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:41.585020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e603c72-6de2-46be-a7bb-fa2ca7545434 None admin] PATH_INFO: `/v3/projects/6d9c496e56164c98869a3fdd158c5f6b/users/1c619165842f4b4494b0c47f47c735f5/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:41.586970 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e603c72-6de2-46be-a7bb-fa2ca7545434 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d9c496e56164c98869a3fdd158c5f6b, user_id=1c619165842f4b4494b0c47f47c735f5, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:41.588384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e603c72-6de2-46be-a7bb-fa2ca7545434 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:41.600623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 604/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:04:41 2022] PUT /identity/v3/projects/6d9c496e56164c98869a3fdd158c5f6b/users/1c619165842f4b4494b0c47f47c735f5/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:04:43.632419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c42b0-a000-4d82-b424-67c0dd6d548c None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:43.632958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c42b0-a000-4d82-b424-67c0dd6d548c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:43.632958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c42b0-a000-4d82-b424-67c0dd6d548c None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:43.634334 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 589/1193] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:04:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:04:43.639370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de877f-b95c-49d5-85d9-529d545577b3 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:43.639803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de877f-b95c-49d5-85d9-529d545577b3 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:43.639912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de877f-b95c-49d5-85d9-529d545577b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:43.657254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e8de877f-b95c-49d5-85d9-529d545577b3 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:04:43.658435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e8de877f-b95c-49d5-85d9-529d545577b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:04:43.723599 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 605/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:04:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:04:43.747054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c42b0-a000-4d82-b424-67c0dd6d548c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:43.801822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:43.845368 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c42b0-a000-4d82-b424-67c0dd6d548c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:43.877976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280f7a-d16e-4447-94cd-b33407be075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:43.878838 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280f7a-d16e-4447-94cd-b33407be075d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:43.879124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280f7a-d16e-4447-94cd-b33407be075d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:43.879397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280f7a-d16e-4447-94cd-b33407be075d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:43.889221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e280f7a-d16e-4447-94cd-b33407be075d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-7e280f7a-d16e-4447-94cd-b33407be075d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:04:43.897233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:04:43.898329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:04:43.899548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 590/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:04:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:04:43.904360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de877f-b95c-49d5-85d9-529d545577b3 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:43.987026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:44.002975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de877f-b95c-49d5-85d9-529d545577b3 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:44.035819 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9b0d1-347b-45bd-a5f0-55819287c814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:44.036473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9b0d1-347b-45bd-a5f0-55819287c814 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:44.036755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9b0d1-347b-45bd-a5f0-55819287c814 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:44.037030 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9b0d1-347b-45bd-a5f0-55819287c814 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:44.038520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9b0d1-347b-45bd-a5f0-55819287c814 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:44.038854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9b0d1-347b-45bd-a5f0-55819287c814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:44.040229 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9b0d1-347b-45bd-a5f0-55819287c814 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:44.048063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 606/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:04:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:44.053816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280f7a-d16e-4447-94cd-b33407be075d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:44.155427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280f7a-d16e-4447-94cd-b33407be075d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:44.171134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:44.189115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0b137-b132-4d6a-ab20-61547141de3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:44.189960 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0b137-b132-4d6a-ab20-61547141de3b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:44.190237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0b137-b132-4d6a-ab20-61547141de3b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:44.190507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0b137-b132-4d6a-ab20-61547141de3b None admin] PATH_INFO: `/v3/users/1c619165842f4b4494b0c47f47c735f5` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:44.191715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0b137-b132-4d6a-ab20-61547141de3b None admin] RBAC: Authorizing `identity:get_user(user_id=1c619165842f4b4494b0c47f47c735f5)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:44.193154 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0b137-b132-4d6a-ab20-61547141de3b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:44.195779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 591/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 08:04:44 2022] GET /identity/v3/users/1c619165842f4b4494b0c47f47c735f5 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:44.201401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9b0d1-347b-45bd-a5f0-55819287c814 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:44.308934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9b0d1-347b-45bd-a5f0-55819287c814 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:44.349518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296668d-d937-4687-832a-c0240c8e4b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:44.350197 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296668d-d937-4687-832a-c0240c8e4b4d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:44.350479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296668d-d937-4687-832a-c0240c8e4b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:44.350780 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296668d-d937-4687-832a-c0240c8e4b4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:44.368265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:44.424002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296668d-d937-4687-832a-c0240c8e4b4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:44.425370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296668d-d937-4687-832a-c0240c8e4b4d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:44.544284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 607/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:04:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:04:44.550235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0b137-b132-4d6a-ab20-61547141de3b None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:44.671596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0b137-b132-4d6a-ab20-61547141de3b None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:44.706506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fbe15-e6e0-455e-a70e-92b85f28781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:44.707354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fbe15-e6e0-455e-a70e-92b85f28781c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:44.707633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fbe15-e6e0-455e-a70e-92b85f28781c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:44.707907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fbe15-e6e0-455e-a70e-92b85f28781c None admin] PATH_INFO: `/v3/projects/6d9c496e56164c98869a3fdd158c5f6b` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:44.709168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fbe15-e6e0-455e-a70e-92b85f28781c None admin] RBAC: Authorizing `identity:get_project(project_id=6d9c496e56164c98869a3fdd158c5f6b)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:44.711172 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fbe15-e6e0-455e-a70e-92b85f28781c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:44.712884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 592/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 08:04:44 2022] GET /identity/v3/projects/6d9c496e56164c98869a3fdd158c5f6b => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:44.720507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296668d-d937-4687-832a-c0240c8e4b4d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:04:44.777296 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:44.830648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296668d-d937-4687-832a-c0240c8e4b4d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:04:44.868382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e512d-6f3d-4ee8-9baf-d98a01df4f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:04:44.869025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e512d-6f3d-4ee8-9baf-d98a01df4f20 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:04:44.869312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e512d-6f3d-4ee8-9baf-d98a01df4f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:04:44.869589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e512d-6f3d-4ee8-9baf-d98a01df4f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:04:44.870417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e512d-6f3d-4ee8-9baf-d98a01df4f20 None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=6d9c496e56164c98869a3fdd158c5f6b, user.id=1c619165842f4b4494b0c47f47c735f5) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:04:44.870760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e512d-6f3d-4ee8-9baf-d98a01df4f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:04:44.872203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e512d-6f3d-4ee8-9baf-d98a01df4f20 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:04:44.878853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 608/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:04:44 2022] GET /identity/v3/role_assignments?user.id=1c619165842f4b4494b0c47f47c735f5&scope.project.id=6d9c496e56164c98869a3fdd158c5f6b&role.id=6fcc322b483a475399974562c1e5bd43 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:04:54.702395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=74 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:04:54.876160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=44 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:40.657634 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8da76-443b-4cd5-be17-01271b033d32 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:40.658233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8da76-443b-4cd5-be17-01271b033d32 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:40.658233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8da76-443b-4cd5-be17-01271b033d32 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:40.659874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 593/1201] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:05:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:05:40.668352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc0dca-ef7a-4c91-a237-f19421e6a9e6 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:40.668352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc0dca-ef7a-4c91-a237-f19421e6a9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:40.668352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc0dca-ef7a-4c91-a237-f19421e6a9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:40.688524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-25fc0dca-ef7a-4c91-a237-f19421e6a9e6 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:05:40.690037 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-25fc0dca-ef7a-4c91-a237-f19421e6a9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:05:40.780029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 609/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:05:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:05:40.805394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8da76-443b-4cd5-be17-01271b033d32 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:40.948023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8da76-443b-4cd5-be17-01271b033d32 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:40.989553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bca7dc-9d4a-406c-bc09-a3d91c503722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:40.990387 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bca7dc-9d4a-406c-bc09-a3d91c503722 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:40.990694 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bca7dc-9d4a-406c-bc09-a3d91c503722 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:40.990974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bca7dc-9d4a-406c-bc09-a3d91c503722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:41.002316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bca7dc-9d4a-406c-bc09-a3d91c503722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:41.003858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bca7dc-9d4a-406c-bc09-a3d91c503722 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-c3bca7dc-9d4a-406c-bc09-a3d91c503722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:05:41.027756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:41.028816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:41.029799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:05:41.029799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:05:41.029799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:41.029799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:05:41.034043 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 594/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:41.035122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc0dca-ef7a-4c91-a237-f19421e6a9e6 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:41.182323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc0dca-ef7a-4c91-a237-f19421e6a9e6 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:41.215352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:41.222301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcb5f4-38f9-42b1-92b8-94a1dde1d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:41.223633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcb5f4-38f9-42b1-92b8-94a1dde1d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:41.224062 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcb5f4-38f9-42b1-92b8-94a1dde1d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:41.224423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcb5f4-38f9-42b1-92b8-94a1dde1d1c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:41.225198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcb5f4-38f9-42b1-92b8-94a1dde1d1c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:41.225502 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcb5f4-38f9-42b1-92b8-94a1dde1d1c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:41.227004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcb5f4-38f9-42b1-92b8-94a1dde1d1c7 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:41.242655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 610/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:41.246209 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bca7dc-9d4a-406c-bc09-a3d91c503722 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:41.312519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:41.384852 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bca7dc-9d4a-406c-bc09-a3d91c503722 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:41.429757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6210b-d672-4359-a982-c0865c5798aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:41.430535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6210b-d672-4359-a982-c0865c5798aa None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:41.430842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6210b-d672-4359-a982-c0865c5798aa None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:41.431156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6210b-d672-4359-a982-c0865c5798aa None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:41.431903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6210b-d672-4359-a982-c0865c5798aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:41.433508 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6210b-d672-4359-a982-c0865c5798aa None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:41.455948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 595/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 08:05:41 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:05:43.694527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64151edd-543b-438b-ac48-ff0cefcfbc07 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:43.695076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64151edd-543b-438b-ac48-ff0cefcfbc07 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:43.695181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64151edd-543b-438b-ac48-ff0cefcfbc07 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:43.696467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 611/1206] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:05:43.701800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c675-b39e-48f5-8177-da6fac09a5dc None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:43.702260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c675-b39e-48f5-8177-da6fac09a5dc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:43.702355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c675-b39e-48f5-8177-da6fac09a5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:43.719419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-65b0c675-b39e-48f5-8177-da6fac09a5dc None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:05:43.723458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-65b0c675-b39e-48f5-8177-da6fac09a5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:05:43.798491 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 596/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:05:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:05:43.822610 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64151edd-543b-438b-ac48-ff0cefcfbc07 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:43.938955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64151edd-543b-438b-ac48-ff0cefcfbc07 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:43.984673 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889439a-b1f8-45c2-aead-f2c7d18600ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:43.985508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889439a-b1f8-45c2-aead-f2c7d18600ae None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:43.985783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889439a-b1f8-45c2-aead-f2c7d18600ae None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:43.986008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889439a-b1f8-45c2-aead-f2c7d18600ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:43.998170 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889439a-b1f8-45c2-aead-f2c7d18600ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-7889439a-b1f8-45c2-aead-f2c7d18600ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:05:44.007480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:44.008476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:05:44.009322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 612/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:05:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:44.015277 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c675-b39e-48f5-8177-da6fac09a5dc None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:44.065946 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:44.139062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c675-b39e-48f5-8177-da6fac09a5dc None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:44.177479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590895f3-8c69-46ce-8ec3-7b8a90d0ccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:44.178202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590895f3-8c69-46ce-8ec3-7b8a90d0ccb1 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:44.178480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590895f3-8c69-46ce-8ec3-7b8a90d0ccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:44.178866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590895f3-8c69-46ce-8ec3-7b8a90d0ccb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:44.179614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590895f3-8c69-46ce-8ec3-7b8a90d0ccb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:44.179923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590895f3-8c69-46ce-8ec3-7b8a90d0ccb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:44.181338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590895f3-8c69-46ce-8ec3-7b8a90d0ccb1 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:44.190140 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 597/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:05:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:05:44.196373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889439a-b1f8-45c2-aead-f2c7d18600ae None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:44.254722 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:44.318024 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889439a-b1f8-45c2-aead-f2c7d18600ae None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:44.360517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70918e-28df-4896-812f-3dbb49169e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:44.361400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70918e-28df-4896-812f-3dbb49169e27 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:44.361735 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70918e-28df-4896-812f-3dbb49169e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:44.362054 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70918e-28df-4896-812f-3dbb49169e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:44.375106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70918e-28df-4896-812f-3dbb49169e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:44.376643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70918e-28df-4896-812f-3dbb49169e27 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-bd70918e-28df-4896-812f-3dbb49169e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:05:44.395836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:44.396793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:44.397772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:05:44.397772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:05:44.397772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:44.397772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:05:44.401623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 613/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:44.403040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590895f3-8c69-46ce-8ec3-7b8a90d0ccb1 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:44.529519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:44.533361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590895f3-8c69-46ce-8ec3-7b8a90d0ccb1 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:44.578119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22213c-f971-4b20-91d0-a1a92d4cc475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:44.578834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22213c-f971-4b20-91d0-a1a92d4cc475 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:44.579155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22213c-f971-4b20-91d0-a1a92d4cc475 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:44.579607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22213c-f971-4b20-91d0-a1a92d4cc475 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:44.580299 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22213c-f971-4b20-91d0-a1a92d4cc475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:44.580675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22213c-f971-4b20-91d0-a1a92d4cc475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:44.582190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22213c-f971-4b20-91d0-a1a92d4cc475 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:44.600261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 598/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:44.601836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70918e-28df-4896-812f-3dbb49169e27 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:44.738345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70918e-28df-4896-812f-3dbb49169e27 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:44.740594 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:44.778180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c654c-96b3-439a-829b-4c88419453b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:44.779214 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c654c-96b3-439a-829b-4c88419453b6 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:44.779521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c654c-96b3-439a-829b-4c88419453b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:44.779820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c654c-96b3-439a-829b-4c88419453b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:44.790518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c654c-96b3-439a-829b-4c88419453b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:44.792009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c654c-96b3-439a-829b-4c88419453b6 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-f45c654c-96b3-439a-829b-4c88419453b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:05:44.807176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:44.808188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:44.809149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:44.809149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:44.809149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:05:44.809149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:05:44.809149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:05:44.809149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:05:44.809149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:05:44.809149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:05:44.809149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 08:05:44.809149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:05:44.809149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 614/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:44.814551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22213c-f971-4b20-91d0-a1a92d4cc475 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:44.931024 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22213c-f971-4b20-91d0-a1a92d4cc475 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:44.972405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86beb7-96c2-4db3-9944-19ed1a71a497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:44.973955 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86beb7-96c2-4db3-9944-19ed1a71a497 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:44.974344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86beb7-96c2-4db3-9944-19ed1a71a497 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:44.974664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86beb7-96c2-4db3-9944-19ed1a71a497 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:44.975916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86beb7-96c2-4db3-9944-19ed1a71a497 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:44.975916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86beb7-96c2-4db3-9944-19ed1a71a497 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:44.977261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86beb7-96c2-4db3-9944-19ed1a71a497 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:44.996664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 599/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 21 08:05:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:45.002852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c654c-96b3-439a-829b-4c88419453b6 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:45.123005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c654c-96b3-439a-829b-4c88419453b6 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:45.161635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9da65d-2c17-49ec-b128-1ba53404454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:45.162733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9da65d-2c17-49ec-b128-1ba53404454e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:45.163045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9da65d-2c17-49ec-b128-1ba53404454e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:45.163393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9da65d-2c17-49ec-b128-1ba53404454e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:45.198153 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:45.241988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9da65d-2c17-49ec-b128-1ba53404454e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:45.243500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9da65d-2c17-49ec-b128-1ba53404454e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:45.372150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 615/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:05:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 08:05:45.378955 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86beb7-96c2-4db3-9944-19ed1a71a497 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:45.406967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:45.499315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86beb7-96c2-4db3-9944-19ed1a71a497 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:45.551467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522ee8a-a4e5-4013-afaa-4557722a59b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:45.552592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522ee8a-a4e5-4013-afaa-4557722a59b7 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:45.552912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522ee8a-a4e5-4013-afaa-4557722a59b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:45.553188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522ee8a-a4e5-4013-afaa-4557722a59b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:45.571112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522ee8a-a4e5-4013-afaa-4557722a59b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:45.573555 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522ee8a-a4e5-4013-afaa-4557722a59b7 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-8522ee8a-a4e5-4013-afaa-4557722a59b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:05:45.602503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:45.603548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:45.604660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:05:45.604660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:05:45.604660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:45.604660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:05:45.610496 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 600/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:45.612048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9da65d-2c17-49ec-b128-1ba53404454e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:45.682167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:45.732352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9da65d-2c17-49ec-b128-1ba53404454e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:45.774605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5007b-3fb6-4850-92af-d70545d66d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:45.776844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5007b-3fb6-4850-92af-d70545d66d9e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:45.777290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5007b-3fb6-4850-92af-d70545d66d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:45.777652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5007b-3fb6-4850-92af-d70545d66d9e None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:45.778520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5007b-3fb6-4850-92af-d70545d66d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:45.778769 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5007b-3fb6-4850-92af-d70545d66d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:45.780946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5007b-3fb6-4850-92af-d70545d66d9e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:45.801853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 616/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:45.807956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522ee8a-a4e5-4013-afaa-4557722a59b7 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:45.895582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:45.946477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522ee8a-a4e5-4013-afaa-4557722a59b7 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:45.995890 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7482fa-8db9-48de-ae84-cc5afbf8478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:45.998828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7482fa-8db9-48de-ae84-cc5afbf8478d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:45.999288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7482fa-8db9-48de-ae84-cc5afbf8478d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:45.999676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7482fa-8db9-48de-ae84-cc5afbf8478d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:46.008234 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7482fa-8db9-48de-ae84-cc5afbf8478d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:46.010142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7482fa-8db9-48de-ae84-cc5afbf8478d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-6f7482fa-8db9-48de-ae84-cc5afbf8478d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:05:46.024881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:46.027823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:46.029667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:05:46.029667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:05:46.029667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:05:46.029667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:05:46.029667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:05:46.029667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:05:46.029667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:05:46.029667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:05:46.031041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 601/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:46.032990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5007b-3fb6-4850-92af-d70545d66d9e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:46.191322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5007b-3fb6-4850-92af-d70545d66d9e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:46.225629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:46.247158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345fee5-9ea4-4738-9ece-c7458fc51e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:46.247972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345fee5-9ea4-4738-9ece-c7458fc51e32 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:46.248319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345fee5-9ea4-4738-9ece-c7458fc51e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:46.248652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345fee5-9ea4-4738-9ece-c7458fc51e32 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:46.251435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345fee5-9ea4-4738-9ece-c7458fc51e32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:46.251899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345fee5-9ea4-4738-9ece-c7458fc51e32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:46.254014 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345fee5-9ea4-4738-9ece-c7458fc51e32 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:46.279793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 617/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:05:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:46.287522 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7482fa-8db9-48de-ae84-cc5afbf8478d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:46.432642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7482fa-8db9-48de-ae84-cc5afbf8478d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:46.466769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:46.475432 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e906160-373f-4b59-a7a3-9ac0be382948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:46.476320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906160-373f-4b59-a7a3-9ac0be382948 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:46.476708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906160-373f-4b59-a7a3-9ac0be382948 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:46.477148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906160-373f-4b59-a7a3-9ac0be382948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:46.478139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e906160-373f-4b59-a7a3-9ac0be382948 None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=53dfc3572d05469ca7e2de1acea3629a) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:46.478545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e906160-373f-4b59-a7a3-9ac0be382948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:46.480178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e906160-373f-4b59-a7a3-9ac0be382948 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:46.487078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 602/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:05:46 2022] GET /identity/v3/role_assignments?user.id=53dfc3572d05469ca7e2de1acea3629a&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:48.611004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05d3bc-81ff-4212-8cd1-023c18eb6833 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:48.611618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05d3bc-81ff-4212-8cd1-023c18eb6833 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:48.611618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05d3bc-81ff-4212-8cd1-023c18eb6833 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:48.613196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 618/1220] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:05:48.618625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8782b6-6577-43b6-8298-ad32bbee94f1 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:48.619047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8782b6-6577-43b6-8298-ad32bbee94f1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:48.619208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8782b6-6577-43b6-8298-ad32bbee94f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:48.637588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2a8782b6-6577-43b6-8298-ad32bbee94f1 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:05:48.638952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2a8782b6-6577-43b6-8298-ad32bbee94f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:05:48.715155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 603/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:05:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:05:48.740321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05d3bc-81ff-4212-8cd1-023c18eb6833 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:48.850137 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05d3bc-81ff-4212-8cd1-023c18eb6833 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:48.887330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acbf3a-96e9-4568-a9e3-8d2d0eb96bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:48.888192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acbf3a-96e9-4568-a9e3-8d2d0eb96bcc None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:48.888471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acbf3a-96e9-4568-a9e3-8d2d0eb96bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:48.888740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acbf3a-96e9-4568-a9e3-8d2d0eb96bcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:48.899744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acbf3a-96e9-4568-a9e3-8d2d0eb96bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-14acbf3a-96e9-4568-a9e3-8d2d0eb96bcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:05:48.907409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:48.909345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:05:48.911112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 619/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:05:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:48.915372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8782b6-6577-43b6-8298-ad32bbee94f1 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:49.016276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8782b6-6577-43b6-8298-ad32bbee94f1 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:49.043143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:49.055399 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bd0a7-388f-402a-8adf-2c955c02a136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:49.056205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bd0a7-388f-402a-8adf-2c955c02a136 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:49.056551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bd0a7-388f-402a-8adf-2c955c02a136 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:49.056854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bd0a7-388f-402a-8adf-2c955c02a136 None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:49.057716 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bd0a7-388f-402a-8adf-2c955c02a136 None admin] RBAC: Adding query filter params (name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:49.058026 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bd0a7-388f-402a-8adf-2c955c02a136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:49.059415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bd0a7-388f-402a-8adf-2c955c02a136 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:49.068227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 604/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:05:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:49.074321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acbf3a-96e9-4568-a9e3-8d2d0eb96bcc None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:49.120081 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:49.179306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acbf3a-96e9-4568-a9e3-8d2d0eb96bcc None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:49.213505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fefcc-cc5d-4210-8203-252d44c6f55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:49.214317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fefcc-cc5d-4210-8203-252d44c6f55f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:49.214606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fefcc-cc5d-4210-8203-252d44c6f55f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:49.214936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fefcc-cc5d-4210-8203-252d44c6f55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:49.226444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fefcc-cc5d-4210-8203-252d44c6f55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:49.228127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fefcc-cc5d-4210-8203-252d44c6f55f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-4f5fefcc-cc5d-4210-8203-252d44c6f55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:05:49.247187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:49.248395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:49.249588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:05:49.249588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:05:49.249588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:49.249588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:05:49.249588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 620/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:49.254568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bd0a7-388f-402a-8adf-2c955c02a136 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:49.365086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bd0a7-388f-402a-8adf-2c955c02a136 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:49.399317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e7d3f-7a9d-4241-a1b1-ec1e9eaf258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:49.399895 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e7d3f-7a9d-4241-a1b1-ec1e9eaf258e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:49.400174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e7d3f-7a9d-4241-a1b1-ec1e9eaf258e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:49.400447 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e7d3f-7a9d-4241-a1b1-ec1e9eaf258e None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:49.401162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e7d3f-7a9d-4241-a1b1-ec1e9eaf258e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:49.401465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e7d3f-7a9d-4241-a1b1-ec1e9eaf258e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:49.402847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e7d3f-7a9d-4241-a1b1-ec1e9eaf258e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:49.415246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 605/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:49.421507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fefcc-cc5d-4210-8203-252d44c6f55f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:49.523258 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:49.530143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fefcc-cc5d-4210-8203-252d44c6f55f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:49.563273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f742d-2e3a-40b3-81a1-43a9d8acf4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:49.564457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f742d-2e3a-40b3-81a1-43a9d8acf4eb None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:49.564457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f742d-2e3a-40b3-81a1-43a9d8acf4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:49.564644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f742d-2e3a-40b3-81a1-43a9d8acf4eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:49.576237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f742d-2e3a-40b3-81a1-43a9d8acf4eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:49.577719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f742d-2e3a-40b3-81a1-43a9d8acf4eb None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-948f742d-2e3a-40b3-81a1-43a9d8acf4eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:05:49.593568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:49.594807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:49.595916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:49.595916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:49.595916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:05:49.595916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:05:49.595916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:05:49.595916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:05:49.595916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:05:49.595916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:05:49.595916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 08:05:49.595916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:05:49.595916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 621/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:49.600738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e7d3f-7a9d-4241-a1b1-ec1e9eaf258e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:49.653137 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:49.715843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e7d3f-7a9d-4241-a1b1-ec1e9eaf258e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:49.753251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3db67-2e30-40e5-b2e5-df3179884955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:49.754077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3db67-2e30-40e5-b2e5-df3179884955 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:49.754435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3db67-2e30-40e5-b2e5-df3179884955 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:49.754749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3db67-2e30-40e5-b2e5-df3179884955 None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:49.755680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3db67-2e30-40e5-b2e5-df3179884955 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:49.756025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3db67-2e30-40e5-b2e5-df3179884955 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:49.757618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3db67-2e30-40e5-b2e5-df3179884955 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:49.777986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 606/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 21 08:05:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:49.783650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f742d-2e3a-40b3-81a1-43a9d8acf4eb None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:49.897876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f742d-2e3a-40b3-81a1-43a9d8acf4eb None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:49.939945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c038912-72cc-4744-8019-906673097dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:49.940682 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c038912-72cc-4744-8019-906673097dfb None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:49.940995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c038912-72cc-4744-8019-906673097dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:49.941344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c038912-72cc-4744-8019-906673097dfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:49.953471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c038912-72cc-4744-8019-906673097dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:49.955069 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c038912-72cc-4744-8019-906673097dfb None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-7c038912-72cc-4744-8019-906673097dfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:05:49.974322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:49.975529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:49.976450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:05:49.976450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:05:49.976450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:49.976450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:05:49.976450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 622/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:05:49.981558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3db67-2e30-40e5-b2e5-df3179884955 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:50.090756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3db67-2e30-40e5-b2e5-df3179884955 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:50.093281 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:50.128421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa878cb-3040-4539-8139-73de26662867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:50.129669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa878cb-3040-4539-8139-73de26662867 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:50.129934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa878cb-3040-4539-8139-73de26662867 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:50.130183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa878cb-3040-4539-8139-73de26662867 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:50.131021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa878cb-3040-4539-8139-73de26662867 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:50.131298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa878cb-3040-4539-8139-73de26662867 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:50.132759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa878cb-3040-4539-8139-73de26662867 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:50.144157 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 607/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:50.150294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c038912-72cc-4744-8019-906673097dfb None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:50.160914 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:50.270643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c038912-72cc-4744-8019-906673097dfb None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:50.310927 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaa58c-5b7b-44b6-9bdd-31d5e1af403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:50.312061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaa58c-5b7b-44b6-9bdd-31d5e1af403a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:50.312553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaa58c-5b7b-44b6-9bdd-31d5e1af403a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:50.312884 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaa58c-5b7b-44b6-9bdd-31d5e1af403a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:50.321324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaa58c-5b7b-44b6-9bdd-31d5e1af403a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:50.322986 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaa58c-5b7b-44b6-9bdd-31d5e1af403a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-eadaa58c-5b7b-44b6-9bdd-31d5e1af403a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:05:50.339344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:50.340407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:50.343560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:05:50.343560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:05:50.343560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:05:50.343560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:05:50.343560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:05:50.343560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:05:50.343560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:05:50.343560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:05:50.343560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 623/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:05:50.346682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa878cb-3040-4539-8139-73de26662867 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:50.456301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa878cb-3040-4539-8139-73de26662867 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:50.490570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d59af-8126-48c6-af3e-0ba89d746e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:50.491247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d59af-8126-48c6-af3e-0ba89d746e80 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:50.491530 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d59af-8126-48c6-af3e-0ba89d746e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:50.491794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d59af-8126-48c6-af3e-0ba89d746e80 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:50.492667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d59af-8126-48c6-af3e-0ba89d746e80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:50.492897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d59af-8126-48c6-af3e-0ba89d746e80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:50.494297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d59af-8126-48c6-af3e-0ba89d746e80 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:50.506827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 608/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:50.513298 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaa58c-5b7b-44b6-9bdd-31d5e1af403a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:50.588100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:50.625212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaa58c-5b7b-44b6-9bdd-31d5e1af403a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:50.665139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10221919-e965-4f5b-8d68-9a8a9ffa0280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:50.666042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10221919-e965-4f5b-8d68-9a8a9ffa0280 None admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:50.666317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10221919-e965-4f5b-8d68-9a8a9ffa0280 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:50.666580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10221919-e965-4f5b-8d68-9a8a9ffa0280 None admin] PATH_INFO: `/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/53dfc3572d05469ca7e2de1acea3629a/roles/daddec68ba304943b424e61611634a1d` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:50.682058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10221919-e965-4f5b-8d68-9a8a9ffa0280 None admin] RBAC: Authorizing `identity:create_grant(project_id=c279ceb26daa45ba821e6ffb1db4f4f0, user_id=53dfc3572d05469ca7e2de1acea3629a, role_id=daddec68ba304943b424e61611634a1d)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:50.683528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10221919-e965-4f5b-8d68-9a8a9ffa0280 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:50.696596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 624/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:05:50 2022] PUT /identity/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/53dfc3572d05469ca7e2de1acea3629a/roles/daddec68ba304943b424e61611634a1d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:05:52.905699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e64fd9-a5dc-47b4-aa4c-de5f46775a41 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:52.906360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e64fd9-a5dc-47b4-aa4c-de5f46775a41 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:52.906360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e64fd9-a5dc-47b4-aa4c-de5f46775a41 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:52.907591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 609/1233] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:05:52.914524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5a0f0-3a35-411f-b2b6-074c13c50afa None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:52.914969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5a0f0-3a35-411f-b2b6-074c13c50afa None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:52.915125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5a0f0-3a35-411f-b2b6-074c13c50afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:52.934775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-54a5a0f0-3a35-411f-b2b6-074c13c50afa None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:05:52.935990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-54a5a0f0-3a35-411f-b2b6-074c13c50afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:05:53.010925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 625/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:05:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:05:53.037152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e64fd9-a5dc-47b4-aa4c-de5f46775a41 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:53.068546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:53.158498 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e64fd9-a5dc-47b4-aa4c-de5f46775a41 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:53.197668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fa357-631a-4169-84c6-60dc7feff8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:53.198458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fa357-631a-4169-84c6-60dc7feff8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:53.198779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fa357-631a-4169-84c6-60dc7feff8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:53.199044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fa357-631a-4169-84c6-60dc7feff8a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:53.211528 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fa357-631a-4169-84c6-60dc7feff8a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-359fa357-631a-4169-84c6-60dc7feff8a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:05:53.221714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:53.223117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:05:53.224094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 610/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 08:05:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:05:53.229795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5a0f0-3a35-411f-b2b6-074c13c50afa None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:53.290472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:53.353315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5a0f0-3a35-411f-b2b6-074c13c50afa None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:53.392667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433613e-d670-436b-8dce-0bab2d965459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:53.393451 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433613e-d670-436b-8dce-0bab2d965459 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:53.393755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433613e-d670-436b-8dce-0bab2d965459 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:53.394065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433613e-d670-436b-8dce-0bab2d965459 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:53.395097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433613e-d670-436b-8dce-0bab2d965459 None admin] RBAC: Adding query filter params (name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:53.395324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433613e-d670-436b-8dce-0bab2d965459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:53.396690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433613e-d670-436b-8dce-0bab2d965459 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:53.404807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 626/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 08:05:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:53.411653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fa357-631a-4169-84c6-60dc7feff8a3 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:53.503490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:53.521995 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fa357-631a-4169-84c6-60dc7feff8a3 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:53.559216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc51986-30ea-49d2-b3a3-a24e73fb5af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:53.560002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc51986-30ea-49d2-b3a3-a24e73fb5af0 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:53.560287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc51986-30ea-49d2-b3a3-a24e73fb5af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:53.560562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc51986-30ea-49d2-b3a3-a24e73fb5af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:53.574016 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc51986-30ea-49d2-b3a3-a24e73fb5af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:53.576192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc51986-30ea-49d2-b3a3-a24e73fb5af0 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-9dc51986-30ea-49d2-b3a3-a24e73fb5af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:05:53.597386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:53.599126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:53.604928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:05:53.604928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:05:53.604928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:53.604928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:05:53.604928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 611/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:53.605738 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433613e-d670-436b-8dce-0bab2d965459 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:53.720791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433613e-d670-436b-8dce-0bab2d965459 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:53.730429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:53.758256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b6fc7-cb56-4cdc-8793-c48ed7169f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:53.759119 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b6fc7-cb56-4cdc-8793-c48ed7169f8d None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:53.759415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b6fc7-cb56-4cdc-8793-c48ed7169f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:53.759731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b6fc7-cb56-4cdc-8793-c48ed7169f8d None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:53.760462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b6fc7-cb56-4cdc-8793-c48ed7169f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:53.760768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b6fc7-cb56-4cdc-8793-c48ed7169f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:53.762250 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b6fc7-cb56-4cdc-8793-c48ed7169f8d None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:53.776840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 627/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:53.782702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc51986-30ea-49d2-b3a3-a24e73fb5af0 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:53.895890 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc51986-30ea-49d2-b3a3-a24e73fb5af0 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:53.933416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798307d2-2e09-49af-a4a3-620c4ffe0acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:53.934211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798307d2-2e09-49af-a4a3-620c4ffe0acf None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:53.934535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798307d2-2e09-49af-a4a3-620c4ffe0acf None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:53.934798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798307d2-2e09-49af-a4a3-620c4ffe0acf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:53.937911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:53.944306 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798307d2-2e09-49af-a4a3-620c4ffe0acf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:53.945902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798307d2-2e09-49af-a4a3-620c4ffe0acf None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-798307d2-2e09-49af-a4a3-620c4ffe0acf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:05:53.960204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:53.961420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:53.962364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:53.962364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:53.962364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:05:53.962364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:05:53.962364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:05:53.962364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:05:53.962364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:05:53.962364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:05:53.962364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 08:05:53.962364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:05:53.962364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 612/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:53.967340 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b6fc7-cb56-4cdc-8793-c48ed7169f8d None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:54.086269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b6fc7-cb56-4cdc-8793-c48ed7169f8d None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:54.133209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015b2ad-188a-4908-a852-fdd880546a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:54.133935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b2ad-188a-4908-a852-fdd880546a09 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:54.134247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b2ad-188a-4908-a852-fdd880546a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:54.134564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b2ad-188a-4908-a852-fdd880546a09 None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:54.135594 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015b2ad-188a-4908-a852-fdd880546a09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:54.135974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015b2ad-188a-4908-a852-fdd880546a09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:54.137597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015b2ad-188a-4908-a852-fdd880546a09 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:54.158659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 628/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 21 08:05:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:05:54.165977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798307d2-2e09-49af-a4a3-620c4ffe0acf None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:54.298106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798307d2-2e09-49af-a4a3-620c4ffe0acf None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:54.344424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa8103-4a0c-47b7-b08e-754338235cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:54.345485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa8103-4a0c-47b7-b08e-754338235cad None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:54.346033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa8103-4a0c-47b7-b08e-754338235cad None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:54.346331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa8103-4a0c-47b7-b08e-754338235cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:54.420480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:54.428411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa8103-4a0c-47b7-b08e-754338235cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:54.430178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa8103-4a0c-47b7-b08e-754338235cad None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:54.535963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 613/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:05:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:05:54.541994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015b2ad-188a-4908-a852-fdd880546a09 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:54.575367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:54.656739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015b2ad-188a-4908-a852-fdd880546a09 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:54.694994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32861e75-3bd6-4718-aa58-e5ce947d791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:54.695973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32861e75-3bd6-4718-aa58-e5ce947d791a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:54.696279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32861e75-3bd6-4718-aa58-e5ce947d791a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:54.696631 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32861e75-3bd6-4718-aa58-e5ce947d791a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:54.707303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32861e75-3bd6-4718-aa58-e5ce947d791a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:54.708743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32861e75-3bd6-4718-aa58-e5ce947d791a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-32861e75-3bd6-4718-aa58-e5ce947d791a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:05:54.728207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:54.729461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:54.730473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:05:54.730473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:05:54.730473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:54.730473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:05:54.730473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 629/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:05:54.735287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa8103-4a0c-47b7-b08e-754338235cad None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:54.838862 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:54.845181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa8103-4a0c-47b7-b08e-754338235cad None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:54.885280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a9f8f-0c11-4182-9932-c37de21ef406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:54.886038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a9f8f-0c11-4182-9932-c37de21ef406 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:54.886398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a9f8f-0c11-4182-9932-c37de21ef406 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:54.886782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a9f8f-0c11-4182-9932-c37de21ef406 None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:54.887751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a9f8f-0c11-4182-9932-c37de21ef406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:54.888168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a9f8f-0c11-4182-9932-c37de21ef406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:54.889942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a9f8f-0c11-4182-9932-c37de21ef406 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:54.908235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 614/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:54.909816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32861e75-3bd6-4718-aa58-e5ce947d791a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:54.996410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:55.018809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32861e75-3bd6-4718-aa58-e5ce947d791a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:55.058258 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c510d11-6829-4ba4-8f12-5c2909deed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:55.059074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c510d11-6829-4ba4-8f12-5c2909deed73 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:55.059360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c510d11-6829-4ba4-8f12-5c2909deed73 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:55.059637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c510d11-6829-4ba4-8f12-5c2909deed73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:55.067256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c510d11-6829-4ba4-8f12-5c2909deed73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:55.069091 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c510d11-6829-4ba4-8f12-5c2909deed73 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-4c510d11-6829-4ba4-8f12-5c2909deed73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:05:55.087536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:55.088714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:55.089827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:05:55.089827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:05:55.089827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:05:55.089827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:05:55.089827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:05:55.089827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:05:55.089827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:05:55.089827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:05:55.089827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 630/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:55.096442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a9f8f-0c11-4182-9932-c37de21ef406 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:55.205711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a9f8f-0c11-4182-9932-c37de21ef406 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:55.245408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff761cfc-11b3-46ac-b030-666252b1345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:55.246106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff761cfc-11b3-46ac-b030-666252b1345b None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:55.246521 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff761cfc-11b3-46ac-b030-666252b1345b None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:55.246866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff761cfc-11b3-46ac-b030-666252b1345b None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:55.247691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff761cfc-11b3-46ac-b030-666252b1345b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:55.248107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff761cfc-11b3-46ac-b030-666252b1345b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:55.249961 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff761cfc-11b3-46ac-b030-666252b1345b None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:55.266141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 615/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:55.274443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c510d11-6829-4ba4-8f12-5c2909deed73 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:55.393058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c510d11-6829-4ba4-8f12-5c2909deed73 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:55.429831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dfbd6-beb3-4498-bce1-4481dda27f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:55.430489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dfbd6-beb3-4498-bce1-4481dda27f6c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:55.430811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dfbd6-beb3-4498-bce1-4481dda27f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:55.431089 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dfbd6-beb3-4498-bce1-4481dda27f6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:55.431929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dfbd6-beb3-4498-bce1-4481dda27f6c None admin] RBAC: Adding query filter params (role.id=daddec68ba304943b424e61611634a1d, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=53dfc3572d05469ca7e2de1acea3629a) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:55.432241 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dfbd6-beb3-4498-bce1-4481dda27f6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:55.433690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dfbd6-beb3-4498-bce1-4481dda27f6c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:55.439906 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 631/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:05:55 2022] GET /identity/v3/role_assignments?user.id=53dfc3572d05469ca7e2de1acea3629a&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=daddec68ba304943b424e61611634a1d => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:57.544952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611b52b-599a-4bd2-9d2c-30a84903ca47 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:57.545510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611b52b-599a-4bd2-9d2c-30a84903ca47 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:57.545510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611b52b-599a-4bd2-9d2c-30a84903ca47 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:57.547028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 616/1247] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:05:57.553249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ab171-e80b-4153-a05e-73d5242f552c None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:57.553728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ab171-e80b-4153-a05e-73d5242f552c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:57.553821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ab171-e80b-4153-a05e-73d5242f552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:57.559189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:57.574778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-772ab171-e80b-4153-a05e-73d5242f552c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:05:57.576185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-772ab171-e80b-4153-a05e-73d5242f552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:05:57.659264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 632/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:05:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:05:57.684479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611b52b-599a-4bd2-9d2c-30a84903ca47 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:57.705725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:57.800506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611b52b-599a-4bd2-9d2c-30a84903ca47 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:57.840939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56619957-6196-4cf6-ba55-b59d98c104f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:57.841708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56619957-6196-4cf6-ba55-b59d98c104f4 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:57.841989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56619957-6196-4cf6-ba55-b59d98c104f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:57.842265 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56619957-6196-4cf6-ba55-b59d98c104f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:57.853565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56619957-6196-4cf6-ba55-b59d98c104f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-56619957-6196-4cf6-ba55-b59d98c104f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:05:57.861748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:57.863232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:57.864110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:57.864110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:57.864110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:57.864110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:57.864110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:05:57.864110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:05:57.864110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:05:57.864110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:05:57.864110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:05:57.864110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:05:57.864110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:05:57.864110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:05:57.872194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 617/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:05:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:05:57.872333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ab171-e80b-4153-a05e-73d5242f552c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:57.984343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ab171-e80b-4153-a05e-73d5242f552c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:58.021253 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:58.027867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086af60e-b601-45c4-9975-964c34e77c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:58.028543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086af60e-b601-45c4-9975-964c34e77c88 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:58.028896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086af60e-b601-45c4-9975-964c34e77c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:58.029713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086af60e-b601-45c4-9975-964c34e77c88 None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:58.030467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086af60e-b601-45c4-9975-964c34e77c88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:58.030867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086af60e-b601-45c4-9975-964c34e77c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:58.032919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086af60e-b601-45c4-9975-964c34e77c88 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:58.045005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 633/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:05:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:58.053038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56619957-6196-4cf6-ba55-b59d98c104f4 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:58.149632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:58.176641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56619957-6196-4cf6-ba55-b59d98c104f4 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:58.213306 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceaa9b-793b-4d5b-95c0-bf21ef6b4c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:58.214103 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceaa9b-793b-4d5b-95c0-bf21ef6b4c9e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:58.214408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceaa9b-793b-4d5b-95c0-bf21ef6b4c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:58.214709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceaa9b-793b-4d5b-95c0-bf21ef6b4c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:58.230541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceaa9b-793b-4d5b-95c0-bf21ef6b4c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:58.232422 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceaa9b-793b-4d5b-95c0-bf21ef6b4c9e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-5bceaa9b-793b-4d5b-95c0-bf21ef6b4c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:05:58.253772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:58.254908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:58.255789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:05:58.255789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:05:58.255789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:58.255789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:05:58.255789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 618/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:58.261166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086af60e-b601-45c4-9975-964c34e77c88 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:58.394067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086af60e-b601-45c4-9975-964c34e77c88 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:58.432719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ebab0-8aa0-48c9-a45d-759620deb197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:58.433393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ebab0-8aa0-48c9-a45d-759620deb197 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:58.433692 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ebab0-8aa0-48c9-a45d-759620deb197 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:58.433973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ebab0-8aa0-48c9-a45d-759620deb197 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:58.434690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ebab0-8aa0-48c9-a45d-759620deb197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:58.434994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ebab0-8aa0-48c9-a45d-759620deb197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:58.436362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ebab0-8aa0-48c9-a45d-759620deb197 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:58.449691 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 634/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:58.455495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceaa9b-793b-4d5b-95c0-bf21ef6b4c9e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:58.566254 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceaa9b-793b-4d5b-95c0-bf21ef6b4c9e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:58.600998 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:58.611035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d3ce1-eaeb-4a78-81fa-024538180024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:58.611837 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d3ce1-eaeb-4a78-81fa-024538180024 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:58.612121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d3ce1-eaeb-4a78-81fa-024538180024 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:58.612398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d3ce1-eaeb-4a78-81fa-024538180024 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:58.623719 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d3ce1-eaeb-4a78-81fa-024538180024 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:58.625385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d3ce1-eaeb-4a78-81fa-024538180024 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-285d3ce1-eaeb-4a78-81fa-024538180024 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:05:58.644563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:58.645743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:58.647178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:58.647178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:58.647178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:05:58.647178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:05:58.647178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:05:58.647178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:05:58.647178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:05:58.647178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:05:58.647178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 08:05:58.647178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:05:58.647178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 619/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:58.651804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ebab0-8aa0-48c9-a45d-759620deb197 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:58.709534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:58.762310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ebab0-8aa0-48c9-a45d-759620deb197 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:58.798714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f92b58-1d35-4529-99db-8f2b7a58023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:58.799384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f92b58-1d35-4529-99db-8f2b7a58023c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:58.799669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f92b58-1d35-4529-99db-8f2b7a58023c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:58.799944 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f92b58-1d35-4529-99db-8f2b7a58023c None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:58.801078 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f92b58-1d35-4529-99db-8f2b7a58023c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:58.801402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f92b58-1d35-4529-99db-8f2b7a58023c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:58.802973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f92b58-1d35-4529-99db-8f2b7a58023c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:58.822956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 635/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 21 08:05:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:05:58.829001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d3ce1-eaeb-4a78-81fa-024538180024 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:58.937640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d3ce1-eaeb-4a78-81fa-024538180024 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:58.973396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93965eb-7a3c-4967-908d-986d77f7722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:58.974048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93965eb-7a3c-4967-908d-986d77f7722a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:58.974336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93965eb-7a3c-4967-908d-986d77f7722a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:58.974655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93965eb-7a3c-4967-908d-986d77f7722a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:59.032592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:59.045478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93965eb-7a3c-4967-908d-986d77f7722a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:59.047002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93965eb-7a3c-4967-908d-986d77f7722a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:59.163389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 620/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:05:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:05:59.169276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f92b58-1d35-4529-99db-8f2b7a58023c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:59.273534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f92b58-1d35-4529-99db-8f2b7a58023c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:59.288813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:59.313007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea8951-75af-48ee-b8b6-976a744b112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:59.313767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea8951-75af-48ee-b8b6-976a744b112e None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:59.314074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea8951-75af-48ee-b8b6-976a744b112e None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:59.314335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea8951-75af-48ee-b8b6-976a744b112e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:59.327482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea8951-75af-48ee-b8b6-976a744b112e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:59.329345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea8951-75af-48ee-b8b6-976a744b112e None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-ddea8951-75af-48ee-b8b6-976a744b112e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:05:59.348376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:59.349705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:59.350593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:05:59.350593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:05:59.350593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:05:59.350593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:05:59.350593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 636/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:59.355381 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93965eb-7a3c-4967-908d-986d77f7722a None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:59.445858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:59.459966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93965eb-7a3c-4967-908d-986d77f7722a None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:59.497762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b7a77-84f8-4f6b-81a8-0900061f9a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:59.498409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7a77-84f8-4f6b-81a8-0900061f9a1e None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:59.498732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7a77-84f8-4f6b-81a8-0900061f9a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:59.499004 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b7a77-84f8-4f6b-81a8-0900061f9a1e None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:59.499728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b7a77-84f8-4f6b-81a8-0900061f9a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:59.500034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b7a77-84f8-4f6b-81a8-0900061f9a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:59.501409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b7a77-84f8-4f6b-81a8-0900061f9a1e None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:59.513565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 621/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:05:59.519352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea8951-75af-48ee-b8b6-976a744b112e None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:59.633972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea8951-75af-48ee-b8b6-976a744b112e None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:59.672541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65199f-8fff-4ef0-9e16-ecfb5325ba7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:59.673412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65199f-8fff-4ef0-9e16-ecfb5325ba7c None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:59.673762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65199f-8fff-4ef0-9e16-ecfb5325ba7c None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:59.674041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65199f-8fff-4ef0-9e16-ecfb5325ba7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:59.682304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65199f-8fff-4ef0-9e16-ecfb5325ba7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:59.683924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65199f-8fff-4ef0-9e16-ecfb5325ba7c None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-ef65199f-8fff-4ef0-9e16-ecfb5325ba7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:05:59.699040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:05:59.700101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:05:59.701282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:05:59.701282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:05:59.701282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:05:59.701282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:05:59.701282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:05:59.701282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:05:59.701282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:05:59.701282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:05:59.701282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 637/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:05:59.706410 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b7a77-84f8-4f6b-81a8-0900061f9a1e None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:59.817682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b7a77-84f8-4f6b-81a8-0900061f9a1e None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:05:59.857474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469f645-889f-4d79-9f12-d6b57f9328b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:05:59.858058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469f645-889f-4d79-9f12-d6b57f9328b2 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:05:59.858340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469f645-889f-4d79-9f12-d6b57f9328b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:05:59.858644 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469f645-889f-4d79-9f12-d6b57f9328b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:05:59.859425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469f645-889f-4d79-9f12-d6b57f9328b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:05:59.859732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469f645-889f-4d79-9f12-d6b57f9328b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:05:59.861170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469f645-889f-4d79-9f12-d6b57f9328b2 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:05:59.875302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 622/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:05:59.882000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65199f-8fff-4ef0-9e16-ecfb5325ba7c None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:05:59.912825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:05:59.995508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65199f-8fff-4ef0-9e16-ecfb5325ba7c None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:00.029745 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e7dcc-5177-453d-a8c8-d77fd0e352e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:00.030414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e7dcc-5177-453d-a8c8-d77fd0e352e7 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:00.030707 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e7dcc-5177-453d-a8c8-d77fd0e352e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:00.031007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e7dcc-5177-453d-a8c8-d77fd0e352e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:00.031816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e7dcc-5177-453d-a8c8-d77fd0e352e7 None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=53dfc3572d05469ca7e2de1acea3629a) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:00.032107 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e7dcc-5177-453d-a8c8-d77fd0e352e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:00.033528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e7dcc-5177-453d-a8c8-d77fd0e352e7 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:00.039709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 638/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:05:59 2022] GET /identity/v3/role_assignments?user.id=53dfc3572d05469ca7e2de1acea3629a&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=6fcc322b483a475399974562c1e5bd43 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:02.071964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d320b5-2f34-45e6-9cd8-98b00e318abb None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:02.072532 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d320b5-2f34-45e6-9cd8-98b00e318abb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:02.072532 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d320b5-2f34-45e6-9cd8-98b00e318abb None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:02.073860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 623/1261] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:06:02.079023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597b3ef-aab8-4c35-a74c-5b333ac09b5c None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:02.079398 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597b3ef-aab8-4c35-a74c-5b333ac09b5c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:02.079570 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597b3ef-aab8-4c35-a74c-5b333ac09b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:02.095876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-2597b3ef-aab8-4c35-a74c-5b333ac09b5c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:06:02.097042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2597b3ef-aab8-4c35-a74c-5b333ac09b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:06:02.162329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 639/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:06:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:06:02.184998 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d320b5-2f34-45e6-9cd8-98b00e318abb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:02.196211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:02.289534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d320b5-2f34-45e6-9cd8-98b00e318abb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:02.335399 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a82bae-db41-4190-b84a-0a520fe5da46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:02.336108 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a82bae-db41-4190-b84a-0a520fe5da46 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:02.336388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a82bae-db41-4190-b84a-0a520fe5da46 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:02.336669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a82bae-db41-4190-b84a-0a520fe5da46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:02.348048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a82bae-db41-4190-b84a-0a520fe5da46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-61a82bae-db41-4190-b84a-0a520fe5da46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:06:02.355643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:02.356732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:06:02.357754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 624/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:06:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:06:02.363848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597b3ef-aab8-4c35-a74c-5b333ac09b5c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:02.381789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:02.466387 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597b3ef-aab8-4c35-a74c-5b333ac09b5c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:02.500422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d965d2f-4482-4b0e-9543-b8db770d13ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:02.501078 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965d2f-4482-4b0e-9543-b8db770d13ac None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:02.501364 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965d2f-4482-4b0e-9543-b8db770d13ac None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:02.501642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965d2f-4482-4b0e-9543-b8db770d13ac None admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:02.502384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d965d2f-4482-4b0e-9543-b8db770d13ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:02.502719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d965d2f-4482-4b0e-9543-b8db770d13ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:02.504114 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d965d2f-4482-4b0e-9543-b8db770d13ac None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:02.511991 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 640/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:06:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:02.517587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a82bae-db41-4190-b84a-0a520fe5da46 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:02.583859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:02.622507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a82bae-db41-4190-b84a-0a520fe5da46 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:02.656438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d4764-0e89-4db0-9f43-c9ee3a0a3aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:02.657200 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d4764-0e89-4db0-9f43-c9ee3a0a3aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:02.657484 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d4764-0e89-4db0-9f43-c9ee3a0a3aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:02.657759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d4764-0e89-4db0-9f43-c9ee3a0a3aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:02.668779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d4764-0e89-4db0-9f43-c9ee3a0a3aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:02.670220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d4764-0e89-4db0-9f43-c9ee3a0a3aa8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-4f1d4764-0e89-4db0-9f43-c9ee3a0a3aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:06:02.686948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:02.687915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:02.688806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:06:02.688806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:06:02.688806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:06:02.688806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:06:02.688806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 625/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:06:02.694544 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d965d2f-4482-4b0e-9543-b8db770d13ac None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:02.776948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:02.796874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d965d2f-4482-4b0e-9543-b8db770d13ac None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:02.829982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d5d2c-f232-49a4-bbb6-c50719e57ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:02.830640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d5d2c-f232-49a4-bbb6-c50719e57ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:02.830948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d5d2c-f232-49a4-bbb6-c50719e57ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:02.831224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d5d2c-f232-49a4-bbb6-c50719e57ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:02.832940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d5d2c-f232-49a4-bbb6-c50719e57ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:02.833254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d5d2c-f232-49a4-bbb6-c50719e57ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:02.834640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d5d2c-f232-49a4-bbb6-c50719e57ad1 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:02.845982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 641/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:02.852415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d4764-0e89-4db0-9f43-c9ee3a0a3aa8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:02.961285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d4764-0e89-4db0-9f43-c9ee3a0a3aa8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:02.980348 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:02.994605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b7ba7-829b-41a1-8484-7851bc054066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:02.995424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b7ba7-829b-41a1-8484-7851bc054066 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:02.995701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b7ba7-829b-41a1-8484-7851bc054066 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:02.995972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b7ba7-829b-41a1-8484-7851bc054066 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:03.004488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b7ba7-829b-41a1-8484-7851bc054066 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:03.005923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b7ba7-829b-41a1-8484-7851bc054066 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-fe0b7ba7-829b-41a1-8484-7851bc054066 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:06:03.020198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:03.021467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:03.022513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:03.022513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:03.022513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:06:03.022513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:06:03.022513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:06:03.022513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:06:03.022513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:06:03.022513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:06:03.022513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 08:06:03.022513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:06:03.022513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 626/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:06:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:06:03.027112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d5d2c-f232-49a4-bbb6-c50719e57ad1 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:03.121701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d5d2c-f232-49a4-bbb6-c50719e57ad1 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:03.153975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b41f46-cf57-4f1b-a6c9-e6bf554a81e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:03.154639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b41f46-cf57-4f1b-a6c9-e6bf554a81e4 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:03.154921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b41f46-cf57-4f1b-a6c9-e6bf554a81e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:03.155197 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b41f46-cf57-4f1b-a6c9-e6bf554a81e4 None admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:03.156012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b41f46-cf57-4f1b-a6c9-e6bf554a81e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:03.156315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b41f46-cf57-4f1b-a6c9-e6bf554a81e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:03.157718 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b41f46-cf57-4f1b-a6c9-e6bf554a81e4 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:03.166637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:03.175117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 642/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 21 08:06:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:03.180987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b7ba7-829b-41a1-8484-7851bc054066 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:03.281516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b7ba7-829b-41a1-8484-7851bc054066 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:03.318234 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857798d-744f-4eb4-a12b-c01199f227ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:03.319039 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857798d-744f-4eb4-a12b-c01199f227ba None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:03.319319 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857798d-744f-4eb4-a12b-c01199f227ba None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:03.319588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857798d-744f-4eb4-a12b-c01199f227ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:03.329771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857798d-744f-4eb4-a12b-c01199f227ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:03.331241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857798d-744f-4eb4-a12b-c01199f227ba None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f857798d-744f-4eb4-a12b-c01199f227ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:06:03.348759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:03.349835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:03.351000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:06:03.351000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:06:03.351000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:06:03.351000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:06:03.351000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 627/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:06:03.355635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b41f46-cf57-4f1b-a6c9-e6bf554a81e4 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:03.452458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b41f46-cf57-4f1b-a6c9-e6bf554a81e4 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:03.486027 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706086d9-f4ba-4aa3-b6c1-a46755211309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:03.486701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706086d9-f4ba-4aa3-b6c1-a46755211309 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:03.486979 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706086d9-f4ba-4aa3-b6c1-a46755211309 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:03.487247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706086d9-f4ba-4aa3-b6c1-a46755211309 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:03.488247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706086d9-f4ba-4aa3-b6c1-a46755211309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:03.488545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706086d9-f4ba-4aa3-b6c1-a46755211309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:03.489901 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706086d9-f4ba-4aa3-b6c1-a46755211309 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:03.500630 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 643/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:03.506167 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857798d-744f-4eb4-a12b-c01199f227ba None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:03.538291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:03.606749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857798d-744f-4eb4-a12b-c01199f227ba None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:03.639865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b779ec1-c7d1-4f03-9f41-3c55163305ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:03.640639 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b779ec1-c7d1-4f03-9f41-3c55163305ea None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:03.640923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b779ec1-c7d1-4f03-9f41-3c55163305ea None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:03.641206 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b779ec1-c7d1-4f03-9f41-3c55163305ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:03.648291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b779ec1-c7d1-4f03-9f41-3c55163305ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:03.649721 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b779ec1-c7d1-4f03-9f41-3c55163305ea None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-2b779ec1-c7d1-4f03-9f41-3c55163305ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:06:03.663603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:03.664671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:03.670229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:06:03.670229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:06:03.670229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:06:03.670229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:06:03.670229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:06:03.670229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:06:03.670229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:06:03.670229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:06:03.670229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 628/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:06:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:06:03.670888 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706086d9-f4ba-4aa3-b6c1-a46755211309 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:03.727501 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:03.767782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706086d9-f4ba-4aa3-b6c1-a46755211309 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:03.800382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3505b1a-77eb-4c93-9a38-30551b97ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:03.801077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3505b1a-77eb-4c93-9a38-30551b97ac93 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:03.801390 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3505b1a-77eb-4c93-9a38-30551b97ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:03.801669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3505b1a-77eb-4c93-9a38-30551b97ac93 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:03.802490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3505b1a-77eb-4c93-9a38-30551b97ac93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:03.802825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3505b1a-77eb-4c93-9a38-30551b97ac93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:03.804295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3505b1a-77eb-4c93-9a38-30551b97ac93 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:03.817088 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 644/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:03.823137 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b779ec1-c7d1-4f03-9f41-3c55163305ea None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:03.912200 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:03.920941 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b779ec1-c7d1-4f03-9f41-3c55163305ea None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:03.958098 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73959a2-dffe-46a0-92d9-039e69da21dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:03.958998 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73959a2-dffe-46a0-92d9-039e69da21dd None admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:03.959282 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73959a2-dffe-46a0-92d9-039e69da21dd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:03.959558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73959a2-dffe-46a0-92d9-039e69da21dd None admin] PATH_INFO: `/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/53dfc3572d05469ca7e2de1acea3629a/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:03.961519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73959a2-dffe-46a0-92d9-039e69da21dd None admin] RBAC: Authorizing `identity:create_grant(project_id=c279ceb26daa45ba821e6ffb1db4f4f0, user_id=53dfc3572d05469ca7e2de1acea3629a, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:03.962975 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73959a2-dffe-46a0-92d9-039e69da21dd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:03.975205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 629/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 08:06:03 2022] PUT /identity/v3/projects/c279ceb26daa45ba821e6ffb1db4f4f0/users/53dfc3572d05469ca7e2de1acea3629a/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:06:05.984950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c5959-763e-49dd-a5e6-8f821b33be46 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:05.985465 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c5959-763e-49dd-a5e6-8f821b33be46 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:05.985578 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c5959-763e-49dd-a5e6-8f821b33be46 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:05.986890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 645/1274] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:06:05.993072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7d736-6d91-4631-8241-1d423ac72a67 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:05.993519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7d736-6d91-4631-8241-1d423ac72a67 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:05.993623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7d736-6d91-4631-8241-1d423ac72a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:06.009840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b6f7d736-6d91-4631-8241-1d423ac72a67 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:06:06.011026 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b6f7d736-6d91-4631-8241-1d423ac72a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:06:06.075271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 630/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:06:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:06:06.098642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c5959-763e-49dd-a5e6-8f821b33be46 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:06.196890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c5959-763e-49dd-a5e6-8f821b33be46 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:06.213436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:06.230267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a031bdb-2819-4a8c-bb2d-850d30926a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:06.231071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a031bdb-2819-4a8c-bb2d-850d30926a50 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:06.231352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a031bdb-2819-4a8c-bb2d-850d30926a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:06.231623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a031bdb-2819-4a8c-bb2d-850d30926a50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:06.242333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a031bdb-2819-4a8c-bb2d-850d30926a50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-4a031bdb-2819-4a8c-bb2d-850d30926a50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 08:06:06.249796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:06.250942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:06:06.252046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 646/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 08:06:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:06:06.256869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7d736-6d91-4631-8241-1d423ac72a67 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:06.343654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:06.361923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7d736-6d91-4631-8241-1d423ac72a67 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:06.396438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dbac8-44b2-41c9-a007-7d7ee7b5496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:06.397088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dbac8-44b2-41c9-a007-7d7ee7b5496c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:06.397370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dbac8-44b2-41c9-a007-7d7ee7b5496c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:06.397645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dbac8-44b2-41c9-a007-7d7ee7b5496c None admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:06.398385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dbac8-44b2-41c9-a007-7d7ee7b5496c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:06.398718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dbac8-44b2-41c9-a007-7d7ee7b5496c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:06.400100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dbac8-44b2-41c9-a007-7d7ee7b5496c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:06.407915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 631/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 08:06:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:06.413828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a031bdb-2819-4a8c-bb2d-850d30926a50 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:06.514656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a031bdb-2819-4a8c-bb2d-850d30926a50 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:06.546480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7dd274-5e8a-442a-aa81-b88478f33f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:06.547267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7dd274-5e8a-442a-aa81-b88478f33f0a None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:06.547545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7dd274-5e8a-442a-aa81-b88478f33f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:06.547814 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7dd274-5e8a-442a-aa81-b88478f33f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:06.558799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7dd274-5e8a-442a-aa81-b88478f33f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:06.560223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7dd274-5e8a-442a-aa81-b88478f33f0a None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-da7dd274-5e8a-442a-aa81-b88478f33f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:06:06.577435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:06.578463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:06.579438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:06:06.579438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:06:06.579438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:06:06.579438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:06:06.579438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 647/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:06:06.584273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dbac8-44b2-41c9-a007-7d7ee7b5496c None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:06.685330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dbac8-44b2-41c9-a007-7d7ee7b5496c None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:06.716983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542b3d8-649f-4fb9-86f2-ebd31f9ac2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:06.717622 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542b3d8-649f-4fb9-86f2-ebd31f9ac2cf None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:06.717899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542b3d8-649f-4fb9-86f2-ebd31f9ac2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:06.718168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542b3d8-649f-4fb9-86f2-ebd31f9ac2cf None admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:06.718911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542b3d8-649f-4fb9-86f2-ebd31f9ac2cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:06.719214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542b3d8-649f-4fb9-86f2-ebd31f9ac2cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:06.720560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542b3d8-649f-4fb9-86f2-ebd31f9ac2cf None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:06.733047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 632/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:06.739517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7dd274-5e8a-442a-aa81-b88478f33f0a None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:06.769306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:06.836568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7dd274-5e8a-442a-aa81-b88478f33f0a None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:06.869790 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d6640-64cc-49ef-92ec-75e29b0e9b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:06.870566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d6640-64cc-49ef-92ec-75e29b0e9b94 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:06.870870 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d6640-64cc-49ef-92ec-75e29b0e9b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:06.871141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d6640-64cc-49ef-92ec-75e29b0e9b94 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:06.879315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d6640-64cc-49ef-92ec-75e29b0e9b94 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:06.880737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d6640-64cc-49ef-92ec-75e29b0e9b94 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-5e1d6640-64cc-49ef-92ec-75e29b0e9b94 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 08:06:06.894675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:06.895607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:06.896586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:06.896586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:06.896586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 08:06:06.896586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 08:06:06.896586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 08:06:06.896586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 08:06:06.896586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 08:06:06.896586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 08:06:06.896586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 08:06:06.896586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:06:06.896586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 648/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:06:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 08:06:06.901561 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542b3d8-649f-4fb9-86f2-ebd31f9ac2cf None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:06.905225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:07.003042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542b3d8-649f-4fb9-86f2-ebd31f9ac2cf None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:07.037231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d0122-e959-4a29-8cd6-39c360a495ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:07.037818 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0122-e959-4a29-8cd6-39c360a495ba None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:07.038097 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0122-e959-4a29-8cd6-39c360a495ba None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:07.038367 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0122-e959-4a29-8cd6-39c360a495ba None admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:07.039216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d0122-e959-4a29-8cd6-39c360a495ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:07.039521 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d0122-e959-4a29-8cd6-39c360a495ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:07.040930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d0122-e959-4a29-8cd6-39c360a495ba None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:07.057254 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 633/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 21 08:06:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:07.062922 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d6640-64cc-49ef-92ec-75e29b0e9b94 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:07.150967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:07.161395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d6640-64cc-49ef-92ec-75e29b0e9b94 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:07.194803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab26b69-3b77-4eb5-b0fd-3f5eb75dcd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:07.195438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab26b69-3b77-4eb5-b0fd-3f5eb75dcd1f None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:07.195725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab26b69-3b77-4eb5-b0fd-3f5eb75dcd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:07.196004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab26b69-3b77-4eb5-b0fd-3f5eb75dcd1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:07.261498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab26b69-3b77-4eb5-b0fd-3f5eb75dcd1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:07.262984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab26b69-3b77-4eb5-b0fd-3f5eb75dcd1f None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:07.355448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:07.366715 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 649/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 08:06:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 08:06:07.372428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d0122-e959-4a29-8cd6-39c360a495ba None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:07.432487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:07.469737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d0122-e959-4a29-8cd6-39c360a495ba None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:07.504764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28218-2a54-4c3a-96aa-488c9fd860e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:07.505534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28218-2a54-4c3a-96aa-488c9fd860e5 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:07.505819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28218-2a54-4c3a-96aa-488c9fd860e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:07.506097 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28218-2a54-4c3a-96aa-488c9fd860e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:07.515956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae28218-2a54-4c3a-96aa-488c9fd860e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:07.517392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae28218-2a54-4c3a-96aa-488c9fd860e5 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-1ae28218-2a54-4c3a-96aa-488c9fd860e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 08:06:07.535115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:07.536329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:07.537246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 08:06:07.537246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 08:06:07.537246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 08:06:07.537246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:06:07.537246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 634/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:06:07.542018 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab26b69-3b77-4eb5-b0fd-3f5eb75dcd1f None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:07.642013 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab26b69-3b77-4eb5-b0fd-3f5eb75dcd1f None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:07.676764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088bae5-f240-4463-b68d-bf41fc2e1049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:07.677413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088bae5-f240-4463-b68d-bf41fc2e1049 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:07.677697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088bae5-f240-4463-b68d-bf41fc2e1049 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:07.677976 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088bae5-f240-4463-b68d-bf41fc2e1049 None admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:07.678725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088bae5-f240-4463-b68d-bf41fc2e1049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:07.679034 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088bae5-f240-4463-b68d-bf41fc2e1049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:07.680405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088bae5-f240-4463-b68d-bf41fc2e1049 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:07.691478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 650/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 08:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:07.697215 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28218-2a54-4c3a-96aa-488c9fd860e5 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:07.796420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28218-2a54-4c3a-96aa-488c9fd860e5 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:07.810826 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:07.832028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2c72e-8620-42ce-9ac7-c33d8d3f6a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:07.832861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2c72e-8620-42ce-9ac7-c33d8d3f6a1d None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:07.833145 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2c72e-8620-42ce-9ac7-c33d8d3f6a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:07.833421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2c72e-8620-42ce-9ac7-c33d8d3f6a1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:07.840005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2c72e-8620-42ce-9ac7-c33d8d3f6a1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:07.841436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2c72e-8620-42ce-9ac7-c33d8d3f6a1d None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application [None req-f6b2c72e-8620-42ce-9ac7-c33d8d3f6a1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 08:06:07.855257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:07.856208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:07.857192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 08:06:07.857192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 08:06:07.857192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 08:06:07.857192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 08:06:07.857192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 08:06:07.857192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 08:06:07.857192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 08:06:07.857192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: ERROR keystone.server.flask.application Jun 21 08:06:07.857192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 635/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 08:06:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:06:07.862242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088bae5-f240-4463-b68d-bf41fc2e1049 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:07.912763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:07.961761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088bae5-f240-4463-b68d-bf41fc2e1049 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:07.995159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9488fcf-7ac8-4804-bae0-d4f09829c100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:07.995800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9488fcf-7ac8-4804-bae0-d4f09829c100 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:07.996081 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9488fcf-7ac8-4804-bae0-d4f09829c100 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:07.996356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9488fcf-7ac8-4804-bae0-d4f09829c100 None admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:07.997131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9488fcf-7ac8-4804-bae0-d4f09829c100 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:07.997439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9488fcf-7ac8-4804-bae0-d4f09829c100 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:07.998889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9488fcf-7ac8-4804-bae0-d4f09829c100 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:08.011312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 651/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 08:06:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:08.017267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2c72e-8620-42ce-9ac7-c33d8d3f6a1d None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:08.115262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2c72e-8620-42ce-9ac7-c33d8d3f6a1d None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:08.147816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce454a1-8871-4fd3-a78a-6815869a912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:08.148435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce454a1-8871-4fd3-a78a-6815869a912a None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:08.148712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce454a1-8871-4fd3-a78a-6815869a912a None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:08.148984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce454a1-8871-4fd3-a78a-6815869a912a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:08.149796 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce454a1-8871-4fd3-a78a-6815869a912a None admin] RBAC: Adding query filter params (role.id=6fcc322b483a475399974562c1e5bd43, scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0, user.id=53dfc3572d05469ca7e2de1acea3629a) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:08.150102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce454a1-8871-4fd3-a78a-6815869a912a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:08.151539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce454a1-8871-4fd3-a78a-6815869a912a None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:08.157123 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 636/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 08:06:08 2022] GET /identity/v3/role_assignments?user.id=53dfc3572d05469ca7e2de1acea3629a&scope.project.id=c279ceb26daa45ba821e6ffb1db4f4f0&role.id=6fcc322b483a475399974562c1e5bd43 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:10.214070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fb199-ff2f-4db0-9578-afa548c34aa6 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:10.214600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fb199-ff2f-4db0-9578-afa548c34aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:10.214747 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fb199-ff2f-4db0-9578-afa548c34aa6 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:10.216041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 652/1288] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:06:10.221087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a2779-3b8d-4c68-a0cf-5bf6507bdfeb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:10.221454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a2779-3b8d-4c68-a0cf-5bf6507bdfeb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:10.221649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a2779-3b8d-4c68-a0cf-5bf6507bdfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:10.239378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1f4a2779-3b8d-4c68-a0cf-5bf6507bdfeb None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:06:10.240557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1f4a2779-3b8d-4c68-a0cf-5bf6507bdfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:06:10.272110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:10.316944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 637/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:06:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:06:10.340299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fb199-ff2f-4db0-9578-afa548c34aa6 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:10.441329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fb199-ff2f-4db0-9578-afa548c34aa6 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:10.452474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:10.475860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5d249-f720-4537-8326-b045ed8cf779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:10.476576 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5d249-f720-4537-8326-b045ed8cf779 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:10.476855 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5d249-f720-4537-8326-b045ed8cf779 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:10.477127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5d249-f720-4537-8326-b045ed8cf779 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:10.477766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5d249-f720-4537-8326-b045ed8cf779 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:10.479163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5d249-f720-4537-8326-b045ed8cf779 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-08d5d249-f720-4537-8326-b045ed8cf779 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:10.490871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:10.496369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:06:10.497447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 653/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 08:06:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:06:10.498472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a2779-3b8d-4c68-a0cf-5bf6507bdfeb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:10.594325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a2779-3b8d-4c68-a0cf-5bf6507bdfeb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:10.627221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedf508-a2fa-41cc-adf4-9881630f0627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:10.627873 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedf508-a2fa-41cc-adf4-9881630f0627 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:10.628685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedf508-a2fa-41cc-adf4-9881630f0627 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:10.629058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedf508-a2fa-41cc-adf4-9881630f0627 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:10.629764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedf508-a2fa-41cc-adf4-9881630f0627 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:10.630073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedf508-a2fa-41cc-adf4-9881630f0627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:10.631471 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedf508-a2fa-41cc-adf4-9881630f0627 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:10.636204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 638/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jun 21 08:06:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:10.642010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5d249-f720-4537-8326-b045ed8cf779 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:10.744032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5d249-f720-4537-8326-b045ed8cf779 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:10.780039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ab1dd-cdab-4383-a1f8-098e3c8984a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:10.780688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ab1dd-cdab-4383-a1f8-098e3c8984a8 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:10.780970 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ab1dd-cdab-4383-a1f8-098e3c8984a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:10.781244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ab1dd-cdab-4383-a1f8-098e3c8984a8 None admin] PATH_INFO: `/v3/services` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:10.781943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ab1dd-cdab-4383-a1f8-098e3c8984a8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:10.782247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ab1dd-cdab-4383-a1f8-098e3c8984a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:10.783635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ab1dd-cdab-4383-a1f8-098e3c8984a8 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:10.788505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 654/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jun 21 08:06:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:12.841401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70227b-8c5e-411e-b213-790e8806e5b9 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:12.841912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70227b-8c5e-411e-b213-790e8806e5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:12.841912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70227b-8c5e-411e-b213-790e8806e5b9 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:12.843284 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 639/1293] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:06:12.848551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7a12c-54a3-4800-885a-de9eced7fe8f None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:12.848958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7a12c-54a3-4800-885a-de9eced7fe8f None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:12.849101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7a12c-54a3-4800-885a-de9eced7fe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:12.865725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-38a7a12c-54a3-4800-885a-de9eced7fe8f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:06:12.866925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-38a7a12c-54a3-4800-885a-de9eced7fe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:06:12.896040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:12.932189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 655/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:06:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:06:12.957436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70227b-8c5e-411e-b213-790e8806e5b9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:12.988529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:13.057943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70227b-8c5e-411e-b213-790e8806e5b9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:13.090632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb74f73-bea1-4aed-aab7-e932511436fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:13.091287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb74f73-bea1-4aed-aab7-e932511436fd None admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:13.091623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb74f73-bea1-4aed-aab7-e932511436fd None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:13.091856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb74f73-bea1-4aed-aab7-e932511436fd None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:13.092581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb74f73-bea1-4aed-aab7-e932511436fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:13.093947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb74f73-bea1-4aed-aab7-e932511436fd None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:13.106227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 640/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 08:06:12 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:06:15.167419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ec524-4bcc-4ed6-9e53-43ef44252487 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:15.167991 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ec524-4bcc-4ed6-9e53-43ef44252487 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:15.167991 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ec524-4bcc-4ed6-9e53-43ef44252487 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:15.169330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 656/1296] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:06:15.174340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdf443-89db-4f4b-ad4b-8e309705385f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:15.174738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdf443-89db-4f4b-ad4b-8e309705385f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:15.174982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdf443-89db-4f4b-ad4b-8e309705385f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:15.191919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e6bdf443-89db-4f4b-ad4b-8e309705385f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:06:15.193105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e6bdf443-89db-4f4b-ad4b-8e309705385f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:06:15.265220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 641/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:06:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:06:15.289688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ec524-4bcc-4ed6-9e53-43ef44252487 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:15.400320 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ec524-4bcc-4ed6-9e53-43ef44252487 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:15.433899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5efade-f41f-4319-895d-1be36f2b823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:15.434641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5efade-f41f-4319-895d-1be36f2b823b None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:15.434923 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5efade-f41f-4319-895d-1be36f2b823b None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:15.435198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5efade-f41f-4319-895d-1be36f2b823b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:15.435848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5efade-f41f-4319-895d-1be36f2b823b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:15.437216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5efade-f41f-4319-895d-1be36f2b823b None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-5d5efade-f41f-4319-895d-1be36f2b823b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:15.449762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:15.450956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:06:15.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 657/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 08:06:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:06:15.457106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdf443-89db-4f4b-ad4b-8e309705385f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:15.474854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:15.553294 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdf443-89db-4f4b-ad4b-8e309705385f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:15.586839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469744-4bb4-4ad8-a3d1-eb2bdf50fde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:15.587492 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469744-4bb4-4ad8-a3d1-eb2bdf50fde8 None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:15.587778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469744-4bb4-4ad8-a3d1-eb2bdf50fde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:15.588053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469744-4bb4-4ad8-a3d1-eb2bdf50fde8 None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:15.588756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef469744-4bb4-4ad8-a3d1-eb2bdf50fde8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:15.589064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef469744-4bb4-4ad8-a3d1-eb2bdf50fde8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:15.590429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef469744-4bb4-4ad8-a3d1-eb2bdf50fde8 None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:15.595517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 642/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jun 21 08:06:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:15.602086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5efade-f41f-4319-895d-1be36f2b823b None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:15.632935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:15.700912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5efade-f41f-4319-895d-1be36f2b823b None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:15.734004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08040293-750b-49bc-b573-8a561bcd4e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:15.734680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08040293-750b-49bc-b573-8a561bcd4e82 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:15.734979 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08040293-750b-49bc-b573-8a561bcd4e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:15.735258 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08040293-750b-49bc-b573-8a561bcd4e82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:15.736042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08040293-750b-49bc-b573-8a561bcd4e82 None admin] RBAC: Adding query filter params (interface=public, service_id=2a334faa2ba64e958e50a609396875b7, region_id=RegionOne) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:15.736356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08040293-750b-49bc-b573-8a561bcd4e82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:15.738348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08040293-750b-49bc-b573-8a561bcd4e82 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:15.743412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 658/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 08:06:15 2022] GET /identity/v3/endpoints?service_id=2a334faa2ba64e958e50a609396875b7&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:15.748991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469744-4bb4-4ad8-a3d1-eb2bdf50fde8 None admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:15.829632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:15.847881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469744-4bb4-4ad8-a3d1-eb2bdf50fde8 None admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:15.880561 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e72e0f-9d79-43c4-90bf-00f6a948cb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:15.881197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e72e0f-9d79-43c4-90bf-00f6a948cb7c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:15.881476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e72e0f-9d79-43c4-90bf-00f6a948cb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:15.881749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e72e0f-9d79-43c4-90bf-00f6a948cb7c None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:15.882416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e72e0f-9d79-43c4-90bf-00f6a948cb7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:15.883856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e72e0f-9d79-43c4-90bf-00f6a948cb7c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:15.890448 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 643/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 08:06:15 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:06:17.902643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6770f-3ac8-4568-ba20-f24357af8f03 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:17.903140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6770f-3ac8-4568-ba20-f24357af8f03 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:17.903140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6770f-3ac8-4568-ba20-f24357af8f03 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:17.904502 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 659/1302] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:06:17.910291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66243f-9d74-4695-90bc-71189d446b06 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:17.910685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66243f-9d74-4695-90bc-71189d446b06 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:17.910870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66243f-9d74-4695-90bc-71189d446b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:17.927534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2e66243f-9d74-4695-90bc-71189d446b06 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:06:17.928700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2e66243f-9d74-4695-90bc-71189d446b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:06:17.999870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 644/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:06:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 08:06:18.023383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6770f-3ac8-4568-ba20-f24357af8f03 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:18.119978 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:18.126735 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6770f-3ac8-4568-ba20-f24357af8f03 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:18.160784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fc8d4-ac67-4fe8-ac4b-7faa6c803f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:18.161504 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fc8d4-ac67-4fe8-ac4b-7faa6c803f70 None admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:18.161792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fc8d4-ac67-4fe8-ac4b-7faa6c803f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:18.162064 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fc8d4-ac67-4fe8-ac4b-7faa6c803f70 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:18.162730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fc8d4-ac67-4fe8-ac4b-7faa6c803f70 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:18.164094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fc8d4-ac67-4fe8-ac4b-7faa6c803f70 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application [None req-804fc8d4-ac67-4fe8-ac4b-7faa6c803f70 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 08:06:18.176487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 08:06:18.177651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application with Lock( Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self._enter() Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application return self.creator() Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application created_value = creator( Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: ERROR keystone.server.flask.application Jun 21 08:06:18.178713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 660/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 08:06:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 08:06:18.183778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66243f-9d74-4695-90bc-71189d446b06 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:18.258223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:18.286051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66243f-9d74-4695-90bc-71189d446b06 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:18.318321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c7047-9b5a-4bf4-b085-0fd203f1a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:18.318997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c7047-9b5a-4bf4-b085-0fd203f1a36c None admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:18.319277 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c7047-9b5a-4bf4-b085-0fd203f1a36c None admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:18.319549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c7047-9b5a-4bf4-b085-0fd203f1a36c None admin] PATH_INFO: `/v3/services` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:18.320243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c7047-9b5a-4bf4-b085-0fd203f1a36c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:06:18.320545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c7047-9b5a-4bf4-b085-0fd203f1a36c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:18.321894 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c7047-9b5a-4bf4-b085-0fd203f1a36c None admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:18.326880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 645/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jun 21 08:06:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:06:18.333244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fc8d4-ac67-4fe8-ac4b-7faa6c803f70 None admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:06:18.430902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fc8d4-ac67-4fe8-ac4b-7faa6c803f70 None admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:06:18.463204 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807e6c4-9186-4305-b16d-820d631ae300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:06:18.463835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807e6c4-9186-4305-b16d-820d631ae300 None admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:06:18.464121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807e6c4-9186-4305-b16d-820d631ae300 None admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:06:18.464394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807e6c4-9186-4305-b16d-820d631ae300 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:06:18.465127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807e6c4-9186-4305-b16d-820d631ae300 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:06:18.466478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807e6c4-9186-4305-b16d-820d631ae300 None admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:06:18.484617 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 661/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 08:06:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:06:28.324212 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=30 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:06:28.480250 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:21.729093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323f82-ef1a-426d-a504-e9fc26389639 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:21.729664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323f82-ef1a-426d-a504-e9fc26389639 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:21.729664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323f82-ef1a-426d-a504-e9fc26389639 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:21.736988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852386d-2270-4c33-8687-f1249ba6f697 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:21.737466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852386d-2270-4c33-8687-f1249ba6f697 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:21.737547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852386d-2270-4c33-8687-f1249ba6f697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:21.741321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 646/1307] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:07:21 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:21.812467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-9852386d-2270-4c33-8687-f1249ba6f697 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:21.814544 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9852386d-2270-4c33-8687-f1249ba6f697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:21.961766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 662/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:22.015616 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc5ffd-4206-41a7-8922-62626e82f7ba None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:22.016134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc5ffd-4206-41a7-8922-62626e82f7ba None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:22.016650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc5ffd-4206-41a7-8922-62626e82f7ba None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:22.019026 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 647/1309] 10.222.0.36 () {54 vars in 964 bytes} [Tue Jun 21 08:07:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:22.025052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68285e13-9e3b-49ed-8399-a2fcf1a7fa11 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:22.025370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68285e13-9e3b-49ed-8399-a2fcf1a7fa11 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:22.025616 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68285e13-9e3b-49ed-8399-a2fcf1a7fa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:22.122933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-68285e13-9e3b-49ed-8399-a2fcf1a7fa11 None None] MFA Rules not processed for user `cdac6ddece434ed7abddcffe841476ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:22.124690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-68285e13-9e3b-49ed-8399-a2fcf1a7fa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:22.150038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:22.213601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 663/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Tue Jun 21 08:07:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:22.223156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc5ffd-4206-41a7-8922-62626e82f7ba None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:07:22.225116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c3fc5ffd-4206-41a7-8922-62626e82f7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:22.348278 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc5ffd-4206-41a7-8922-62626e82f7ba None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:07:22.431330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2050e-0691-489c-a6ea-f81bd2798c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:07:22.432148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2050e-0691-489c-a6ea-f81bd2798c32 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:22.432545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2050e-0691-489c-a6ea-f81bd2798c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:22.432921 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2050e-0691-489c-a6ea-f81bd2798c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:22.434681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d1a2050e-0691-489c-a6ea-f81bd2798c32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:22.492969 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:22.552794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2050e-0691-489c-a6ea-f81bd2798c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:07:22.554239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2050e-0691-489c-a6ea-f81bd2798c32 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:07:22.575215 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 648/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:07:24.926612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec885817-5fa7-4080-b7e3-72132435bb40 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:24.927167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec885817-5fa7-4080-b7e3-72132435bb40 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:24.927167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec885817-5fa7-4080-b7e3-72132435bb40 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:24.928508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 664/1312] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:24.933599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6d16-949f-4c94-8f34-754c6dc3e4ca None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:24.934030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6d16-949f-4c94-8f34-754c6dc3e4ca None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:24.934325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6d16-949f-4c94-8f34-754c6dc3e4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:25.030729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-654a6d16-949f-4c94-8f34-754c6dc3e4ca None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:25.032293 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-654a6d16-949f-4c94-8f34-754c6dc3e4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:25.158681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 649/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:25.180795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec885817-5fa7-4080-b7e3-72132435bb40 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:07:25.182289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ec885817-5fa7-4080-b7e3-72132435bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:25.302180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec885817-5fa7-4080-b7e3-72132435bb40 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:07:25.378603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:25.381377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6313fa-e0c6-4f91-a55c-aa3e5458bf27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:07:25.382106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6313fa-e0c6-4f91-a55c-aa3e5458bf27 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:25.382387 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6313fa-e0c6-4f91-a55c-aa3e5458bf27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:25.382763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6313fa-e0c6-4f91-a55c-aa3e5458bf27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:25.384809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6d6313fa-e0c6-4f91-a55c-aa3e5458bf27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:25.502881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6313fa-e0c6-4f91-a55c-aa3e5458bf27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:07:25.504431 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6313fa-e0c6-4f91-a55c-aa3e5458bf27 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:07:25.523987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 665/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:07:27.886127 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aab89-81e0-4089-9f8f-858cbc3eec74 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:27.886663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aab89-81e0-4089-9f8f-858cbc3eec74 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:27.886663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aab89-81e0-4089-9f8f-858cbc3eec74 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:27.888014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 650/1315] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:27.893120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3971f-d39e-409a-adb3-32b52cd49560 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:27.893546 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3971f-d39e-409a-adb3-32b52cd49560 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:27.893671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3971f-d39e-409a-adb3-32b52cd49560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:27.960245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-95c3971f-d39e-409a-adb3-32b52cd49560 None None] MFA Rules not processed for user `7b5047405b9548e5a14237010269640a`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:27.962326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-95c3971f-d39e-409a-adb3-32b52cd49560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:28.013765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:28.058377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 666/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:07:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:07:28.099091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9aab89-81e0-4089-9f8f-858cbc3eec74 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:07:28.100632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-de9aab89-81e0-4089-9f8f-858cbc3eec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:28.110320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:28.202306 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9aab89-81e0-4089-9f8f-858cbc3eec74 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:07:28.275912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61e323-dc5a-4ccb-b20a-62968fd5af39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:07:28.276546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61e323-dc5a-4ccb-b20a-62968fd5af39 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:28.276825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61e323-dc5a-4ccb-b20a-62968fd5af39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:28.277095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61e323-dc5a-4ccb-b20a-62968fd5af39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:28.278764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7b61e323-dc5a-4ccb-b20a-62968fd5af39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:28.340416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:28.386277 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61e323-dc5a-4ccb-b20a-62968fd5af39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:07:28.387729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61e323-dc5a-4ccb-b20a-62968fd5af39 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:07:28.405596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 651/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:07:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:07:31.017911 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a349-41fc-41e3-bbda-caaf097125aa None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:31.019643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a349-41fc-41e3-bbda-caaf097125aa None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:31.019643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a349-41fc-41e3-bbda-caaf097125aa None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:31.020008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 667/1318] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:07:31.025129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987089f7-a18d-47e3-a2e8-d0577221cc46 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:31.025586 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987089f7-a18d-47e3-a2e8-d0577221cc46 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:31.025685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987089f7-a18d-47e3-a2e8-d0577221cc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:31.089049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-987089f7-a18d-47e3-a2e8-d0577221cc46 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:31.090267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-987089f7-a18d-47e3-a2e8-d0577221cc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:31.187250 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 652/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:07:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:31.238961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09086cab-a027-4d9a-8986-0e0c7ef9aa54 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:31.239249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09086cab-a027-4d9a-8986-0e0c7ef9aa54 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:31.239530 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09086cab-a027-4d9a-8986-0e0c7ef9aa54 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:31.240910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 668/1320] 10.222.0.36 () {54 vars in 964 bytes} [Tue Jun 21 08:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:31.246510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0abf4d-36b3-48bb-9431-95006479cd23 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:31.246828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0abf4d-36b3-48bb-9431-95006479cd23 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:31.247104 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0abf4d-36b3-48bb-9431-95006479cd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:31.268750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:31.323709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1e0abf4d-36b3-48bb-9431-95006479cd23 None None] MFA Rules not processed for user `cdac6ddece434ed7abddcffe841476ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:31.324908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1e0abf4d-36b3-48bb-9431-95006479cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:31.398773 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 653/1321] 10.222.0.36 () {58 vars in 1061 bytes} [Tue Jun 21 08:07:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:31.409541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09086cab-a027-4d9a-8986-0e0c7ef9aa54 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:07:31.411099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-09086cab-a027-4d9a-8986-0e0c7ef9aa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:31.514813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09086cab-a027-4d9a-8986-0e0c7ef9aa54 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:07:31.589849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650b72a-264d-4357-ac69-1217610b5e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:07:31.590488 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650b72a-264d-4357-ac69-1217610b5e55 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:31.590806 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650b72a-264d-4357-ac69-1217610b5e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:31.591083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650b72a-264d-4357-ac69-1217610b5e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:31.592726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8650b72a-264d-4357-ac69-1217610b5e55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:31.599604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:31.700022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650b72a-264d-4357-ac69-1217610b5e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:07:31.701441 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650b72a-264d-4357-ac69-1217610b5e55 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:07:31.719039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 669/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:07:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:07:34.907082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66dfb-df69-40d2-955f-04263998cdf8 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:34.907588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66dfb-df69-40d2-955f-04263998cdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:34.907588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66dfb-df69-40d2-955f-04263998cdf8 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:34.909195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 654/1323] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:34.914424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83b43-591d-4671-9cf3-5e22aaaca280 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:34.914917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83b43-591d-4671-9cf3-5e22aaaca280 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:34.915023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83b43-591d-4671-9cf3-5e22aaaca280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:34.981046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-beb83b43-591d-4671-9cf3-5e22aaaca280 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:34.982285 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-beb83b43-591d-4671-9cf3-5e22aaaca280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:35.062503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:35.108450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 670/1324] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:35.144968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66dfb-df69-40d2-955f-04263998cdf8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:07:35.146639 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e9d66dfb-df69-40d2-955f-04263998cdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:35.255821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66dfb-df69-40d2-955f-04263998cdf8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:07:35.269052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:35.342282 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886b1d8-a8c6-4c54-b4aa-ad2c940234e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:07:35.342954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886b1d8-a8c6-4c54-b4aa-ad2c940234e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:35.343236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886b1d8-a8c6-4c54-b4aa-ad2c940234e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:35.343510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886b1d8-a8c6-4c54-b4aa-ad2c940234e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:35.345149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0886b1d8-a8c6-4c54-b4aa-ad2c940234e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:35.457944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886b1d8-a8c6-4c54-b4aa-ad2c940234e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:07:35.459419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886b1d8-a8c6-4c54-b4aa-ad2c940234e6 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:07:35.478638 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 655/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:07:37.564158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce6d2c-b3f5-4d49-ae1d-9265406090b5 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:37.565125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce6d2c-b3f5-4d49-ae1d-9265406090b5 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:37.565450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce6d2c-b3f5-4d49-ae1d-9265406090b5 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:37.566924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 671/1326] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:37.572273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede7e6-c606-4e29-9271-38111e857024 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:37.572671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede7e6-c606-4e29-9271-38111e857024 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:37.572940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede7e6-c606-4e29-9271-38111e857024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:37.619119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:37.638343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-94ede7e6-c606-4e29-9271-38111e857024 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:37.639575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-94ede7e6-c606-4e29-9271-38111e857024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:37.736057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 656/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:37.773091 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce6d2c-b3f5-4d49-ae1d-9265406090b5 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:07:37.774655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-86ce6d2c-b3f5-4d49-ae1d-9265406090b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:37.880982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce6d2c-b3f5-4d49-ae1d-9265406090b5 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:07:37.956271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a9ef6-d09e-4cc8-9831-8611dd56bf13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:07:37.956933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9ef6-d09e-4cc8-9831-8611dd56bf13 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:37.957221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9ef6-d09e-4cc8-9831-8611dd56bf13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:37.957497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9ef6-d09e-4cc8-9831-8611dd56bf13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:37.959259 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-328a9ef6-d09e-4cc8-9831-8611dd56bf13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:37.978335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:38.075220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a9ef6-d09e-4cc8-9831-8611dd56bf13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:07:38.076662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a9ef6-d09e-4cc8-9831-8611dd56bf13 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:07:38.094814 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 672/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:07:40.196286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48151b72-fc80-450c-bbc0-562aba37233a None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:40.196841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48151b72-fc80-450c-bbc0-562aba37233a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:40.196841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48151b72-fc80-450c-bbc0-562aba37233a None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:40.198198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 657/1329] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:40.203318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542523ec-38f5-4fc4-a474-4c44943ac1e5 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:40.203733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542523ec-38f5-4fc4-a474-4c44943ac1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:40.203886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542523ec-38f5-4fc4-a474-4c44943ac1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:40.269004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-542523ec-38f5-4fc4-a474-4c44943ac1e5 None None] MFA Rules not processed for user `7b5047405b9548e5a14237010269640a`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:40.270217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-542523ec-38f5-4fc4-a474-4c44943ac1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:40.337994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:40.370728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 673/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:07:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:40.409163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48151b72-fc80-450c-bbc0-562aba37233a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:07:40.410806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-48151b72-fc80-450c-bbc0-562aba37233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:40.517903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48151b72-fc80-450c-bbc0-562aba37233a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:07:40.537916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:40.596905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665c013-0263-461e-af47-dd3bdb514390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:07:40.597470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665c013-0263-461e-af47-dd3bdb514390 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:40.597750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665c013-0263-461e-af47-dd3bdb514390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:40.598021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665c013-0263-461e-af47-dd3bdb514390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:40.599735 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c665c013-0263-461e-af47-dd3bdb514390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:40.711886 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665c013-0263-461e-af47-dd3bdb514390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:07:40.713329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665c013-0263-461e-af47-dd3bdb514390 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:07:40.731521 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 658/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:07:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:07:43.049473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e938a84-895b-4f89-a712-e93dcd152fe6 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:43.050041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e938a84-895b-4f89-a712-e93dcd152fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:43.050041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e938a84-895b-4f89-a712-e93dcd152fe6 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:43.051448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 674/1332] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:43.056510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998bc35-8dff-46e9-a14a-4ed4b1587d6d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:43.056927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998bc35-8dff-46e9-a14a-4ed4b1587d6d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:43.057077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998bc35-8dff-46e9-a14a-4ed4b1587d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:43.119618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:43.122639 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3998bc35-8dff-46e9-a14a-4ed4b1587d6d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:43.124365 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3998bc35-8dff-46e9-a14a-4ed4b1587d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:43.218545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 659/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:43.254897 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e938a84-895b-4f89-a712-e93dcd152fe6 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:07:43.256443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8e938a84-895b-4f89-a712-e93dcd152fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:43.358863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e938a84-895b-4f89-a712-e93dcd152fe6 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:07:43.432395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689faeb3-249e-4da9-97d1-33a933854c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:07:43.433034 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689faeb3-249e-4da9-97d1-33a933854c8c service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:43.433316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689faeb3-249e-4da9-97d1-33a933854c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:43.433591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689faeb3-249e-4da9-97d1-33a933854c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:43.435289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-689faeb3-249e-4da9-97d1-33a933854c8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:43.462245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:43.544135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689faeb3-249e-4da9-97d1-33a933854c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:07:43.545562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689faeb3-249e-4da9-97d1-33a933854c8c service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:07:43.564986 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 675/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:07:45.660891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce280d-6364-48a5-b208-6be41d40168d None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:45.661424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce280d-6364-48a5-b208-6be41d40168d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:45.661546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce280d-6364-48a5-b208-6be41d40168d None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:45.662901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 660/1335] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:45.667966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bf09f-d002-4e82-b923-7d9830fdc382 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:45.668344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bf09f-d002-4e82-b923-7d9830fdc382 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:45.668519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bf09f-d002-4e82-b923-7d9830fdc382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:45.732057 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-9e4bf09f-d002-4e82-b923-7d9830fdc382 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:45.733260 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9e4bf09f-d002-4e82-b923-7d9830fdc382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:45.807765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:45.833218 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 676/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:45.875541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce280d-6364-48a5-b208-6be41d40168d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:07:45.877785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-85ce280d-6364-48a5-b208-6be41d40168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:45.979555 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce280d-6364-48a5-b208-6be41d40168d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:07:46.008357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:46.053290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b47e77-a630-4e03-9fd3-a380450345ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:07:46.053956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b47e77-a630-4e03-9fd3-a380450345ab service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:46.054241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b47e77-a630-4e03-9fd3-a380450345ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:46.054518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b47e77-a630-4e03-9fd3-a380450345ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:46.056248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-75b47e77-a630-4e03-9fd3-a380450345ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:46.172689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b47e77-a630-4e03-9fd3-a380450345ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:07:46.174612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b47e77-a630-4e03-9fd3-a380450345ab service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:07:46.192983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 661/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:07:48.618420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800730a-37cf-4380-b0c8-4286b0969dc0 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:48.619105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800730a-37cf-4380-b0c8-4286b0969dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:48.619105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800730a-37cf-4380-b0c8-4286b0969dc0 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:48.620383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 677/1338] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:48.625747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510abef1-fad1-4084-8d95-db837e851771 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:48.626188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510abef1-fad1-4084-8d95-db837e851771 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:48.626342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510abef1-fad1-4084-8d95-db837e851771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:48.705817 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-510abef1-fad1-4084-8d95-db837e851771 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:48.707100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-510abef1-fad1-4084-8d95-db837e851771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:48.716605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:48.811244 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 662/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:07:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:48.848329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800730a-37cf-4380-b0c8-4286b0969dc0 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:07:48.849878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9800730a-37cf-4380-b0c8-4286b0969dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:48.960830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800730a-37cf-4380-b0c8-4286b0969dc0 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:07:49.039347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d528d8-2e1e-443e-b64a-2796dd180c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:07:49.039985 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d528d8-2e1e-443e-b64a-2796dd180c9f service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:49.040262 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d528d8-2e1e-443e-b64a-2796dd180c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:49.040529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d528d8-2e1e-443e-b64a-2796dd180c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:49.042163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-49d528d8-2e1e-443e-b64a-2796dd180c9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:49.090145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:49.174758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d528d8-2e1e-443e-b64a-2796dd180c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:07:49.176112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d528d8-2e1e-443e-b64a-2796dd180c9f service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:07:49.194374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 678/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:07:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:07:53.154170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277bed6-a96d-49ce-8162-a1d0c8e7c801 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:53.154756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277bed6-a96d-49ce-8162-a1d0c8e7c801 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:53.154926 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277bed6-a96d-49ce-8162-a1d0c8e7c801 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:53.156274 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 663/1341] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:53.162012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4234-9f67-45f5-9066-9781836f2542 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:53.162416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4234-9f67-45f5-9066-9781836f2542 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:53.162558 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c4234-9f67-45f5-9066-9781836f2542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:53.236600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-240c4234-9f67-45f5-9066-9781836f2542 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:53.238099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-240c4234-9f67-45f5-9066-9781836f2542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:53.330376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:53.343379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 679/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:53.382609 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277bed6-a96d-49ce-8162-a1d0c8e7c801 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:07:53.384736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0277bed6-a96d-49ce-8162-a1d0c8e7c801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:53.478068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277bed6-a96d-49ce-8162-a1d0c8e7c801 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:07:53.481706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab4b0c-c28e-427b-a477-a86b687165cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:07:53.482350 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab4b0c-c28e-427b-a477-a86b687165cd service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:53.482662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab4b0c-c28e-427b-a477-a86b687165cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:53.482945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab4b0c-c28e-427b-a477-a86b687165cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:53.493190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab4b0c-c28e-427b-a477-a86b687165cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:07:53.494557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab4b0c-c28e-427b-a477-a86b687165cd service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:07:53.505000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 664/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:07:56.120941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cb203-6caa-4a96-b213-31744d9f6faf None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:56.121509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cb203-6caa-4a96-b213-31744d9f6faf None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:56.121509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cb203-6caa-4a96-b213-31744d9f6faf None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:56.123048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 680/1344] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:07:56.128851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b41874-8820-4622-8c01-afdb99885da5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:56.129278 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b41874-8820-4622-8c01-afdb99885da5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:56.129413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b41874-8820-4622-8c01-afdb99885da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:56.157509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-51b41874-8820-4622-8c01-afdb99885da5 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:07:56.158758 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-51b41874-8820-4622-8c01-afdb99885da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:56.186419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:07:56.237041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 665/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:07:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:07:56.275076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cb203-6caa-4a96-b213-31744d9f6faf None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:07:56.276827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-833cb203-6caa-4a96-b213-31744d9f6faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:07:56.292048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cb203-6caa-4a96-b213-31744d9f6faf None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:07:56.296739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71f225-a5d1-4723-9b29-19eabd4e311e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:07:56.297741 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71f225-a5d1-4723-9b29-19eabd4e311e service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:07:56.298884 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71f225-a5d1-4723-9b29-19eabd4e311e service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:07:56.299256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71f225-a5d1-4723-9b29-19eabd4e311e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:07:56.309083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71f225-a5d1-4723-9b29-19eabd4e311e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:07:56.310507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71f225-a5d1-4723-9b29-19eabd4e311e service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:07:56.321062 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 681/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:07:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:00.714697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d79546-00e3-472b-8dea-767ab889587e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:00.715220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d79546-00e3-472b-8dea-767ab889587e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:00.715403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d79546-00e3-472b-8dea-767ab889587e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:00.716918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 666/1347] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:00.722994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7debfc-1e20-413c-9af8-a6e013eb4bf9 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:00.723447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7debfc-1e20-413c-9af8-a6e013eb4bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:00.723539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7debfc-1e20-413c-9af8-a6e013eb4bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:00.741087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-2d7debfc-1e20-413c-9af8-a6e013eb4bf9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:00.742276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2d7debfc-1e20-413c-9af8-a6e013eb4bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:00.750033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 682/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:00.790069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d79546-00e3-472b-8dea-767ab889587e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:00.803937 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d79546-00e3-472b-8dea-767ab889587e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:00.807552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337f345-3497-4fa1-9952-56e5344da6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:00.808191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337f345-3497-4fa1-9952-56e5344da6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:00.808485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337f345-3497-4fa1-9952-56e5344da6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:00.808761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337f345-3497-4fa1-9952-56e5344da6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:00.818460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337f345-3497-4fa1-9952-56e5344da6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:00.819929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337f345-3497-4fa1-9952-56e5344da6f1 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:00.830203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 667/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:05.910428 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b318f45-b6f8-4c87-96ee-210051b6cab3 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:05.911479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b318f45-b6f8-4c87-96ee-210051b6cab3 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:05.911909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b318f45-b6f8-4c87-96ee-210051b6cab3 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:05.913437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 683/1350] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:05.924346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157352-7187-4564-bae8-7002045b6614 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:05.925180 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157352-7187-4564-bae8-7002045b6614 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:05.930640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157352-7187-4564-bae8-7002045b6614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:06.022525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-55157352-7187-4564-bae8-7002045b6614 None None] MFA Rules not processed for user `53dfc3572d05469ca7e2de1acea3629a`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:06.023990 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-55157352-7187-4564-bae8-7002045b6614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:06.105493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 668/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:08:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:10.267863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0986-8130-4b01-9d95-83ca1c000d2d None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:10.268412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0986-8130-4b01-9d95-83ca1c000d2d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:10.268412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0986-8130-4b01-9d95-83ca1c000d2d None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:10.270060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 684/1352] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:10.276036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d0633-68c5-4dae-9897-feae1f864119 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:10.276488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d0633-68c5-4dae-9897-feae1f864119 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:10.276585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d0633-68c5-4dae-9897-feae1f864119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:10.295662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-359d0633-68c5-4dae-9897-feae1f864119 None None] MFA Rules not processed for user `53dfc3572d05469ca7e2de1acea3629a`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:10.296967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-359d0633-68c5-4dae-9897-feae1f864119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:10.305669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 669/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:08:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:10.735629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=13 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:11.952409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83335e-107d-462f-9ef3-6e8e8758cb60 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:11.953030 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83335e-107d-462f-9ef3-6e8e8758cb60 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:11.953030 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83335e-107d-462f-9ef3-6e8e8758cb60 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:11.955166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 685/1354] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:11.960351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cead38-7ab3-41a8-af53-3fd937ac33c5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:11.960806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cead38-7ab3-41a8-af53-3fd937ac33c5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:11.961059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cead38-7ab3-41a8-af53-3fd937ac33c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:11.979841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a5cead38-7ab3-41a8-af53-3fd937ac33c5 None None] MFA Rules not processed for user `53dfc3572d05469ca7e2de1acea3629a`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:11.981019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a5cead38-7ab3-41a8-af53-3fd937ac33c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:11.989836 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 670/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:08:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:08:15.626239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b36acf-4229-44b5-b490-f517408ef6c6 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:15.626839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b36acf-4229-44b5-b490-f517408ef6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:15.626839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b36acf-4229-44b5-b490-f517408ef6c6 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:15.628482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 686/1356] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:15.633627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f363636-7a65-4a40-8556-69a8e2ef25b3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:15.634066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f363636-7a65-4a40-8556-69a8e2ef25b3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:15.634159 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f363636-7a65-4a40-8556-69a8e2ef25b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:15.653058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6f363636-7a65-4a40-8556-69a8e2ef25b3 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:15.654239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6f363636-7a65-4a40-8556-69a8e2ef25b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:15.662511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 671/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:15.719234 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a363d4-da30-401d-a7b8-e6e80d73b869 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:15.719818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a363d4-da30-401d-a7b8-e6e80d73b869 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:15.720266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a363d4-da30-401d-a7b8-e6e80d73b869 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:15.721799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 687/1358] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jun 21 08:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:15.731332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c3fea-8a06-44db-a705-7285f387d9a0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:15.731823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c3fea-8a06-44db-a705-7285f387d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:15.732236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c3fea-8a06-44db-a705-7285f387d9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:15.779798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:15.789328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9c9c3fea-8a06-44db-a705-7285f387d9a0 None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:15.790540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9c9c3fea-8a06-44db-a705-7285f387d9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:15.887795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 672/1359] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jun 21 08:08:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:15.895801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a363d4-da30-401d-a7b8-e6e80d73b869 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:15.911518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a363d4-da30-401d-a7b8-e6e80d73b869 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:15.917027 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea863f6-3caf-42e9-af64-50c934f4e9c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:15.917763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea863f6-3caf-42e9-af64-50c934f4e9c9 service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:15.918167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea863f6-3caf-42e9-af64-50c934f4e9c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:15.918542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea863f6-3caf-42e9-af64-50c934f4e9c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:15.928327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea863f6-3caf-42e9-af64-50c934f4e9c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:15.930053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea863f6-3caf-42e9-af64-50c934f4e9c9 service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:15.940929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 688/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:18.192907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71068f8-669a-452e-9e2a-56d74e120893 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:18.193431 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71068f8-669a-452e-9e2a-56d74e120893 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:18.193535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71068f8-669a-452e-9e2a-56d74e120893 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:18.195058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 673/1361] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:18.200015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b98e3-e5ca-4e6d-9b3b-dba072e8314b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:18.200789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b98e3-e5ca-4e6d-9b3b-dba072e8314b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:18.201070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b98e3-e5ca-4e6d-9b3b-dba072e8314b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:18.222357 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-5a8b98e3-e5ca-4e6d-9b3b-dba072e8314b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:18.223870 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-5a8b98e3-e5ca-4e6d-9b3b-dba072e8314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:18.245259 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 689/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:18.293684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71068f8-669a-452e-9e2a-56d74e120893 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:18.308608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71068f8-669a-452e-9e2a-56d74e120893 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:18.314252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e51db-4a92-4f6b-a90c-5f854e605664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:18.315001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e51db-4a92-4f6b-a90c-5f854e605664 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:18.315358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e51db-4a92-4f6b-a90c-5f854e605664 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:18.315709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e51db-4a92-4f6b-a90c-5f854e605664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:18.324660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e51db-4a92-4f6b-a90c-5f854e605664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:18.326337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e51db-4a92-4f6b-a90c-5f854e605664 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:18.338965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 674/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:20.751111 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4024-a3a8-4616-bf10-3d4ff3d5509e None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:20.751690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4024-a3a8-4616-bf10-3d4ff3d5509e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:20.751690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4024-a3a8-4616-bf10-3d4ff3d5509e None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:20.753053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 690/1364] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:20.758363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439fdbe-4309-4c21-b269-105ed3f71cc7 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:20.758832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439fdbe-4309-4c21-b269-105ed3f71cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:20.758976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439fdbe-4309-4c21-b269-105ed3f71cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:20.777692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1439fdbe-4309-4c21-b269-105ed3f71cc7 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:20.778912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1439fdbe-4309-4c21-b269-105ed3f71cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:20.787483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 675/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:20.833764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bcc0f-c63e-4f6f-b65d-296692a24e0c None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:20.834062 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bcc0f-c63e-4f6f-b65d-296692a24e0c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:20.834411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bcc0f-c63e-4f6f-b65d-296692a24e0c None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:20.835901 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 691/1366] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jun 21 08:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:20.841093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ac0a1-ad3b-4df1-b4e3-2c27310bb467 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:20.841385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ac0a1-ad3b-4df1-b4e3-2c27310bb467 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:20.841666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ac0a1-ad3b-4df1-b4e3-2c27310bb467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:20.859959 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e40ac0a1-ad3b-4df1-b4e3-2c27310bb467 None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:20.861228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e40ac0a1-ad3b-4df1-b4e3-2c27310bb467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:20.870761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 676/1367] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jun 21 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:08:20.879231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bcc0f-c63e-4f6f-b65d-296692a24e0c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:20.894278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bcc0f-c63e-4f6f-b65d-296692a24e0c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:20.899714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8ebad-7be5-450d-9495-ca59341ce6de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:20.900350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ebad-7be5-450d-9495-ca59341ce6de service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:20.900634 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ebad-7be5-450d-9495-ca59341ce6de service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:20.900908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8ebad-7be5-450d-9495-ca59341ce6de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:20.909553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8ebad-7be5-450d-9495-ca59341ce6de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:20.911179 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8ebad-7be5-450d-9495-ca59341ce6de service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:20.927155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 692/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:23.072155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533586d0-f7f2-4d91-ad41-1d7db043174d None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:23.072748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533586d0-f7f2-4d91-ad41-1d7db043174d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:23.072748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533586d0-f7f2-4d91-ad41-1d7db043174d None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:23.074141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 677/1369] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:23.080273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179a79-9c35-4c46-a582-c4d338fe2fa2 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:23.080809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179a79-9c35-4c46-a582-c4d338fe2fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:23.080809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179a79-9c35-4c46-a582-c4d338fe2fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:23.099347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-70179a79-9c35-4c46-a582-c4d338fe2fa2 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:23.100555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-70179a79-9c35-4c46-a582-c4d338fe2fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:23.108583 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 693/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:23.152795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533586d0-f7f2-4d91-ad41-1d7db043174d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:23.169120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533586d0-f7f2-4d91-ad41-1d7db043174d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:23.175284 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb61e3-5f71-4e5e-b565-0314ecbe8e26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:23.176057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb61e3-5f71-4e5e-b565-0314ecbe8e26 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:23.176448 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb61e3-5f71-4e5e-b565-0314ecbe8e26 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:23.176831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb61e3-5f71-4e5e-b565-0314ecbe8e26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:23.185856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb61e3-5f71-4e5e-b565-0314ecbe8e26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:23.187588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb61e3-5f71-4e5e-b565-0314ecbe8e26 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:23.198630 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 678/1371] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:23.753670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba0297-7f7c-41c9-8a6c-ff0839a78813 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:23.754571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba0297-7f7c-41c9-8a6c-ff0839a78813 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:23.754992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba0297-7f7c-41c9-8a6c-ff0839a78813 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:23.756662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 694/1372] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:23.761828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f873a0f-9956-460a-be87-bb652401be39 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:23.762271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f873a0f-9956-460a-be87-bb652401be39 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:23.762832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f873a0f-9956-460a-be87-bb652401be39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:23.782234 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4f873a0f-9956-460a-be87-bb652401be39 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:23.783701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4f873a0f-9956-460a-be87-bb652401be39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:23.792199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 679/1373] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:08:24.137510 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412f9b8-8f1d-4565-be5f-2981b8729f84 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:24.137510 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412f9b8-8f1d-4565-be5f-2981b8729f84 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:24.137510 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412f9b8-8f1d-4565-be5f-2981b8729f84 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:24.140408 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 695/1374] 10.222.0.36 () {54 vars in 963 bytes} [Tue Jun 21 08:08:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:24.145650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08622-19ff-4550-af97-be78f9cd7848 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:24.146149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08622-19ff-4550-af97-be78f9cd7848 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:24.146338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08622-19ff-4550-af97-be78f9cd7848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:24.196079 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0af08622-19ff-4550-af97-be78f9cd7848 None None] MFA Rules not processed for user `36e7b70349d9427e899ee290dda2d3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:24.197378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0af08622-19ff-4550-af97-be78f9cd7848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:24.258320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 680/1375] 10.222.0.36 () {58 vars in 1060 bytes} [Tue Jun 21 08:08:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:24.266455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412f9b8-8f1d-4565-be5f-2981b8729f84 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:24.278031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412f9b8-8f1d-4565-be5f-2981b8729f84 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:24.282382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e6095-4153-426e-ae9c-4370a0581ffe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:24.283074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e6095-4153-426e-ae9c-4370a0581ffe service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:24.283420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e6095-4153-426e-ae9c-4370a0581ffe service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:24.283757 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e6095-4153-426e-ae9c-4370a0581ffe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:24.293348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e6095-4153-426e-ae9c-4370a0581ffe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:24.294895 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e6095-4153-426e-ae9c-4370a0581ffe service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:24.306514 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 696/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:25.295844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69728fe4-7cc2-4b92-80ed-715833b8827c None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:25.296376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69728fe4-7cc2-4b92-80ed-715833b8827c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:25.296376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69728fe4-7cc2-4b92-80ed-715833b8827c None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:25.298768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 681/1377] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:25.304319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d699787-afa9-4d9e-a5eb-b31b658c8c8d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:25.304831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d699787-afa9-4d9e-a5eb-b31b658c8c8d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:25.304948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d699787-afa9-4d9e-a5eb-b31b658c8c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:25.324556 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-2d699787-afa9-4d9e-a5eb-b31b658c8c8d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:25.325750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2d699787-afa9-4d9e-a5eb-b31b658c8c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:25.333848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 697/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:25.379804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69728fe4-7cc2-4b92-80ed-715833b8827c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:25.394101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69728fe4-7cc2-4b92-80ed-715833b8827c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:25.399423 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ebc4-c84d-4105-908a-d0268ae6b117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:25.400048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ebc4-c84d-4105-908a-d0268ae6b117 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:25.400330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ebc4-c84d-4105-908a-d0268ae6b117 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:25.400606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ebc4-c84d-4105-908a-d0268ae6b117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:25.409082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3ebc4-c84d-4105-908a-d0268ae6b117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:25.410670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3ebc4-c84d-4105-908a-d0268ae6b117 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:25.414544 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:25.421514 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 682/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:27.500963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca30856-323f-4869-ab33-746203a7763f None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:27.501482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca30856-323f-4869-ab33-746203a7763f None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:27.501604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca30856-323f-4869-ab33-746203a7763f None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:27.502964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 698/1380] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:27.508076 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18f349-6bce-4715-bafe-261c074d2b34 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:27.508501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18f349-6bce-4715-bafe-261c074d2b34 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:27.508627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18f349-6bce-4715-bafe-261c074d2b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:27.526177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4a18f349-6bce-4715-bafe-261c074d2b34 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:27.527452 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4a18f349-6bce-4715-bafe-261c074d2b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:27.535210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 683/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:27.580792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca30856-323f-4869-ab33-746203a7763f None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:27.596735 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca30856-323f-4869-ab33-746203a7763f None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:27.602416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35984e23-dbe9-4049-aa22-0f524e136858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:27.603081 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35984e23-dbe9-4049-aa22-0f524e136858 service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:27.603371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35984e23-dbe9-4049-aa22-0f524e136858 service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:27.603656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35984e23-dbe9-4049-aa22-0f524e136858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:27.612885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35984e23-dbe9-4049-aa22-0f524e136858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:27.614831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35984e23-dbe9-4049-aa22-0f524e136858 service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:27.624200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 699/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:29.747665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9fa94-6a5c-48da-a201-c4aa57836dd2 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:29.748198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9fa94-6a5c-48da-a201-c4aa57836dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:29.748198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9fa94-6a5c-48da-a201-c4aa57836dd2 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:29.749574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 684/1383] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:29.754922 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f97205-91a5-4517-b022-c835617a883d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:29.755347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f97205-91a5-4517-b022-c835617a883d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:29.755477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f97205-91a5-4517-b022-c835617a883d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:29.774232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-20f97205-91a5-4517-b022-c835617a883d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:29.775365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-20f97205-91a5-4517-b022-c835617a883d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:29.784100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 700/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:29.826063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9fa94-6a5c-48da-a201-c4aa57836dd2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:29.841421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9fa94-6a5c-48da-a201-c4aa57836dd2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:29.847081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e2d52-97a5-450b-8c9c-969d6157b838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:29.847722 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e2d52-97a5-450b-8c9c-969d6157b838 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:29.848007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e2d52-97a5-450b-8c9c-969d6157b838 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:29.848286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e2d52-97a5-450b-8c9c-969d6157b838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:29.857079 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e2d52-97a5-450b-8c9c-969d6157b838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:29.858699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e2d52-97a5-450b-8c9c-969d6157b838 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:29.872394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 685/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:31.944565 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16176010-3391-41ed-9060-f118fb0722ec None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:31.945089 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16176010-3391-41ed-9060-f118fb0722ec None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:31.945203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16176010-3391-41ed-9060-f118fb0722ec None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:31.946509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 701/1386] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:31.951719 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3023a8c-54ec-42b2-81a4-42f0dce4ddc9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:31.952173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3023a8c-54ec-42b2-81a4-42f0dce4ddc9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:31.952426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3023a8c-54ec-42b2-81a4-42f0dce4ddc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:31.973051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b3023a8c-54ec-42b2-81a4-42f0dce4ddc9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:31.974366 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b3023a8c-54ec-42b2-81a4-42f0dce4ddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:31.982630 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 686/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:32.031666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16176010-3391-41ed-9060-f118fb0722ec None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:32.045912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16176010-3391-41ed-9060-f118fb0722ec None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:32.052137 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c0bcc-62f4-4c48-b444-1f8ce6dd9176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:32.052764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c0bcc-62f4-4c48-b444-1f8ce6dd9176 service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:32.053043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c0bcc-62f4-4c48-b444-1f8ce6dd9176 service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:32.053312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c0bcc-62f4-4c48-b444-1f8ce6dd9176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:32.061473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c0bcc-62f4-4c48-b444-1f8ce6dd9176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:32.063940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c0bcc-62f4-4c48-b444-1f8ce6dd9176 service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:32.075305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 702/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:34.205610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bdc3f-0f50-40a0-850e-c37c9111caae None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:34.206139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bdc3f-0f50-40a0-850e-c37c9111caae None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:34.206139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bdc3f-0f50-40a0-850e-c37c9111caae None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:34.207645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 687/1389] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:34.213437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa09bf-114d-47c9-8988-fefb0220cfa9 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:34.213886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa09bf-114d-47c9-8988-fefb0220cfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:34.214176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa09bf-114d-47c9-8988-fefb0220cfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:34.238276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-06fa09bf-114d-47c9-8988-fefb0220cfa9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:34.240154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-06fa09bf-114d-47c9-8988-fefb0220cfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:34.251538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 703/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:34.299792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bdc3f-0f50-40a0-850e-c37c9111caae None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:34.319128 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bdc3f-0f50-40a0-850e-c37c9111caae None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:34.326160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a3c5f-03a8-4625-b11a-403f73cd9795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:34.326979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a3c5f-03a8-4625-b11a-403f73cd9795 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:34.327611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a3c5f-03a8-4625-b11a-403f73cd9795 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:34.329479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a3c5f-03a8-4625-b11a-403f73cd9795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:34.340237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a3c5f-03a8-4625-b11a-403f73cd9795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:34.342290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a3c5f-03a8-4625-b11a-403f73cd9795 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:34.355517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 688/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:36.614571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8be010-a8eb-4fb9-8e75-92a5d16a6d3e None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:36.615238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8be010-a8eb-4fb9-8e75-92a5d16a6d3e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:36.615238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8be010-a8eb-4fb9-8e75-92a5d16a6d3e None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:36.616520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 704/1392] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:36.623449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b5aa1-2c24-42e5-bec7-cb21f3f55ec9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:36.623891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b5aa1-2c24-42e5-bec7-cb21f3f55ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:36.623991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b5aa1-2c24-42e5-bec7-cb21f3f55ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:36.642426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3d8b5aa1-2c24-42e5-bec7-cb21f3f55ec9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:36.643663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3d8b5aa1-2c24-42e5-bec7-cb21f3f55ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:36.651670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 689/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:36.721453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8be010-a8eb-4fb9-8e75-92a5d16a6d3e None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:36.739790 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8be010-a8eb-4fb9-8e75-92a5d16a6d3e None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:36.745243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05bd75-d88e-4bc2-91a3-c1e041d86c7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:36.745905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05bd75-d88e-4bc2-91a3-c1e041d86c7f service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:36.746182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05bd75-d88e-4bc2-91a3-c1e041d86c7f service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:36.746455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05bd75-d88e-4bc2-91a3-c1e041d86c7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:36.755066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05bd75-d88e-4bc2-91a3-c1e041d86c7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:36.756665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05bd75-d88e-4bc2-91a3-c1e041d86c7f service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:36.766325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 705/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:08:38.963568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050b775-452c-4c93-9d80-ef02a2d1ef5f None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:38.964125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050b775-452c-4c93-9d80-ef02a2d1ef5f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:38.964125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050b775-452c-4c93-9d80-ef02a2d1ef5f None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:38.965495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 690/1395] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:38.971127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d15558-81ca-415a-b571-3380260c2478 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:38.971540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d15558-81ca-415a-b571-3380260c2478 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:38.971683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d15558-81ca-415a-b571-3380260c2478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:38.989373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d7d15558-81ca-415a-b571-3380260c2478 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:38.990552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d7d15558-81ca-415a-b571-3380260c2478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:38.999049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 706/1396] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:39.045054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050b775-452c-4c93-9d80-ef02a2d1ef5f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:39.061722 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050b775-452c-4c93-9d80-ef02a2d1ef5f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:39.068080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6378f45-0f08-44d4-a29e-dbc7e16289af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:39.068727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6378f45-0f08-44d4-a29e-dbc7e16289af service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:39.069013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6378f45-0f08-44d4-a29e-dbc7e16289af service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:39.069290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6378f45-0f08-44d4-a29e-dbc7e16289af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:39.080014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6378f45-0f08-44d4-a29e-dbc7e16289af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:39.081828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6378f45-0f08-44d4-a29e-dbc7e16289af service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:39.092018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 691/1397] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:39.502862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871dd26-0b61-4b86-a485-c9d67d850c20 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:39.503154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871dd26-0b61-4b86-a485-c9d67d850c20 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:39.503438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871dd26-0b61-4b86-a485-c9d67d850c20 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:39.504854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 707/1398] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:39.510464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d09dd1-8e6d-4183-b158-7eda3ab59c1b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:39.510869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d09dd1-8e6d-4183-b158-7eda3ab59c1b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:39.511151 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d09dd1-8e6d-4183-b158-7eda3ab59c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:39.528636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-50d09dd1-8e6d-4183-b158-7eda3ab59c1b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:39.529816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-50d09dd1-8e6d-4183-b158-7eda3ab59c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:39.537815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 692/1399] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:39.600731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cc6a0-b639-4160-b77a-a6d98736474a None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:39.602600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cc6a0-b639-4160-b77a-a6d98736474a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:39.602909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cc6a0-b639-4160-b77a-a6d98736474a None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:39.604518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 708/1400] 10.222.0.36 () {54 vars in 962 bytes} [Tue Jun 21 08:08:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:39.610355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea75c74-f57e-4bc3-8ef7-ec4b55dc3efa None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:39.610797 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea75c74-f57e-4bc3-8ef7-ec4b55dc3efa None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:39.611096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea75c74-f57e-4bc3-8ef7-ec4b55dc3efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:39.659608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9ea75c74-f57e-4bc3-8ef7-ec4b55dc3efa None None] MFA Rules not processed for user `31a233e2fc784b01a3a8a24599f3c1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:39.660811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9ea75c74-f57e-4bc3-8ef7-ec4b55dc3efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:39.722703 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 693/1401] 10.222.0.36 () {58 vars in 1059 bytes} [Tue Jun 21 08:08:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:39.730120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cc6a0-b639-4160-b77a-a6d98736474a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:39.741292 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cc6a0-b639-4160-b77a-a6d98736474a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:39.744794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac97bcb-6047-483b-a4df-46d277f8dc8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31a233e2fc784b01a3a8a24599f3c1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:39.745428 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac97bcb-6047-483b-a4df-46d277f8dc8e service glance] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:39.745712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac97bcb-6047-483b-a4df-46d277f8dc8e service glance] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:39.745990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac97bcb-6047-483b-a4df-46d277f8dc8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:39.756125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac97bcb-6047-483b-a4df-46d277f8dc8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:39.757480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac97bcb-6047-483b-a4df-46d277f8dc8e service glance] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:39.767611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 709/1402] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:40.493216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e47014-8deb-4d8d-9afe-9eefc6d92d6f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:40.493692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e47014-8deb-4d8d-9afe-9eefc6d92d6f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:40.493800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e47014-8deb-4d8d-9afe-9eefc6d92d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:40.545038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-10e47014-8deb-4d8d-9afe-9eefc6d92d6f None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:40.546223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-10e47014-8deb-4d8d-9afe-9eefc6d92d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:40.587247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:40.612317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 694/1403] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:08:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:40.657139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781017-d1d8-47e6-a36e-d6dc8ed38c05 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:40.657602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781017-d1d8-47e6-a36e-d6dc8ed38c05 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:40.657820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781017-d1d8-47e6-a36e-d6dc8ed38c05 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:40.659401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 710/1404] 10.222.0.36 () {54 vars in 942 bytes} [Tue Jun 21 08:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:40.666253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed022fff-5e1d-468e-8a00-42f5c04834e1 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:40.666596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed022fff-5e1d-468e-8a00-42f5c04834e1 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:40.666855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed022fff-5e1d-468e-8a00-42f5c04834e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:40.715749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ed022fff-5e1d-468e-8a00-42f5c04834e1 None None] MFA Rules not processed for user `a0c29a6bfcf44b47ae368f47fdd04643`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:40.716943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ed022fff-5e1d-468e-8a00-42f5c04834e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:40.788420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 695/1405] 10.222.0.36 () {58 vars in 1039 bytes} [Tue Jun 21 08:08:40 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:40.798069 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1781017-d1d8-47e6-a36e-d6dc8ed38c05 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:40.805718 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=61 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:40.813500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1781017-d1d8-47e6-a36e-d6dc8ed38c05 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:40.818396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9c743-c746-4e82-977b-abd317d46c52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:40.819062 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9c743-c746-4e82-977b-abd317d46c52 service swift] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:40.819345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9c743-c746-4e82-977b-abd317d46c52 service swift] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:40.819616 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9c743-c746-4e82-977b-abd317d46c52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:40.828845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9c743-c746-4e82-977b-abd317d46c52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:40.830358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9c743-c746-4e82-977b-abd317d46c52 service swift] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:40.838570 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 711/1406] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:08:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:08:41.169993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f045269-101b-41d3-95d3-26bd3cab8ecf None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:41.170247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f045269-101b-41d3-95d3-26bd3cab8ecf None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:41.170471 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f045269-101b-41d3-95d3-26bd3cab8ecf None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:41.171918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 696/1407] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:08:41.177126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff9d0c-8aae-46d2-be0a-78974d1c3a19 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:41.179407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff9d0c-8aae-46d2-be0a-78974d1c3a19 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:41.179712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff9d0c-8aae-46d2-be0a-78974d1c3a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:41.199121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-62ff9d0c-8aae-46d2-be0a-78974d1c3a19 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:08:41.200332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-62ff9d0c-8aae-46d2-be0a-78974d1c3a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:08:41.208770 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 712/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:08:41.254020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f045269-101b-41d3-95d3-26bd3cab8ecf None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:08:41.279375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f045269-101b-41d3-95d3-26bd3cab8ecf None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:08:41.286392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225ed2c-7d3b-4b44-8264-85a8288bd002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:08:41.287145 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225ed2c-7d3b-4b44-8264-85a8288bd002 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:08:41.287500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225ed2c-7d3b-4b44-8264-85a8288bd002 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:08:41.287848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225ed2c-7d3b-4b44-8264-85a8288bd002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:08:41.297472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225ed2c-7d3b-4b44-8264-85a8288bd002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:08:41.299346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225ed2c-7d3b-4b44-8264-85a8288bd002 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:08:41.314332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 697/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:08:51.193870 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=8 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:08:51.309411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=59 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:09:03.447352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3034-ab09-40f2-9a75-dbd84be64a30 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:03.447875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3034-ab09-40f2-9a75-dbd84be64a30 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:03.447998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3034-ab09-40f2-9a75-dbd84be64a30 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:03.449294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 713/1410] 10.222.0.36 () {54 vars in 918 bytes} [Tue Jun 21 08:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:03.454469 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a66ac-a428-40c3-a482-8e46f0b79f53 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:03.454951 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a66ac-a428-40c3-a482-8e46f0b79f53 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:03.455054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a66ac-a428-40c3-a482-8e46f0b79f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:03.473697 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4a7a66ac-a428-40c3-a482-8e46f0b79f53 None None] MFA Rules not processed for user `53dfc3572d05469ca7e2de1acea3629a`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:03.474918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4a7a66ac-a428-40c3-a482-8e46f0b79f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:03.483190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 698/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jun 21 08:09:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:03.497868 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677c205-baed-4b1b-9387-5b1d631c854a None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:03.498162 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677c205-baed-4b1b-9387-5b1d631c854a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:03.498447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677c205-baed-4b1b-9387-5b1d631c854a None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:03.500420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 714/1412] 10.222.0.36 () {54 vars in 918 bytes} [Tue Jun 21 08:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:03.504763 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765e77e-33ca-4d18-85b4-c69ef6ac515f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:03.505048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765e77e-33ca-4d18-85b4-c69ef6ac515f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:03.505321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765e77e-33ca-4d18-85b4-c69ef6ac515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:03.522776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6765e77e-33ca-4d18-85b4-c69ef6ac515f None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:03.523998 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6765e77e-33ca-4d18-85b4-c69ef6ac515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:03.534410 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 699/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jun 21 08:09:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:09:06.048529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9b2c1-08a3-4b68-8869-a60e346e8053 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:06.049085 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9b2c1-08a3-4b68-8869-a60e346e8053 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:06.049198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9b2c1-08a3-4b68-8869-a60e346e8053 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:06.050526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:09:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:06.055617 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5682fe-3ff6-4eae-9504-ad6d2d226839 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:06.056046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5682fe-3ff6-4eae-9504-ad6d2d226839 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:06.056201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5682fe-3ff6-4eae-9504-ad6d2d226839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:06.073636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6f5682fe-3ff6-4eae-9504-ad6d2d226839 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:06.074850 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6f5682fe-3ff6-4eae-9504-ad6d2d226839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:06.082627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:06.126221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9b2c1-08a3-4b68-8869-a60e346e8053 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:06.139994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9b2c1-08a3-4b68-8869-a60e346e8053 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:06.145402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91d2bb-520b-4547-aca4-bca7ffd6c589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:06.146021 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91d2bb-520b-4547-aca4-bca7ffd6c589 service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:06.146302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91d2bb-520b-4547-aca4-bca7ffd6c589 service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:06.146575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91d2bb-520b-4547-aca4-bca7ffd6c589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:06.156912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91d2bb-520b-4547-aca4-bca7ffd6c589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:06.158488 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91d2bb-520b-4547-aca4-bca7ffd6c589 service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:06.167836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 716/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:07.101260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ab8ad-4dda-4b20-9a3f-876a957edeae None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:07.101847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ab8ad-4dda-4b20-9a3f-876a957edeae None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:07.101847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ab8ad-4dda-4b20-9a3f-876a957edeae None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:07.103215 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 08:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:07.108113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e009f5-4c9d-48f8-81da-b03df23862c1 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:07.108539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e009f5-4c9d-48f8-81da-b03df23862c1 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:07.108671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e009f5-4c9d-48f8-81da-b03df23862c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:07.128552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-c9e009f5-4c9d-48f8-81da-b03df23862c1 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:07.129739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c9e009f5-4c9d-48f8-81da-b03df23862c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:07.137401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 08:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:07.295481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ab8ad-4dda-4b20-9a3f-876a957edeae None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:07.310678 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ab8ad-4dda-4b20-9a3f-876a957edeae None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:07.316519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501df757-e28e-40c1-90c0-b7441130cc97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:07.317146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501df757-e28e-40c1-90c0-b7441130cc97 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:07.317429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501df757-e28e-40c1-90c0-b7441130cc97 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:07.317713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501df757-e28e-40c1-90c0-b7441130cc97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:07.325647 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501df757-e28e-40c1-90c0-b7441130cc97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:07.327271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501df757-e28e-40c1-90c0-b7441130cc97 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:07.336939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 702/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:08.235396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604a3f5-ae02-485d-b1d3-ed029bcee12b None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:08.236239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604a3f5-ae02-485d-b1d3-ed029bcee12b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:08.236414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604a3f5-ae02-485d-b1d3-ed029bcee12b None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:08.237824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 08:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:08.243008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a360337-e7eb-47cb-9d81-b1730b8e270f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:08.243459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a360337-e7eb-47cb-9d81-b1730b8e270f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:08.243562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a360337-e7eb-47cb-9d81-b1730b8e270f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:08.262001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8a360337-e7eb-47cb-9d81-b1730b8e270f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:08.263243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8a360337-e7eb-47cb-9d81-b1730b8e270f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:08.272042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 08:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:08.423027 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604a3f5-ae02-485d-b1d3-ed029bcee12b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:08.436861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604a3f5-ae02-485d-b1d3-ed029bcee12b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:08.442670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4cdad-1011-4380-aebc-4ac29641f9d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:08.443244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4cdad-1011-4380-aebc-4ac29641f9d9 service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:08.443524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4cdad-1011-4380-aebc-4ac29641f9d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:08.443797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4cdad-1011-4380-aebc-4ac29641f9d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:08.451766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4cdad-1011-4380-aebc-4ac29641f9d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:08.453484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4cdad-1011-4380-aebc-4ac29641f9d9 service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:08.462672 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 719/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:09.326734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3865d-445b-4cce-9c36-e9ecb0ddc777 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:09.327309 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3865d-445b-4cce-9c36-e9ecb0ddc777 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:09.327309 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3865d-445b-4cce-9c36-e9ecb0ddc777 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:09.328825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 08:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:09.333749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcca8b-0338-4e66-8c93-c80a36cf0453 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:09.334132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcca8b-0338-4e66-8c93-c80a36cf0453 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:09.334313 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcca8b-0338-4e66-8c93-c80a36cf0453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:09.352892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-60fcca8b-0338-4e66-8c93-c80a36cf0453 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:09.354096 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-60fcca8b-0338-4e66-8c93-c80a36cf0453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:09.362668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 08:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:09.513608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3865d-445b-4cce-9c36-e9ecb0ddc777 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:09.528660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3865d-445b-4cce-9c36-e9ecb0ddc777 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:09.535031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311927c-5624-441f-af13-7a1986bd659d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:09.535664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311927c-5624-441f-af13-7a1986bd659d service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:09.535948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311927c-5624-441f-af13-7a1986bd659d service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:09.536226 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311927c-5624-441f-af13-7a1986bd659d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:09.544280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311927c-5624-441f-af13-7a1986bd659d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:09.545860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311927c-5624-441f-af13-7a1986bd659d service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:09.556805 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 705/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:10.439029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b772d-abdf-4fc8-a712-3a1f92ae4d3e None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:10.439605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b772d-abdf-4fc8-a712-3a1f92ae4d3e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:10.439605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b772d-abdf-4fc8-a712-3a1f92ae4d3e None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:10.440963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 08:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:10.446085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a839f-0f7f-47a6-84e5-06ceceef2fe3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:10.446610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a839f-0f7f-47a6-84e5-06ceceef2fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:10.446742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a839f-0f7f-47a6-84e5-06ceceef2fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:10.465162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-208a839f-0f7f-47a6-84e5-06ceceef2fe3 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:10.466347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-208a839f-0f7f-47a6-84e5-06ceceef2fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:10.474895 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 08:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:10.627744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b772d-abdf-4fc8-a712-3a1f92ae4d3e None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:10.642072 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b772d-abdf-4fc8-a712-3a1f92ae4d3e None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:10.647274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49abe2-28ae-42f6-bd20-5ae3fd8e91e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:10.647895 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49abe2-28ae-42f6-bd20-5ae3fd8e91e7 service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:10.648173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49abe2-28ae-42f6-bd20-5ae3fd8e91e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:10.648443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49abe2-28ae-42f6-bd20-5ae3fd8e91e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:10.658746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49abe2-28ae-42f6-bd20-5ae3fd8e91e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:10.660383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49abe2-28ae-42f6-bd20-5ae3fd8e91e7 service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:10.670413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 722/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:11.482551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14bd18-8495-40d3-bb66-c45ed156c4ac None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:11.485069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14bd18-8495-40d3-bb66-c45ed156c4ac None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:11.485069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14bd18-8495-40d3-bb66-c45ed156c4ac None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:11.485269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 08:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:11.490368 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e93f67-c5cd-4d57-affe-99db36ef52c1 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:11.490804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e93f67-c5cd-4d57-affe-99db36ef52c1 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:11.490995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e93f67-c5cd-4d57-affe-99db36ef52c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:11.509567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-b0e93f67-c5cd-4d57-affe-99db36ef52c1 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:11.510797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b0e93f67-c5cd-4d57-affe-99db36ef52c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:11.518495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 08:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:11.667766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14bd18-8495-40d3-bb66-c45ed156c4ac None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:11.683595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14bd18-8495-40d3-bb66-c45ed156c4ac None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:11.689626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e690bd-2cc5-4c97-b026-7771a927dafd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:11.690267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e690bd-2cc5-4c97-b026-7771a927dafd service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:11.690551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e690bd-2cc5-4c97-b026-7771a927dafd service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:11.690856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e690bd-2cc5-4c97-b026-7771a927dafd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:11.699074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e690bd-2cc5-4c97-b026-7771a927dafd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:11.701076 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e690bd-2cc5-4c97-b026-7771a927dafd service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:11.710927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 708/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:12.534155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbe019-56e7-47b5-9671-ea5b360af6e4 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:12.534871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbe019-56e7-47b5-9671-ea5b360af6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:12.534871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbe019-56e7-47b5-9671-ea5b360af6e4 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:12.536093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 08:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:12.541040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ec196-4e33-4436-b4e5-6b42041733a7 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:12.541488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ec196-4e33-4436-b4e5-6b42041733a7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:12.541631 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ec196-4e33-4436-b4e5-6b42041733a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:12.559952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-653ec196-4e33-4436-b4e5-6b42041733a7 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:12.561188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-653ec196-4e33-4436-b4e5-6b42041733a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:12.569340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 08:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:12.720226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbe019-56e7-47b5-9671-ea5b360af6e4 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:12.735078 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbe019-56e7-47b5-9671-ea5b360af6e4 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:12.743500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfb605-3a12-4810-8657-cd9e4171270c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:12.744649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfb605-3a12-4810-8657-cd9e4171270c service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:12.744649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfb605-3a12-4810-8657-cd9e4171270c service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:12.744649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfb605-3a12-4810-8657-cd9e4171270c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:12.753216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfb605-3a12-4810-8657-cd9e4171270c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:12.754845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfb605-3a12-4810-8657-cd9e4171270c service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:12.764167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 725/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:13.559189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75c06-bdbd-467a-9442-c1b76bcc0563 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:13.559790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75c06-bdbd-467a-9442-c1b76bcc0563 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:13.559790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c75c06-bdbd-467a-9442-c1b76bcc0563 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:13.561153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 08:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:13.568191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60a7b-dbb6-4bf7-af00-c0af04cd31a9 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:13.568825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60a7b-dbb6-4bf7-af00-c0af04cd31a9 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:13.568825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60a7b-dbb6-4bf7-af00-c0af04cd31a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:13.588195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-6bc60a7b-dbb6-4bf7-af00-c0af04cd31a9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:13.589377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6bc60a7b-dbb6-4bf7-af00-c0af04cd31a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:13.598271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 08:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:13.752407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c75c06-bdbd-467a-9442-c1b76bcc0563 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:13.767302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c75c06-bdbd-467a-9442-c1b76bcc0563 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:13.772687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd099b2b-1028-4fdb-a8a1-8b7732526cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:13.773320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd099b2b-1028-4fdb-a8a1-8b7732526cce service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:13.773601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd099b2b-1028-4fdb-a8a1-8b7732526cce service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:13.773880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd099b2b-1028-4fdb-a8a1-8b7732526cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:13.782583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd099b2b-1028-4fdb-a8a1-8b7732526cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:13.785284 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd099b2b-1028-4fdb-a8a1-8b7732526cce service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:13.795669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 711/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:14.599114 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87fe70-fd80-4315-b059-7e58ddc35931 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:14.599614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87fe70-fd80-4315-b059-7e58ddc35931 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:14.599719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87fe70-fd80-4315-b059-7e58ddc35931 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:14.601061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 08:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:14.606056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd8744-d1b1-4696-bb6d-63a4dd8a5ccf None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:14.606506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd8744-d1b1-4696-bb6d-63a4dd8a5ccf None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:14.606634 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd8744-d1b1-4696-bb6d-63a4dd8a5ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:14.626513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-89cd8744-d1b1-4696-bb6d-63a4dd8a5ccf None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:14.628630 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-89cd8744-d1b1-4696-bb6d-63a4dd8a5ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:14.638098 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 08:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:14.788986 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87fe70-fd80-4315-b059-7e58ddc35931 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:14.803555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87fe70-fd80-4315-b059-7e58ddc35931 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:14.808826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36b155-3ee9-43d0-9f21-d6d8a1de985e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:14.809449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b155-3ee9-43d0-9f21-d6d8a1de985e service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:14.809732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b155-3ee9-43d0-9f21-d6d8a1de985e service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:14.810008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b155-3ee9-43d0-9f21-d6d8a1de985e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:14.818715 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36b155-3ee9-43d0-9f21-d6d8a1de985e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:14.820340 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36b155-3ee9-43d0-9f21-d6d8a1de985e service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:14.833732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 728/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:16.777983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc5a3b-5eb9-4750-9d9a-8083089323a8 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:16.778549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc5a3b-5eb9-4750-9d9a-8083089323a8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:16.778549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc5a3b-5eb9-4750-9d9a-8083089323a8 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:16.780044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:16.785984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ea2d3-0e33-4ab3-bc54-1a66f404f2f3 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:16.786393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ea2d3-0e33-4ab3-bc54-1a66f404f2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:16.786538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ea2d3-0e33-4ab3-bc54-1a66f404f2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:16.804046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-2b8ea2d3-0e33-4ab3-bc54-1a66f404f2f3 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:16.805221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2b8ea2d3-0e33-4ab3-bc54-1a66f404f2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:16.812879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:16.851074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc5a3b-5eb9-4750-9d9a-8083089323a8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:16.861560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc5a3b-5eb9-4750-9d9a-8083089323a8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:16.865277 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78101f41-d43a-40bb-a4b0-4b7c9d3ef3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:16.865903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78101f41-d43a-40bb-a4b0-4b7c9d3ef3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:16.866188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78101f41-d43a-40bb-a4b0-4b7c9d3ef3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:16.866456 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78101f41-d43a-40bb-a4b0-4b7c9d3ef3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:16.875139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78101f41-d43a-40bb-a4b0-4b7c9d3ef3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:16.876555 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78101f41-d43a-40bb-a4b0-4b7c9d3ef3f8 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:16.885674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 714/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:19.085499 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c143c84-a4bc-4727-8d58-47a5c834ba2e None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:19.086042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c143c84-a4bc-4727-8d58-47a5c834ba2e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:19.086042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c143c84-a4bc-4727-8d58-47a5c834ba2e None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:19.087482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:19.092712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e58a2-3670-4964-b8c4-523fe055d095 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:19.093126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e58a2-3670-4964-b8c4-523fe055d095 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:19.093403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e58a2-3670-4964-b8c4-523fe055d095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:19.111277 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-834e58a2-3670-4964-b8c4-523fe055d095 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:19.112462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-834e58a2-3670-4964-b8c4-523fe055d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:19.120358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:19.158052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c143c84-a4bc-4727-8d58-47a5c834ba2e None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:19.168784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c143c84-a4bc-4727-8d58-47a5c834ba2e None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:19.173267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32dc08-a12d-4f66-b127-519ae7de895f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:19.173891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32dc08-a12d-4f66-b127-519ae7de895f service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:19.174173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32dc08-a12d-4f66-b127-519ae7de895f service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:19.174445 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32dc08-a12d-4f66-b127-519ae7de895f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:19.183232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32dc08-a12d-4f66-b127-519ae7de895f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:19.184661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32dc08-a12d-4f66-b127-519ae7de895f service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:19.194990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 731/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:21.524782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ce071-656c-4a7e-b2c8-098eefb00426 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:21.525323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ce071-656c-4a7e-b2c8-098eefb00426 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:21.525323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ce071-656c-4a7e-b2c8-098eefb00426 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:21.526732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:21.532827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493701-f19e-47d8-b25b-72d5dbaffa43 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:21.533268 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493701-f19e-47d8-b25b-72d5dbaffa43 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:21.533388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493701-f19e-47d8-b25b-72d5dbaffa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:21.551191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-91493701-f19e-47d8-b25b-72d5dbaffa43 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:21.552391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-91493701-f19e-47d8-b25b-72d5dbaffa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:21.560110 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:21.608769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ce071-656c-4a7e-b2c8-098eefb00426 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:21.624082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ce071-656c-4a7e-b2c8-098eefb00426 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:21.628264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55496bb-7b4c-4b07-b7a4-108b7ab18331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:21.628901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55496bb-7b4c-4b07-b7a4-108b7ab18331 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:21.629178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55496bb-7b4c-4b07-b7a4-108b7ab18331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:21.629449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55496bb-7b4c-4b07-b7a4-108b7ab18331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:21.638713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55496bb-7b4c-4b07-b7a4-108b7ab18331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:21.640181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55496bb-7b4c-4b07-b7a4-108b7ab18331 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:21.649433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 717/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:23.932200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d77da-2dd1-44e3-bb2b-e79461197b8c None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:23.932726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d77da-2dd1-44e3-bb2b-e79461197b8c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:23.932726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d77da-2dd1-44e3-bb2b-e79461197b8c None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:23.934046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:23.940114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529327f6-3e83-47dd-930b-0fc473da2ccc None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:23.940544 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529327f6-3e83-47dd-930b-0fc473da2ccc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:23.940681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529327f6-3e83-47dd-930b-0fc473da2ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:23.960036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-529327f6-3e83-47dd-930b-0fc473da2ccc None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:23.961262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-529327f6-3e83-47dd-930b-0fc473da2ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:23.969117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:24.008317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d77da-2dd1-44e3-bb2b-e79461197b8c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:24.019630 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d77da-2dd1-44e3-bb2b-e79461197b8c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:24.023183 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97661d76-ad7c-4659-b0c7-5d809217602d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:24.023816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97661d76-ad7c-4659-b0c7-5d809217602d service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:24.024103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97661d76-ad7c-4659-b0c7-5d809217602d service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:24.024378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97661d76-ad7c-4659-b0c7-5d809217602d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:24.033484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97661d76-ad7c-4659-b0c7-5d809217602d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:24.034955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97661d76-ad7c-4659-b0c7-5d809217602d service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:24.044291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 734/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:26.322468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf5e22-ad60-4d77-bed1-a0ee37975fef None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:26.323077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf5e22-ad60-4d77-bed1-a0ee37975fef None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:26.323077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf5e22-ad60-4d77-bed1-a0ee37975fef None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:26.324433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:26.330328 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87a612-b91c-4c8d-92d0-0fed73d9187e None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:26.330779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87a612-b91c-4c8d-92d0-0fed73d9187e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:26.330971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87a612-b91c-4c8d-92d0-0fed73d9187e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:26.348965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-fc87a612-b91c-4c8d-92d0-0fed73d9187e None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:26.350188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-fc87a612-b91c-4c8d-92d0-0fed73d9187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:26.357919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:26.395837 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf5e22-ad60-4d77-bed1-a0ee37975fef None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:26.406952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf5e22-ad60-4d77-bed1-a0ee37975fef None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:26.410564 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a5392-ffbc-41e5-97d9-688733a263b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:26.411240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a5392-ffbc-41e5-97d9-688733a263b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:26.411521 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a5392-ffbc-41e5-97d9-688733a263b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:26.411794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a5392-ffbc-41e5-97d9-688733a263b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:26.421117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a5392-ffbc-41e5-97d9-688733a263b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:26.423381 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a5392-ffbc-41e5-97d9-688733a263b4 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:26.432806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 720/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:28.519229 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bff00a-78a0-4933-917c-8e81adcc167b None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:28.519809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bff00a-78a0-4933-917c-8e81adcc167b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:28.519809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bff00a-78a0-4933-917c-8e81adcc167b None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:28.521140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:28.526345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9dce2-8d31-4685-8bdc-5940d70d62f8 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:28.526807 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9dce2-8d31-4685-8bdc-5940d70d62f8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:28.526923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9dce2-8d31-4685-8bdc-5940d70d62f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:28.544747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e0c9dce2-8d31-4685-8bdc-5940d70d62f8 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:28.545942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e0c9dce2-8d31-4685-8bdc-5940d70d62f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:28.554272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:28.591623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bff00a-78a0-4933-917c-8e81adcc167b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:28.602993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bff00a-78a0-4933-917c-8e81adcc167b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:28.606539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4bd5e-7000-46fc-8334-b6f78ee04a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:28.607191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4bd5e-7000-46fc-8334-b6f78ee04a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:28.607475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4bd5e-7000-46fc-8334-b6f78ee04a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:28.607768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4bd5e-7000-46fc-8334-b6f78ee04a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:28.617535 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4bd5e-7000-46fc-8334-b6f78ee04a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:28.619008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4bd5e-7000-46fc-8334-b6f78ee04a76 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:28.628539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 737/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:30.766279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76350a5c-2f99-4361-a842-c0a2a3e9e479 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:30.766880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76350a5c-2f99-4361-a842-c0a2a3e9e479 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:30.766880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76350a5c-2f99-4361-a842-c0a2a3e9e479 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:30.768307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:30.773393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e071ec-8871-4013-8192-5889f8e1723d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:30.773772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e071ec-8871-4013-8192-5889f8e1723d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:30.773945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e071ec-8871-4013-8192-5889f8e1723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:30.791420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-a1e071ec-8871-4013-8192-5889f8e1723d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:30.792602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-a1e071ec-8871-4013-8192-5889f8e1723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:30.800495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:30.837891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76350a5c-2f99-4361-a842-c0a2a3e9e479 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:30.848950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76350a5c-2f99-4361-a842-c0a2a3e9e479 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:30.852458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571a19f-f4cc-4e04-8722-4367fccd9a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:30.853083 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571a19f-f4cc-4e04-8722-4367fccd9a0f service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:30.853365 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571a19f-f4cc-4e04-8722-4367fccd9a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:30.853640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571a19f-f4cc-4e04-8722-4367fccd9a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:30.862907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571a19f-f4cc-4e04-8722-4367fccd9a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:30.864595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571a19f-f4cc-4e04-8722-4367fccd9a0f service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:30.873793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 723/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:32.987997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a99bb5-daf9-4b15-86f4-8557a290c514 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:32.988553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a99bb5-daf9-4b15-86f4-8557a290c514 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:32.988553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a99bb5-daf9-4b15-86f4-8557a290c514 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:32.990159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:32.995398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987118-6337-4e6f-b774-5ffe47c8a692 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:32.995810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987118-6337-4e6f-b774-5ffe47c8a692 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:32.995955 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987118-6337-4e6f-b774-5ffe47c8a692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:33.003399 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=79 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:09:33.016663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-99987118-6337-4e6f-b774-5ffe47c8a692 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:33.017943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-99987118-6337-4e6f-b774-5ffe47c8a692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:33.025816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:33.063622 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a99bb5-daf9-4b15-86f4-8557a290c514 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:33.068981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=73 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:09:33.075353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a99bb5-daf9-4b15-86f4-8557a290c514 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:33.079695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5496539-6943-46e7-ac99-187e1bb98162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:33.080330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5496539-6943-46e7-ac99-187e1bb98162 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:33.080615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5496539-6943-46e7-ac99-187e1bb98162 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:33.080895 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5496539-6943-46e7-ac99-187e1bb98162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:33.089798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5496539-6943-46e7-ac99-187e1bb98162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:33.091278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5496539-6943-46e7-ac99-187e1bb98162 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:33.100739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 740/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:35.222310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d7b9e-57dd-4c1a-b8ee-0f3df0528e10 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:35.222909 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d7b9e-57dd-4c1a-b8ee-0f3df0528e10 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:35.223042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d7b9e-57dd-4c1a-b8ee-0f3df0528e10 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:35.224368 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:35.229508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487fed4-ad9a-4912-b974-9dc75bcd4d3d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:35.229935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487fed4-ad9a-4912-b974-9dc75bcd4d3d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:35.230073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487fed4-ad9a-4912-b974-9dc75bcd4d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:35.248011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e487fed4-ad9a-4912-b974-9dc75bcd4d3d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:35.249205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e487fed4-ad9a-4912-b974-9dc75bcd4d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:35.257516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:35.293938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d7b9e-57dd-4c1a-b8ee-0f3df0528e10 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:35.304804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d7b9e-57dd-4c1a-b8ee-0f3df0528e10 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:35.308556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed641d1-fe77-42a6-9ff1-b83215c0ea87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:35.309193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed641d1-fe77-42a6-9ff1-b83215c0ea87 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:35.309477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed641d1-fe77-42a6-9ff1-b83215c0ea87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:35.309751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed641d1-fe77-42a6-9ff1-b83215c0ea87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:35.319440 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed641d1-fe77-42a6-9ff1-b83215c0ea87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:35.320862 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed641d1-fe77-42a6-9ff1-b83215c0ea87 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:35.330862 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 726/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:09:37.402573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30ea29-79c8-42a4-a039-546531e98561 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:37.403174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30ea29-79c8-42a4-a039-546531e98561 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:37.403174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30ea29-79c8-42a4-a039-546531e98561 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:37.404595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:09:37.415431 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8efbfd-9b3a-4497-9cbe-ea52205dbb26 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:37.415899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8efbfd-9b3a-4497-9cbe-ea52205dbb26 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:37.415997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8efbfd-9b3a-4497-9cbe-ea52205dbb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:37.433947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5d8efbfd-9b3a-4497-9cbe-ea52205dbb26 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:37.435158 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5d8efbfd-9b3a-4497-9cbe-ea52205dbb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:37.443030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:37.478790 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30ea29-79c8-42a4-a039-546531e98561 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:37.490674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30ea29-79c8-42a4-a039-546531e98561 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:37.494206 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5098664-b4a2-459f-890e-6902c5a65bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:37.494865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5098664-b4a2-459f-890e-6902c5a65bdd service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:37.495150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5098664-b4a2-459f-890e-6902c5a65bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:37.495429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5098664-b4a2-459f-890e-6902c5a65bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:37.504277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5098664-b4a2-459f-890e-6902c5a65bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:37.505689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5098664-b4a2-459f-890e-6902c5a65bdd service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:37.515084 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 743/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:09:47.428902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=11 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:09:47.510849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=14 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:09:57.501960 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a95ad-e192-46f0-85c1-ad25a0c22568 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:57.502557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a95ad-e192-46f0-85c1-ad25a0c22568 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:57.502557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a95ad-e192-46f0-85c1-ad25a0c22568 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:57.503904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 728/1471] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:57.509235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7156f-5949-4bf4-8b96-e189db632b6c None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:57.509619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7156f-5949-4bf4-8b96-e189db632b6c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:57.509786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7156f-5949-4bf4-8b96-e189db632b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:57.527197 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-21a7156f-5949-4bf4-8b96-e189db632b6c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:57.528379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-21a7156f-5949-4bf4-8b96-e189db632b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:57.536686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 744/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:57.583857 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bec16-161d-4fd9-b0c2-7cf928232429 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:57.584151 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bec16-161d-4fd9-b0c2-7cf928232429 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:57.584432 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bec16-161d-4fd9-b0c2-7cf928232429 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:57.585798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 729/1473] 10.222.0.36 () {54 vars in 962 bytes} [Tue Jun 21 08:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:57.590474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dbfec-c4f5-4378-9bbf-05d587fc04a2 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:57.590794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dbfec-c4f5-4378-9bbf-05d587fc04a2 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:57.591088 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dbfec-c4f5-4378-9bbf-05d587fc04a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:57.609856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-829dbfec-c4f5-4378-9bbf-05d587fc04a2 None None] MFA Rules not processed for user `31a233e2fc784b01a3a8a24599f3c1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:57.611067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-829dbfec-c4f5-4378-9bbf-05d587fc04a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:57.617665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 745/1474] 10.222.0.36 () {58 vars in 1059 bytes} [Tue Jun 21 08:09:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:57.625445 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bec16-161d-4fd9-b0c2-7cf928232429 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:57.635835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bec16-161d-4fd9-b0c2-7cf928232429 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:57.639388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a9a5b-9125-4cb0-940d-70fbdd3e8535 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31a233e2fc784b01a3a8a24599f3c1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:57.640341 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a9a5b-9125-4cb0-940d-70fbdd3e8535 service glance] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:57.640732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a9a5b-9125-4cb0-940d-70fbdd3e8535 service glance] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:57.641013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a9a5b-9125-4cb0-940d-70fbdd3e8535 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:57.650082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a9a5b-9125-4cb0-940d-70fbdd3e8535 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:57.651553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a9a5b-9125-4cb0-940d-70fbdd3e8535 service glance] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:57.661709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 730/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:09:59.809922 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3536a-3206-407d-92bd-dac1839aed73 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:59.810474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3536a-3206-407d-92bd-dac1839aed73 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:59.810474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3536a-3206-407d-92bd-dac1839aed73 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:59.811912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 746/1476] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:09:59.819095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bd1a0-961b-44b9-a85c-a61ba00c13d6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:59.819510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bd1a0-961b-44b9-a85c-a61ba00c13d6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:59.819665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bd1a0-961b-44b9-a85c-a61ba00c13d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:59.838055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-464bd1a0-961b-44b9-a85c-a61ba00c13d6 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:09:59.839221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-464bd1a0-961b-44b9-a85c-a61ba00c13d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:09:59.847738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 731/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:09:59.871847 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3536a-3206-407d-92bd-dac1839aed73 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:09:59.884202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3536a-3206-407d-92bd-dac1839aed73 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:09:59.888580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc1b4e-8939-421f-81c8-071d33b305fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:09:59.889211 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc1b4e-8939-421f-81c8-071d33b305fe admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:09:59.889494 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc1b4e-8939-421f-81c8-071d33b305fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:09:59.889772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc1b4e-8939-421f-81c8-071d33b305fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:09:59.890770 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc1b4e-8939-421f-81c8-071d33b305fe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:09:59.892527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: WARNING py.warnings [None req-62fc1b4e-8939-421f-81c8-071d33b305fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:09:59.892527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: warnings.warn(msg) Jun 21 08:09:59.892527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: Jun 21 08:09:59.893660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc1b4e-8939-421f-81c8-071d33b305fe admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:09:59.913383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 747/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 08:09:59 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:10:01.988606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5508578-0d9e-4fc5-b95b-7156be20e329 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:01.989182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5508578-0d9e-4fc5-b95b-7156be20e329 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:01.989182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5508578-0d9e-4fc5-b95b-7156be20e329 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:01.990814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 732/1479] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:10:01.995949 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1740fdb-3bee-4362-a5db-a012219f9b18 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:01.996374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1740fdb-3bee-4362-a5db-a012219f9b18 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:01.996516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1740fdb-3bee-4362-a5db-a012219f9b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:02.014950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f1740fdb-3bee-4362-a5db-a012219f9b18 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:10:02.016236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f1740fdb-3bee-4362-a5db-a012219f9b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:10:02.023972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 748/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:10:02.066926 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5508578-0d9e-4fc5-b95b-7156be20e329 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:10:02.081743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5508578-0d9e-4fc5-b95b-7156be20e329 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:10:02.087063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632fb24-160d-4657-8a16-799f3ed8dcb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:10:02.087693 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632fb24-160d-4657-8a16-799f3ed8dcb1 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:02.087980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632fb24-160d-4657-8a16-799f3ed8dcb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:02.088256 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632fb24-160d-4657-8a16-799f3ed8dcb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:02.096817 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632fb24-160d-4657-8a16-799f3ed8dcb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:10:02.098400 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632fb24-160d-4657-8a16-799f3ed8dcb1 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:10:02.107712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 733/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:10:04.333681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b03c59-f992-4465-9be4-407f2b57a539 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:04.334239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b03c59-f992-4465-9be4-407f2b57a539 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:04.334239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b03c59-f992-4465-9be4-407f2b57a539 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:04.335620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 749/1482] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:10:04.340748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467233b-2fe1-4ca9-be7e-8cb567687a83 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:04.341181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467233b-2fe1-4ca9-be7e-8cb567687a83 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:04.341347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467233b-2fe1-4ca9-be7e-8cb567687a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:04.358913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2467233b-2fe1-4ca9-be7e-8cb567687a83 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:10:04.360099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2467233b-2fe1-4ca9-be7e-8cb567687a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:10:04.368565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 734/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:10:04.405567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b03c59-f992-4465-9be4-407f2b57a539 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:10:04.416265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b03c59-f992-4465-9be4-407f2b57a539 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:10:04.419756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e51ea-664c-45f6-968d-b1bd0fa7bf8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:10:04.420386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e51ea-664c-45f6-968d-b1bd0fa7bf8f service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:04.420670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e51ea-664c-45f6-968d-b1bd0fa7bf8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:04.420948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e51ea-664c-45f6-968d-b1bd0fa7bf8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:04.429967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e51ea-664c-45f6-968d-b1bd0fa7bf8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:10:04.431458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e51ea-664c-45f6-968d-b1bd0fa7bf8f service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:10:04.441604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 750/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:10:06.551846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79252a17-5d3a-46e1-a316-7d89e49dc597 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:06.552392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79252a17-5d3a-46e1-a316-7d89e49dc597 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:06.552392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79252a17-5d3a-46e1-a316-7d89e49dc597 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:06.553789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 735/1485] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:10:06.558931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4deee5-40f2-4d37-b244-acf17b4a8c57 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:06.559321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4deee5-40f2-4d37-b244-acf17b4a8c57 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:06.559492 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4deee5-40f2-4d37-b244-acf17b4a8c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:06.579882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-5e4deee5-40f2-4d37-b244-acf17b4a8c57 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:10:06.581082 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-5e4deee5-40f2-4d37-b244-acf17b4a8c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:10:06.588931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 751/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:10:06.627295 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79252a17-5d3a-46e1-a316-7d89e49dc597 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:10:06.638531 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79252a17-5d3a-46e1-a316-7d89e49dc597 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:10:06.642809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58600685-825b-444c-905e-63eca743db2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:10:06.643442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58600685-825b-444c-905e-63eca743db2f service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:06.643728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58600685-825b-444c-905e-63eca743db2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:06.644008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58600685-825b-444c-905e-63eca743db2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:06.652811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58600685-825b-444c-905e-63eca743db2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:10:06.654233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58600685-825b-444c-905e-63eca743db2f service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:10:06.663908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 736/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:10:08.881560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21ab0b-709f-438f-943c-75b19d4f31b8 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:08.882092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21ab0b-709f-438f-943c-75b19d4f31b8 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:08.882092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21ab0b-709f-438f-943c-75b19d4f31b8 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:08.883439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 752/1488] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:10:08.888508 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353deca8-fd74-4fdd-b2f2-372ebb5b18d8 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:08.888955 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353deca8-fd74-4fdd-b2f2-372ebb5b18d8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:08.889052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353deca8-fd74-4fdd-b2f2-372ebb5b18d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:08.907501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-353deca8-fd74-4fdd-b2f2-372ebb5b18d8 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:10:08.908923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-353deca8-fd74-4fdd-b2f2-372ebb5b18d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:10:08.916779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 737/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:10:08.957165 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21ab0b-709f-438f-943c-75b19d4f31b8 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:10:08.967693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21ab0b-709f-438f-943c-75b19d4f31b8 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:10:08.971787 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24f2b-fd56-4231-8a24-e541eeaf7f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:10:08.972404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24f2b-fd56-4231-8a24-e541eeaf7f3f service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:08.972682 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24f2b-fd56-4231-8a24-e541eeaf7f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:08.972952 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24f2b-fd56-4231-8a24-e541eeaf7f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:08.981653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24f2b-fd56-4231-8a24-e541eeaf7f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:10:08.983134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24f2b-fd56-4231-8a24-e541eeaf7f3f service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:10:08.993468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 753/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:10:11.274597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b0aa9-4c84-4c89-a13d-0611dbfd3737 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:11.275230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b0aa9-4c84-4c89-a13d-0611dbfd3737 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:11.275230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b0aa9-4c84-4c89-a13d-0611dbfd3737 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:11.276566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 738/1491] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 08:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:10:11.282412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546275f9-b9c7-4332-8588-b38a1dadcea6 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:11.282874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546275f9-b9c7-4332-8588-b38a1dadcea6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:11.283031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546275f9-b9c7-4332-8588-b38a1dadcea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:11.301293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-546275f9-b9c7-4332-8588-b38a1dadcea6 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:10:11.302486 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-546275f9-b9c7-4332-8588-b38a1dadcea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:10:11.310197 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 754/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 08:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:10:11.350005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b0aa9-4c84-4c89-a13d-0611dbfd3737 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:10:11.361685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b0aa9-4c84-4c89-a13d-0611dbfd3737 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:10:11.365372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4e1b4-accb-4cdd-b044-72b0c663f520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:10:11.366301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4e1b4-accb-4cdd-b044-72b0c663f520 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:10:11.366583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4e1b4-accb-4cdd-b044-72b0c663f520 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:10:11.366891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4e1b4-accb-4cdd-b044-72b0c663f520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:10:11.376058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4e1b4-accb-4cdd-b044-72b0c663f520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:10:11.377483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4e1b4-accb-4cdd-b044-72b0c663f520 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:10:11.386798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 739/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:10:21.295672 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=33 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:10:21.382601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=33 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:11:38.181157 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d18adf-648f-4684-887a-5613d24aa59a None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.181794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d18adf-648f-4684-887a-5613d24aa59a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.181794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d18adf-648f-4684-887a-5613d24aa59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.199935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e0d18adf-648f-4684-887a-5613d24aa59a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:11:38.201121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e0d18adf-648f-4684-887a-5613d24aa59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:11:38.209424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 755/1494] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:11:38.219245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d72b7f-2b06-4a34-9f6b-ac727706973d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.219833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d72b7f-2b06-4a34-9f6b-ac727706973d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.219965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d72b7f-2b06-4a34-9f6b-ac727706973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.240793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-08d72b7f-2b06-4a34-9f6b-ac727706973d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:11:38.241977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-08d72b7f-2b06-4a34-9f6b-ac727706973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:11:38.250250 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 740/1495] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:11:38.254766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d18adf-648f-4684-887a-5613d24aa59a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:11:38.264380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d18adf-648f-4684-887a-5613d24aa59a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:11:38.268860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193489de-bc41-4a9d-870a-a645228fc174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:11:38.269505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193489de-bc41-4a9d-870a-a645228fc174 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.269785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193489de-bc41-4a9d-870a-a645228fc174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.270075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193489de-bc41-4a9d-870a-a645228fc174 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.270818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193489de-bc41-4a9d-870a-a645228fc174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:11:38.271122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193489de-bc41-4a9d-870a-a645228fc174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:11:38.272126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: WARNING py.warnings [None req-193489de-bc41-4a9d-870a-a645228fc174 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:11:38.272126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: warnings.warn(msg) Jun 21 08:11:38.272126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: Jun 21 08:11:38.272997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193489de-bc41-4a9d-870a-a645228fc174 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:11:38.285264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 756/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:11:38.293824 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d72b7f-2b06-4a34-9f6b-ac727706973d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:11:38.303889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d72b7f-2b06-4a34-9f6b-ac727706973d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:11:38.308471 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950bc79-cb80-435a-9d77-81a9e0c5a763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:11:38.309115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950bc79-cb80-435a-9d77-81a9e0c5a763 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.309400 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950bc79-cb80-435a-9d77-81a9e0c5a763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.309692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950bc79-cb80-435a-9d77-81a9e0c5a763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.310364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950bc79-cb80-435a-9d77-81a9e0c5a763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:11:38.312471 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: WARNING py.warnings [None req-0950bc79-cb80-435a-9d77-81a9e0c5a763 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:11:38.312471 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: warnings.warn(msg) Jun 21 08:11:38.312471 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: Jun 21 08:11:38.313675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950bc79-cb80-435a-9d77-81a9e0c5a763 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:11:38.350346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 741/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:11:38 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:11:38.355025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193489de-bc41-4a9d-870a-a645228fc174 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:11:38.365948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193489de-bc41-4a9d-870a-a645228fc174 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:11:38.427409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a173e-5313-4492-8d4d-5f0fc6fa09c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:11:38.428075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a173e-5313-4492-8d4d-5f0fc6fa09c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.428359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a173e-5313-4492-8d4d-5f0fc6fa09c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.428635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a173e-5313-4492-8d4d-5f0fc6fa09c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.429321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a173e-5313-4492-8d4d-5f0fc6fa09c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:11:38.430332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: WARNING py.warnings [None req-252a173e-5313-4492-8d4d-5f0fc6fa09c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:11:38.430332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: warnings.warn(msg) Jun 21 08:11:38.430332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: Jun 21 08:11:38.431615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a173e-5313-4492-8d4d-5f0fc6fa09c2 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:11:38.451728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 757/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:11:38 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:11:38.456063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950bc79-cb80-435a-9d77-81a9e0c5a763 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:11:38.466287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950bc79-cb80-435a-9d77-81a9e0c5a763 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:11:38.471262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260129c-ba76-4675-9802-d64f1a9f3770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:11:38.471909 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260129c-ba76-4675-9802-d64f1a9f3770 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.472187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260129c-ba76-4675-9802-d64f1a9f3770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.472477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260129c-ba76-4675-9802-d64f1a9f3770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.473168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260129c-ba76-4675-9802-d64f1a9f3770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:11:38.474161 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: WARNING py.warnings [None req-8260129c-ba76-4675-9802-d64f1a9f3770 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:11:38.474161 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: warnings.warn(msg) Jun 21 08:11:38.474161 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: Jun 21 08:11:38.475092 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260129c-ba76-4675-9802-d64f1a9f3770 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:11:38.488067 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 742/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:11:38.492031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a173e-5313-4492-8d4d-5f0fc6fa09c2 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:11:38.502497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a173e-5313-4492-8d4d-5f0fc6fa09c2 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:11:38.507020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e371e-ffec-40a7-85a8-9894a41acad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:11:38.507665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e371e-ffec-40a7-85a8-9894a41acad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.507949 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e371e-ffec-40a7-85a8-9894a41acad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.508224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e371e-ffec-40a7-85a8-9894a41acad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.508941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e371e-ffec-40a7-85a8-9894a41acad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:11:38.509950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: WARNING py.warnings [None req-a87e371e-ffec-40a7-85a8-9894a41acad7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:11:38.509950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: warnings.warn(msg) Jun 21 08:11:38.509950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: Jun 21 08:11:38.510849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e371e-ffec-40a7-85a8-9894a41acad7 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:11:38.524316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 758/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:11:38.528384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260129c-ba76-4675-9802-d64f1a9f3770 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:11:38.538693 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260129c-ba76-4675-9802-d64f1a9f3770 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:11:38.543191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d02d5-2c4a-4134-a9f4-b84155a85d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:11:38.544059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d02d5-2c4a-4134-a9f4-b84155a85d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.544358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d02d5-2c4a-4134-a9f4-b84155a85d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.544620 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d02d5-2c4a-4134-a9f4-b84155a85d1d admin admin] PATH_INFO: `/v3/projects/329f396c5d1943039ae2b78bd454b404/users/6fd282cf1cd64752b9b19808f6a7506b/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.560158 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d02d5-2c4a-4134-a9f4-b84155a85d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=329f396c5d1943039ae2b78bd454b404, user_id=6fd282cf1cd64752b9b19808f6a7506b, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:11:38.561189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: WARNING py.warnings [None req-6b2d02d5-2c4a-4134-a9f4-b84155a85d1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:11:38.561189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: warnings.warn(msg) Jun 21 08:11:38.561189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: Jun 21 08:11:38.563163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d02d5-2c4a-4134-a9f4-b84155a85d1d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:11:38.578181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 743/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:11:38 2022] PUT /identity/v3/projects/329f396c5d1943039ae2b78bd454b404/users/6fd282cf1cd64752b9b19808f6a7506b/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:11:38.589305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec69cd8-2e41-4b96-b3e0-03e3ed4f6906 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.589599 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec69cd8-2e41-4b96-b3e0-03e3ed4f6906 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.589874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec69cd8-2e41-4b96-b3e0-03e3ed4f6906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.617188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-3ec69cd8-2e41-4b96-b3e0-03e3ed4f6906 None None] MFA Rules not processed for user `6fd282cf1cd64752b9b19808f6a7506b`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:11:38.618678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-3ec69cd8-2e41-4b96-b3e0-03e3ed4f6906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:11:38.681791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 759/1502] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:11:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:11:38.694827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a13895-eafa-4a84-903b-2aef410e43be None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.695143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a13895-eafa-4a84-903b-2aef410e43be None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.695418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a13895-eafa-4a84-903b-2aef410e43be None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.696803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 744/1503] 10.222.0.36 () {54 vars in 963 bytes} [Tue Jun 21 08:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:11:38.701474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb488ad-30bf-4a98-85df-0fde21c269d8 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.702736 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb488ad-30bf-4a98-85df-0fde21c269d8 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.703027 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb488ad-30bf-4a98-85df-0fde21c269d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.722224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-1bb488ad-30bf-4a98-85df-0fde21c269d8 None None] MFA Rules not processed for user `36e7b70349d9427e899ee290dda2d3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:11:38.723490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1bb488ad-30bf-4a98-85df-0fde21c269d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:11:38.769315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:11:38.777124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 760/1504] 10.222.0.36 () {58 vars in 1060 bytes} [Tue Jun 21 08:11:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:11:38.785141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a13895-eafa-4a84-903b-2aef410e43be None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:11:38.795643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a13895-eafa-4a84-903b-2aef410e43be None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:11:38.799083 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1f076-1d73-442e-ac76-3c9a5e903221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:11:38.799698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1f076-1d73-442e-ac76-3c9a5e903221 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.799976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1f076-1d73-442e-ac76-3c9a5e903221 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.800245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1f076-1d73-442e-ac76-3c9a5e903221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.808552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1f076-1d73-442e-ac76-3c9a5e903221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:11:38.809965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1f076-1d73-442e-ac76-3c9a5e903221 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:11:38.818625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 745/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:11:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:11:38.861005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037c8c-c874-4713-8be6-e5e10ec20e05 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.861296 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037c8c-c874-4713-8be6-e5e10ec20e05 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.861580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037c8c-c874-4713-8be6-e5e10ec20e05 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.862890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 761/1506] 10.222.0.36 () {52 vars in 829 bytes} [Tue Jun 21 08:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:11:38.866476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1f076-1d73-442e-ac76-3c9a5e903221 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:11:38.927188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1f076-1d73-442e-ac76-3c9a5e903221 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:11:38.931652 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:11:38.932541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:38.932772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:38.933043 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] PATH_INFO: `/v3/users/6fd282cf1cd64752b9b19808f6a7506b` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:38.934198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd282cf1cd64752b9b19808f6a7506b)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:11:38.935298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: WARNING py.warnings [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:11:38.935298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: warnings.warn(msg) Jun 21 08:11:38.935298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: Jun 21 08:11:38.938202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:11:39.002415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd282cf1cd64752b9b19808f6a7506b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:11:39.014675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd282cf1cd64752b9b19808f6a7506b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:11:39.023790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd282cf1cd64752b9b19808f6a7506b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:11:39.024546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd282cf1cd64752b9b19808f6a7506b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:11:39.025184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd282cf1cd64752b9b19808f6a7506b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:11:39.041938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:11:39.052467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 746/1507] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:11:38 2022] DELETE /identity/v3/users/6fd282cf1cd64752b9b19808f6a7506b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:11:39.056847 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1718aca-20ef-4b0d-afbe-de23301a9b34 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:39.057141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1718aca-20ef-4b0d-afbe-de23301a9b34 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:39.057423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1718aca-20ef-4b0d-afbe-de23301a9b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:39.074567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d1718aca-20ef-4b0d-afbe-de23301a9b34 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:11:39.075789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d1718aca-20ef-4b0d-afbe-de23301a9b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:11:39.134555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 762/1508] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:11:39.144602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:11:39.145981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:11:39.204789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b4a8e-faf3-4c16-a305-4c398f8d6864 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:11:39.208480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17095317-efea-4662-9b9b-5fb3d5334ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:11:39.209126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17095317-efea-4662-9b9b-5fb3d5334ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:39.209431 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17095317-efea-4662-9b9b-5fb3d5334ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:39.209707 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17095317-efea-4662-9b9b-5fb3d5334ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:39.219221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17095317-efea-4662-9b9b-5fb3d5334ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:11:39.220666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17095317-efea-4662-9b9b-5fb3d5334ee9 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:11:39.229757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 747/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:11:39.556215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1718aca-20ef-4b0d-afbe-de23301a9b34 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:11:39.557744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d1718aca-20ef-4b0d-afbe-de23301a9b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:11:39.573281 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1718aca-20ef-4b0d-afbe-de23301a9b34 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:11:39.577532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:11:39.577532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:11:39.577532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:11:39.577891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] PATH_INFO: `/v3/projects/329f396c5d1943039ae2b78bd454b404` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:11:39.579353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=329f396c5d1943039ae2b78bd454b404)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:11:39.580381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: WARNING py.warnings [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:11:39.580381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: warnings.warn(msg) Jun 21 08:11:39.580381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: Jun 21 08:11:39.581571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:11:39.648236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329f396c5d1943039ae2b78bd454b404', 'request_id': 'req-7e118fa8-b7b7-46e2-84ff-75777fc08564'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:11:39.658355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329f396c5d1943039ae2b78bd454b404', 'request_id': 'req-7e118fa8-b7b7-46e2-84ff-75777fc08564'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:11:39.672508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329f396c5d1943039ae2b78bd454b404', 'request_id': 'req-7e118fa8-b7b7-46e2-84ff-75777fc08564'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:11:39.683419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] The token cache is being invalidate because project 329f396c5d1943039ae2b78bd454b404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:11:39.683710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:11:39.684445 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-7e118fa8-b7b7-46e2-84ff-75777fc08564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:11:39.686612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 763/1510] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:11:39 2022] DELETE /identity/v3/projects/329f396c5d1943039ae2b78bd454b404 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:11:49.225701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:11:49.680348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:13:14.151081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c04bf8-cd9e-430f-bf18-7e3601f32328 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:14.151657 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c04bf8-cd9e-430f-bf18-7e3601f32328 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:14.151657 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c04bf8-cd9e-430f-bf18-7e3601f32328 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:14.152934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 08:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:13:14.158666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330219b-d4de-4db2-b22e-938cad4d884d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:14.159125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330219b-d4de-4db2-b22e-938cad4d884d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:14.159235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330219b-d4de-4db2-b22e-938cad4d884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:14.177705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-9330219b-d4de-4db2-b22e-938cad4d884d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:13:14.178951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9330219b-d4de-4db2-b22e-938cad4d884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:14.236952 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 08:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:13:14.390457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c04bf8-cd9e-430f-bf18-7e3601f32328 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:13:14.392313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f8c04bf8-cd9e-430f-bf18-7e3601f32328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:14.466868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c04bf8-cd9e-430f-bf18-7e3601f32328 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:13:14.472951 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552955aa-6bcc-456b-b61d-d0b5d9327f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:13:14.473583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552955aa-6bcc-456b-b61d-d0b5d9327f22 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:14.473863 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552955aa-6bcc-456b-b61d-d0b5d9327f22 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:14.474142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552955aa-6bcc-456b-b61d-d0b5d9327f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:14.482050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552955aa-6bcc-456b-b61d-d0b5d9327f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:13:14.483728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552955aa-6bcc-456b-b61d-d0b5d9327f22 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:13:14.493029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 749/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:13:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:13:15.336267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7697c48-8cc1-49e5-b0a4-173f6e48017d None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:15.336834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7697c48-8cc1-49e5-b0a4-173f6e48017d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:15.336834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7697c48-8cc1-49e5-b0a4-173f6e48017d None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:15.338302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 08:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:13:15.343987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2562327-79e9-45f3-99ca-7a39dae967a4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:15.344389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2562327-79e9-45f3-99ca-7a39dae967a4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:15.344532 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2562327-79e9-45f3-99ca-7a39dae967a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:15.362538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d2562327-79e9-45f3-99ca-7a39dae967a4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:13:15.363801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d2562327-79e9-45f3-99ca-7a39dae967a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:15.372010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 08:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:13:15.529269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7697c48-8cc1-49e5-b0a4-173f6e48017d None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:13:15.544699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7697c48-8cc1-49e5-b0a4-173f6e48017d None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:13:15.550231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111767e-3936-47f2-bc65-12718d840004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:13:15.550936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111767e-3936-47f2-bc65-12718d840004 service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:15.551221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111767e-3936-47f2-bc65-12718d840004 service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:15.551497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111767e-3936-47f2-bc65-12718d840004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:15.560126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111767e-3936-47f2-bc65-12718d840004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:13:15.562322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111767e-3936-47f2-bc65-12718d840004 service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:13:15.575146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 766/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:13:16.052568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369e5ca-6d68-49d2-ad38-d914cb27bb99 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:16.052889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369e5ca-6d68-49d2-ad38-d914cb27bb99 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:16.053171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369e5ca-6d68-49d2-ad38-d914cb27bb99 None None] PATH_INFO: `/v3` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:16.054525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 751/1517] 10.222.0.46 () {54 vars in 925 bytes} [Tue Jun 21 08:13:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:13:16.060980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d297e32-8093-4cc2-8a89-4baf6606dfa5 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:16.061267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d297e32-8093-4cc2-8a89-4baf6606dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:16.061629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d297e32-8093-4cc2-8a89-4baf6606dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:16.080001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-1d297e32-8093-4cc2-8a89-4baf6606dfa5 None None] MFA Rules not processed for user `53dfc3572d05469ca7e2de1acea3629a`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:13:16.081190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1d297e32-8093-4cc2-8a89-4baf6606dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:16.142302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 767/1518] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Jun 21 08:13:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:13:19.906303 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba665a7-7916-466c-92cf-bdfd3bedfb74 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:19.906901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba665a7-7916-466c-92cf-bdfd3bedfb74 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:19.906901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba665a7-7916-466c-92cf-bdfd3bedfb74 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:19.908172 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 752/1519] 10.222.0.36 () {54 vars in 960 bytes} [Tue Jun 21 08:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:13:19.913037 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5dd2a-840e-4ccf-8360-720515144ac7 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:19.913439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5dd2a-840e-4ccf-8360-720515144ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:19.913599 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5dd2a-840e-4ccf-8360-720515144ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:19.931843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-97d5dd2a-840e-4ccf-8360-720515144ac7 None None] MFA Rules not processed for user `53dfc3572d05469ca7e2de1acea3629a`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:13:19.933038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-97d5dd2a-840e-4ccf-8360-720515144ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:19.942058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 768/1520] 10.222.0.36 () {58 vars in 1057 bytes} [Tue Jun 21 08:13:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:13:19.949287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba665a7-7916-466c-92cf-bdfd3bedfb74 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:13:19.962841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba665a7-7916-466c-92cf-bdfd3bedfb74 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:13:19.967716 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b111a8-513b-4ae5-809b-40fc3f825c59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:13:19.968632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b111a8-513b-4ae5-809b-40fc3f825c59 service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:19.968914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b111a8-513b-4ae5-809b-40fc3f825c59 service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:19.969185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b111a8-513b-4ae5-809b-40fc3f825c59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:19.977560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b111a8-513b-4ae5-809b-40fc3f825c59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:13:19.979177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b111a8-513b-4ae5-809b-40fc3f825c59 service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:13:19.989121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 753/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:13:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:13:26.812101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447e233-893f-4c5b-a033-ce62186a8caf None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:26.812659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447e233-893f-4c5b-a033-ce62186a8caf None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:26.812763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447e233-893f-4c5b-a033-ce62186a8caf None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:26.814269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 08:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:13:26.819164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61908446-ea32-4836-9519-4f396fa6d7ba None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:26.819567 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61908446-ea32-4836-9519-4f396fa6d7ba None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:26.819710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61908446-ea32-4836-9519-4f396fa6d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:26.837915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-61908446-ea32-4836-9519-4f396fa6d7ba None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:13:26.839065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-61908446-ea32-4836-9519-4f396fa6d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:26.847720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 08:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:13:27.006011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447e233-893f-4c5b-a033-ce62186a8caf None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:13:27.021803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447e233-893f-4c5b-a033-ce62186a8caf None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:13:27.027159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05e223-3589-4981-bf9d-aa7767e64ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:13:27.027789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05e223-3589-4981-bf9d-aa7767e64ff9 service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:27.028087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05e223-3589-4981-bf9d-aa7767e64ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:27.028350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05e223-3589-4981-bf9d-aa7767e64ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:27.037407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05e223-3589-4981-bf9d-aa7767e64ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:13:27.039043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05e223-3589-4981-bf9d-aa7767e64ff9 service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:13:27.048790 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 770/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:13:27.898578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9cdb0-e4df-44ce-bfed-1f865825b56b None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:27.899121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9cdb0-e4df-44ce-bfed-1f865825b56b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:27.899121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9cdb0-e4df-44ce-bfed-1f865825b56b None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:27.900489 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 08:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:13:27.906247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8bdc1-f4c5-4dce-90f7-c0b07ca29a41 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:27.906702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8bdc1-f4c5-4dce-90f7-c0b07ca29a41 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:27.906844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8bdc1-f4c5-4dce-90f7-c0b07ca29a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:27.925406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-faa8bdc1-f4c5-4dce-90f7-c0b07ca29a41 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:13:27.926601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-faa8bdc1-f4c5-4dce-90f7-c0b07ca29a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:27.934707 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 08:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:13:28.104159 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9cdb0-e4df-44ce-bfed-1f865825b56b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:13:28.118840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9cdb0-e4df-44ce-bfed-1f865825b56b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:13:28.124503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fa0b4-c518-4c31-b286-676622224854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:13:28.125126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fa0b4-c518-4c31-b286-676622224854 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:28.125408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fa0b4-c518-4c31-b286-676622224854 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:28.125677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fa0b4-c518-4c31-b286-676622224854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:28.133597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fa0b4-c518-4c31-b286-676622224854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:13:28.135262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fa0b4-c518-4c31-b286-676622224854 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:13:28.144969 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 756/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:13:32.010822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ec580-bfa4-4e61-a9cb-dd328e4c65a6 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:32.011380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ec580-bfa4-4e61-a9cb-dd328e4c65a6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:32.011380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ec580-bfa4-4e61-a9cb-dd328e4c65a6 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:32.012913 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:13:32.018269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f175a7-2ac4-481d-b4bf-ffd995dc2484 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:32.018720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f175a7-2ac4-481d-b4bf-ffd995dc2484 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:32.018859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f175a7-2ac4-481d-b4bf-ffd995dc2484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:32.036808 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c7f175a7-2ac4-481d-b4bf-ffd995dc2484 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:13:32.037996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c7f175a7-2ac4-481d-b4bf-ffd995dc2484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:32.046813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:13:32.082791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ec580-bfa4-4e61-a9cb-dd328e4c65a6 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:13:32.084428 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-789ec580-bfa4-4e61-a9cb-dd328e4c65a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:32.141462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ec580-bfa4-4e61-a9cb-dd328e4c65a6 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:13:32.144945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c81c9a-06d4-4714-8f9f-72ba4905498a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:13:32.145574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81c9a-06d4-4714-8f9f-72ba4905498a service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:32.145855 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81c9a-06d4-4714-8f9f-72ba4905498a service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:32.146128 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81c9a-06d4-4714-8f9f-72ba4905498a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:32.154843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c81c9a-06d4-4714-8f9f-72ba4905498a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:13:32.156378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c81c9a-06d4-4714-8f9f-72ba4905498a service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:13:32.161222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:13:32.166182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 773/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:13:34.193291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaded742-9fc9-4fee-b76f-a3c7a74c49a7 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:34.193857 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaded742-9fc9-4fee-b76f-a3c7a74c49a7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:34.193857 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaded742-9fc9-4fee-b76f-a3c7a74c49a7 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:34.195238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:13:34.200288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83f61d-72b8-4364-ada3-f24e4518f085 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:34.200727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83f61d-72b8-4364-ada3-f24e4518f085 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:34.200838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83f61d-72b8-4364-ada3-f24e4518f085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:34.220711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ac83f61d-72b8-4364-ada3-f24e4518f085 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:13:34.221845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ac83f61d-72b8-4364-ada3-f24e4518f085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:34.229622 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:13:34.276755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaded742-9fc9-4fee-b76f-a3c7a74c49a7 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:13:34.288706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaded742-9fc9-4fee-b76f-a3c7a74c49a7 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:13:34.292292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ead8f9-dc01-4fd7-b0ba-adeef88a2bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:13:34.292929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ead8f9-dc01-4fd7-b0ba-adeef88a2bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:34.293210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ead8f9-dc01-4fd7-b0ba-adeef88a2bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:34.293485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ead8f9-dc01-4fd7-b0ba-adeef88a2bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:34.306853 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ead8f9-dc01-4fd7-b0ba-adeef88a2bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:13:34.308355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ead8f9-dc01-4fd7-b0ba-adeef88a2bd9 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:13:34.318465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 759/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:13:37.990728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123f98d-ca57-4a48-86df-8248df1e1a15 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:37.991288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123f98d-ca57-4a48-86df-8248df1e1a15 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:37.991288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123f98d-ca57-4a48-86df-8248df1e1a15 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:37.992667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:13:37.998129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aee3e-3469-4701-b5c6-7bdfd5620cc0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:37.998549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aee3e-3469-4701-b5c6-7bdfd5620cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:37.998762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aee3e-3469-4701-b5c6-7bdfd5620cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:38.018027 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5b4aee3e-3469-4701-b5c6-7bdfd5620cc0 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:13:38.019195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5b4aee3e-3469-4701-b5c6-7bdfd5620cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:38.026981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:13:38.331806 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123f98d-ca57-4a48-86df-8248df1e1a15 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:13:38.333477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e123f98d-ca57-4a48-86df-8248df1e1a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:38.390909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123f98d-ca57-4a48-86df-8248df1e1a15 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:13:38.394414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a47440-c1d1-45fd-8157-c348ea78311a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:13:38.395090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a47440-c1d1-45fd-8157-c348ea78311a service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:38.395381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a47440-c1d1-45fd-8157-c348ea78311a service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:38.395664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a47440-c1d1-45fd-8157-c348ea78311a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:38.404524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a47440-c1d1-45fd-8157-c348ea78311a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:13:38.406478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a47440-c1d1-45fd-8157-c348ea78311a service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:13:38.415932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 776/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:13:40.494573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5837-cc4a-4e04-b898-4f301f04c1c5 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:40.495138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5837-cc4a-4e04-b898-4f301f04c1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:40.495138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5837-cc4a-4e04-b898-4f301f04c1c5 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:40.496834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 08:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:13:40.501909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a666e-b837-4ef4-b468-9f7d8e81da1d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:40.502361 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a666e-b837-4ef4-b468-9f7d8e81da1d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:40.502500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a666e-b837-4ef4-b468-9f7d8e81da1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:40.520942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-eb7a666e-b837-4ef4-b468-9f7d8e81da1d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:13:40.522139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-eb7a666e-b837-4ef4-b468-9f7d8e81da1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:40.529878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 08:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:13:40.840626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c5837-cc4a-4e04-b898-4f301f04c1c5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:13:40.842308 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-936c5837-cc4a-4e04-b898-4f301f04c1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:13:40.850877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=65 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:13:40.857339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c5837-cc4a-4e04-b898-4f301f04c1c5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:13:40.861645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7007b4-9556-4078-83fd-850d09e6134e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:13:40.862276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7007b4-9556-4078-83fd-850d09e6134e service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:13:40.862561 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7007b4-9556-4078-83fd-850d09e6134e service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:13:40.862868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7007b4-9556-4078-83fd-850d09e6134e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:13:40.871974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7007b4-9556-4078-83fd-850d09e6134e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:13:40.873403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7007b4-9556-4078-83fd-850d09e6134e service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:13:40.882978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 762/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:13:50.515768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=32 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:13:50.878970 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:09.475329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3288e0-50d8-45a0-88e4-8e5eedc0532d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.478513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3288e0-50d8-45a0-88e4-8e5eedc0532d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.478513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3288e0-50d8-45a0-88e4-8e5eedc0532d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.501636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-0f3288e0-50d8-45a0-88e4-8e5eedc0532d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.504190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0f3288e0-50d8-45a0-88e4-8e5eedc0532d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.516988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 778/1540] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.524367 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f443b-b2ec-4409-bd59-607db942f907 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.524981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f443b-b2ec-4409-bd59-607db942f907 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.524981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f443b-b2ec-4409-bd59-607db942f907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.527419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9b07d-abce-4945-9adc-4aa5695db195 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.527944 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9b07d-abce-4945-9adc-4aa5695db195 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.528428 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9b07d-abce-4945-9adc-4aa5695db195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.554831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-00f9b07d-abce-4945-9adc-4aa5695db195 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.556451 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-00f9b07d-abce-4945-9adc-4aa5695db195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.559947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f99f443b-b2ec-4409-bd59-607db942f907 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.561294 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f99f443b-b2ec-4409-bd59-607db942f907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.569982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 779/1541] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:15:09.571700 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a89834-d228-4527-8204-e0e9c6286bc8 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.572212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a89834-d228-4527-8204-e0e9c6286bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.572692 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a89834-d228-4527-8204-e0e9c6286bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.584166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 763/1542] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:15:09.585413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d192a7a-5715-44e2-ad5b-00dbd455a34e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.585782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d192a7a-5715-44e2-ad5b-00dbd455a34e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.586139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d192a7a-5715-44e2-ad5b-00dbd455a34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.597451 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-c9a89834-d228-4527-8204-e0e9c6286bc8 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.598716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c9a89834-d228-4527-8204-e0e9c6286bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.608683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 780/1543] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.609947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f2da6-26a2-4e0f-a598-fc2f3bdd1570 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.610426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f2da6-26a2-4e0f-a598-fc2f3bdd1570 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.610887 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f2da6-26a2-4e0f-a598-fc2f3bdd1570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.627735 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1d192a7a-5715-44e2-ad5b-00dbd455a34e None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.629279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1d192a7a-5715-44e2-ad5b-00dbd455a34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.632593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-985f2da6-26a2-4e0f-a598-fc2f3bdd1570 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.634042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-985f2da6-26a2-4e0f-a598-fc2f3bdd1570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.638408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 764/1544] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.639629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d192a7a-5715-44e2-ad5b-00dbd455a34e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:09.645180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 781/1545] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.646657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528dcfd-79a6-4690-9b71-55953beb7dad None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.647131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528dcfd-79a6-4690-9b71-55953beb7dad None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.647645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528dcfd-79a6-4690-9b71-55953beb7dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.652216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d192a7a-5715-44e2-ad5b-00dbd455a34e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:09.657785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3f55b-e0fc-4214-9aea-6dd9e53413f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:09.658448 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3f55b-e0fc-4214-9aea-6dd9e53413f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.658767 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3f55b-e0fc-4214-9aea-6dd9e53413f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.659814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3f55b-e0fc-4214-9aea-6dd9e53413f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.660617 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3f55b-e0fc-4214-9aea-6dd9e53413f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:09.660934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3f55b-e0fc-4214-9aea-6dd9e53413f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:09.661954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: WARNING py.warnings [None req-cfa3f55b-e0fc-4214-9aea-6dd9e53413f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:15:09.661954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: warnings.warn(msg) Jun 21 08:15:09.661954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: Jun 21 08:15:09.662913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3f55b-e0fc-4214-9aea-6dd9e53413f4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:09.667004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d528dcfd-79a6-4690-9b71-55953beb7dad None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.668202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d528dcfd-79a6-4690-9b71-55953beb7dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.675925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 765/1546] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:09.677141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f6d92-d190-402d-b364-5d11a5631e56 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.677440 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f6d92-d190-402d-b364-5d11a5631e56 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.677724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f6d92-d190-402d-b364-5d11a5631e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.677851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 782/1547] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.679120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4fab4-a4b4-41e3-b7e1-52a1da401481 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.679404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4fab4-a4b4-41e3-b7e1-52a1da401481 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.679678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4fab4-a4b4-41e3-b7e1-52a1da401481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.704096 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-41b4fab4-a4b4-41e3-b7e1-52a1da401481 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.705281 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-41b4fab4-a4b4-41e3-b7e1-52a1da401481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.706214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-be9f6d92-d190-402d-b364-5d11a5631e56 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.707902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-be9f6d92-d190-402d-b364-5d11a5631e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.714760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 783/1548] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.719111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 766/1549] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.719278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251bf34-9feb-42cf-a5a2-c71b72c2a2db None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.719278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251bf34-9feb-42cf-a5a2-c71b72c2a2db None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.719278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251bf34-9feb-42cf-a5a2-c71b72c2a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.719548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7b40-b1b4-45d4-83cc-677f8714f76f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.719548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7b40-b1b4-45d4-83cc-677f8714f76f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.719548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7b40-b1b4-45d4-83cc-677f8714f76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.737017 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-402f7b40-b1b4-45d4-83cc-677f8714f76f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.737254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f251bf34-9feb-42cf-a5a2-c71b72c2a2db None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.738137 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-402f7b40-b1b4-45d4-83cc-677f8714f76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.738271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f251bf34-9feb-42cf-a5a2-c71b72c2a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.750188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 767/1550] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.750365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 784/1551] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.750365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251bf34-9feb-42cf-a5a2-c71b72c2a2db None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:09.750535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f239faa-eb9c-4379-8966-3336d2fb07bc None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.750535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f239faa-eb9c-4379-8966-3336d2fb07bc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.750535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f239faa-eb9c-4379-8966-3336d2fb07bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.760317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251bf34-9feb-42cf-a5a2-c71b72c2a2db None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:09.764847 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc2cd1-edd7-4d78-8d12-000a3269bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:09.765495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc2cd1-edd7-4d78-8d12-000a3269bb88 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.765779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc2cd1-edd7-4d78-8d12-000a3269bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.766058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc2cd1-edd7-4d78-8d12-000a3269bb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.766783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc2cd1-edd7-4d78-8d12-000a3269bb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:09.767407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9f239faa-eb9c-4379-8966-3336d2fb07bc None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.767808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: WARNING py.warnings [None req-8ebc2cd1-edd7-4d78-8d12-000a3269bb88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:15:09.767808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: warnings.warn(msg) Jun 21 08:15:09.767808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: Jun 21 08:15:09.769357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9f239faa-eb9c-4379-8966-3336d2fb07bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.769683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc2cd1-edd7-4d78-8d12-000a3269bb88 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:09.777620 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 768/1552] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.779131 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc9f20-d818-4614-a882-588c72570c82 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.779415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc9f20-d818-4614-a882-588c72570c82 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.780078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc9f20-d818-4614-a882-588c72570c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.798377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 785/1553] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:09.798377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c6ee7-53c0-4278-ab30-759ca47eddef None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.798377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c6ee7-53c0-4278-ab30-759ca47eddef None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.798377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c6ee7-53c0-4278-ab30-759ca47eddef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.800290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e5bc9f20-d818-4614-a882-588c72570c82 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.801182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e5bc9f20-d818-4614-a882-588c72570c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.815930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-da4c6ee7-53c0-4278-ab30-759ca47eddef None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.817129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-da4c6ee7-53c0-4278-ab30-759ca47eddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.863163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 769/1554] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.863994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc9f20-d818-4614-a882-588c72570c82 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:09.873108 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc9f20-d818-4614-a882-588c72570c82 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:09.877793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c520e5-b638-481e-b0d2-f2b066b6af11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:09.878484 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c520e5-b638-481e-b0d2-f2b066b6af11 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.878792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c520e5-b638-481e-b0d2-f2b066b6af11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.879070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c520e5-b638-481e-b0d2-f2b066b6af11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.879786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c520e5-b638-481e-b0d2-f2b066b6af11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:09.880090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c520e5-b638-481e-b0d2-f2b066b6af11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:09.881421 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 786/1555] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.881692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c520e5-b638-481e-b0d2-f2b066b6af11 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:09.882269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c6ee7-53c0-4278-ab30-759ca47eddef None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:09.892343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c6ee7-53c0-4278-ab30-759ca47eddef None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:09.905039 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 770/1556] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:09.905230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddbc40-9efe-455e-9cab-373a49302ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:09.905362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c520e5-b638-481e-b0d2-f2b066b6af11 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:09.905472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddbc40-9efe-455e-9cab-373a49302ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.905472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddbc40-9efe-455e-9cab-373a49302ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.905472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddbc40-9efe-455e-9cab-373a49302ec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.905472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddbc40-9efe-455e-9cab-373a49302ec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:09.905472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddbc40-9efe-455e-9cab-373a49302ec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:09.905472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddbc40-9efe-455e-9cab-373a49302ec3 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:09.909556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c520e5-b638-481e-b0d2-f2b066b6af11 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:09.914156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04f281-5fa4-42bf-afae-2fdfcb47c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:09.914827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04f281-5fa4-42bf-afae-2fdfcb47c4eb admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.915111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04f281-5fa4-42bf-afae-2fdfcb47c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.915389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04f281-5fa4-42bf-afae-2fdfcb47c4eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.916109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04f281-5fa4-42bf-afae-2fdfcb47c4eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:09.916413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04f281-5fa4-42bf-afae-2fdfcb47c4eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:09.923615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 787/1557] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:09.923779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04f281-5fa4-42bf-afae-2fdfcb47c4eb admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:09.923885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370ce1d-0694-4b91-a6d6-4865950d48fe None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.923885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370ce1d-0694-4b91-a6d6-4865950d48fe None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.923885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370ce1d-0694-4b91-a6d6-4865950d48fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.937116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 771/1558] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:09.937116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04f281-5fa4-42bf-afae-2fdfcb47c4eb admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:09.937625 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-5370ce1d-0694-4b91-a6d6-4865950d48fe None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:09.938918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-5370ce1d-0694-4b91-a6d6-4865950d48fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:09.948966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 788/1559] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:09.949848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370ce1d-0694-4b91-a6d6-4865950d48fe None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:09.952378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04f281-5fa4-42bf-afae-2fdfcb47c4eb admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:09.958201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97db39-caa3-4d02-9c42-7a2bd165bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:09.958893 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97db39-caa3-4d02-9c42-7a2bd165bbba admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.959176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97db39-caa3-4d02-9c42-7a2bd165bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.959450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97db39-caa3-4d02-9c42-7a2bd165bbba admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.959563 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370ce1d-0694-4b91-a6d6-4865950d48fe None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:09.960178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97db39-caa3-4d02-9c42-7a2bd165bbba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:09.960482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97db39-caa3-4d02-9c42-7a2bd165bbba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:09.962062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97db39-caa3-4d02-9c42-7a2bd165bbba admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:09.964045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2602d-8074-4144-b618-262fc0df2158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:09.964693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2602d-8074-4144-b618-262fc0df2158 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.964980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2602d-8074-4144-b618-262fc0df2158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.965260 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2602d-8074-4144-b618-262fc0df2158 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.965951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2602d-8074-4144-b618-262fc0df2158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:09.967908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2602d-8074-4144-b618-262fc0df2158 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:09.975202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 772/1560] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:09.976241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97db39-caa3-4d02-9c42-7a2bd165bbba admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:09.989702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 789/1561] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:09.990589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075b95a-a559-4edb-aa92-020f9fdd6432 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.990908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075b95a-a559-4edb-aa92-020f9fdd6432 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.991204 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075b95a-a559-4edb-aa92-020f9fdd6432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:09.993601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97db39-caa3-4d02-9c42-7a2bd165bbba admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:09.999417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8b98a-01bb-40ec-93f6-d8bc8dfa1670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:09.999417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8b98a-01bb-40ec-93f6-d8bc8dfa1670 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:09.999691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8b98a-01bb-40ec-93f6-d8bc8dfa1670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:09.999785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8b98a-01bb-40ec-93f6-d8bc8dfa1670 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.000479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8b98a-01bb-40ec-93f6-d8bc8dfa1670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:10.000784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8b98a-01bb-40ec-93f6-d8bc8dfa1670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.002373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8b98a-01bb-40ec-93f6-d8bc8dfa1670 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.009679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f075b95a-a559-4edb-aa92-020f9fdd6432 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:10.011593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f075b95a-a559-4edb-aa92-020f9fdd6432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:10.017033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 773/1562] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:10.017033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8b98a-01bb-40ec-93f6-d8bc8dfa1670 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.024520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 790/1563] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:10.024520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075b95a-a559-4edb-aa92-020f9fdd6432 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.031621 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8b98a-01bb-40ec-93f6-d8bc8dfa1670 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.036794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075b95a-a559-4edb-aa92-020f9fdd6432 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.037448 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd2de8-3be5-45a8-89f3-46fbb0f7c3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.038106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd2de8-3be5-45a8-89f3-46fbb0f7c3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.038388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd2de8-3be5-45a8-89f3-46fbb0f7c3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.038691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd2de8-3be5-45a8-89f3-46fbb0f7c3c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.039390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd2de8-3be5-45a8-89f3-46fbb0f7c3c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.041305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd2de8-3be5-45a8-89f3-46fbb0f7c3c2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.042299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4b177-3821-4d98-a203-5115583b89c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.042996 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b177-3821-4d98-a203-5115583b89c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.043284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b177-3821-4d98-a203-5115583b89c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.043565 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b177-3821-4d98-a203-5115583b89c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.044264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4b177-3821-4d98-a203-5115583b89c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.046500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4b177-3821-4d98-a203-5115583b89c0 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.070667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 774/1564] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.070885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd2de8-3be5-45a8-89f3-46fbb0f7c3c2 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.077710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 791/1565] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.077710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4b177-3821-4d98-a203-5115583b89c0 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.107535 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:10.119598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:10.140838 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd2de8-3be5-45a8-89f3-46fbb0f7c3c2 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.144122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4b177-3821-4d98-a203-5115583b89c0 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.146496 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f8bf-f232-41d0-8264-21f35247d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.147185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f8bf-f232-41d0-8264-21f35247d879 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.147468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f8bf-f232-41d0-8264-21f35247d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.147744 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f8bf-f232-41d0-8264-21f35247d879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.148435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017f8bf-f232-41d0-8264-21f35247d879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.149050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0f29-1ebc-4a2c-9d0f-36ae50dfc595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.149703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0f29-1ebc-4a2c-9d0f-36ae50dfc595 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.149986 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0f29-1ebc-4a2c-9d0f-36ae50dfc595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.150265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0f29-1ebc-4a2c-9d0f-36ae50dfc595 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.150376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017f8bf-f232-41d0-8264-21f35247d879 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.151029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0f29-1ebc-4a2c-9d0f-36ae50dfc595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:10.151339 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0f29-1ebc-4a2c-9d0f-36ae50dfc595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.152942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0f29-1ebc-4a2c-9d0f-36ae50dfc595 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.166084 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 792/1566] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:10.167091 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0f29-1ebc-4a2c-9d0f-36ae50dfc595 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.178050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0f29-1ebc-4a2c-9d0f-36ae50dfc595 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.179027 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 775/1567] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.180051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f8bf-f232-41d0-8264-21f35247d879 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.239121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05d520-df70-4b1e-bad7-80bb97e80bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.239844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05d520-df70-4b1e-bad7-80bb97e80bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.240068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05d520-df70-4b1e-bad7-80bb97e80bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.240355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05d520-df70-4b1e-bad7-80bb97e80bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.241042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05d520-df70-4b1e-bad7-80bb97e80bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.242997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05d520-df70-4b1e-bad7-80bb97e80bd1 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.244201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f8bf-f232-41d0-8264-21f35247d879 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.249041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9001fa5-1909-4c8b-86bc-29f0fe8c056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.249701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9001fa5-1909-4c8b-86bc-29f0fe8c056c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.249985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9001fa5-1909-4c8b-86bc-29f0fe8c056c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.250265 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9001fa5-1909-4c8b-86bc-29f0fe8c056c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.251022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9001fa5-1909-4c8b-86bc-29f0fe8c056c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.252791 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9001fa5-1909-4c8b-86bc-29f0fe8c056c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.263389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 776/1568] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:10.264507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9001fa5-1909-4c8b-86bc-29f0fe8c056c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.273363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 793/1569] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.274295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05d520-df70-4b1e-bad7-80bb97e80bd1 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.275197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9001fa5-1909-4c8b-86bc-29f0fe8c056c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.336082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbf3b3-9719-4bec-b10f-bbdc19e3b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.336742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbf3b3-9719-4bec-b10f-bbdc19e3b52a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.337024 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbf3b3-9719-4bec-b10f-bbdc19e3b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.337301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbf3b3-9719-4bec-b10f-bbdc19e3b52a admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.338025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbf3b3-9719-4bec-b10f-bbdc19e3b52a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.340084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbf3b3-9719-4bec-b10f-bbdc19e3b52a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.343420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05d520-df70-4b1e-bad7-80bb97e80bd1 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.348660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34f26c-fc52-446e-b99a-39ba9298a908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.349316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f26c-fc52-446e-b99a-39ba9298a908 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.349605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f26c-fc52-446e-b99a-39ba9298a908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.349903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f26c-fc52-446e-b99a-39ba9298a908 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.350660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34f26c-fc52-446e-b99a-39ba9298a908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:10.351000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34f26c-fc52-446e-b99a-39ba9298a908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.352599 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34f26c-fc52-446e-b99a-39ba9298a908 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.372199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 794/1570] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:10.372199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34f26c-fc52-446e-b99a-39ba9298a908 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.372755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 777/1571] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.372755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbf3b3-9719-4bec-b10f-bbdc19e3b52a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.379362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34f26c-fc52-446e-b99a-39ba9298a908 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.416915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:10.419992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:10.432164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbf3b3-9719-4bec-b10f-bbdc19e3b52a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.436731 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fa176-c2be-45e1-9e6c-4c1082e3611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.437394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fa176-c2be-45e1-9e6c-4c1082e3611a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.437673 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fa176-c2be-45e1-9e6c-4c1082e3611a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.437948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fa176-c2be-45e1-9e6c-4c1082e3611a admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.438659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fa176-c2be-45e1-9e6c-4c1082e3611a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.439664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: WARNING py.warnings [None req-171fa176-c2be-45e1-9e6c-4c1082e3611a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:15:10.439664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: warnings.warn(msg) Jun 21 08:15:10.439664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: Jun 21 08:15:10.440566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45664b0a-3730-40e8-bcdf-a696196fb359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.440906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fa176-c2be-45e1-9e6c-4c1082e3611a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.441232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45664b0a-3730-40e8-bcdf-a696196fb359 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.441515 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45664b0a-3730-40e8-bcdf-a696196fb359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.441792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45664b0a-3730-40e8-bcdf-a696196fb359 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.442503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45664b0a-3730-40e8-bcdf-a696196fb359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.444446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45664b0a-3730-40e8-bcdf-a696196fb359 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.462421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 778/1572] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.463321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fa176-c2be-45e1-9e6c-4c1082e3611a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.467698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 795/1573] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.468378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45664b0a-3730-40e8-bcdf-a696196fb359 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.475059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fa176-c2be-45e1-9e6c-4c1082e3611a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.478947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45664b0a-3730-40e8-bcdf-a696196fb359 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.479531 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df881f7-034e-4450-8a81-e9737e2f7433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.480167 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df881f7-034e-4450-8a81-e9737e2f7433 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.480455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df881f7-034e-4450-8a81-e9737e2f7433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.480728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df881f7-034e-4450-8a81-e9737e2f7433 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.481434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df881f7-034e-4450-8a81-e9737e2f7433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.483362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df881f7-034e-4450-8a81-e9737e2f7433 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.483526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb37ce-775f-4dec-9664-93a2f3c2714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.484166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb37ce-775f-4dec-9664-93a2f3c2714d admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.484450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb37ce-775f-4dec-9664-93a2f3c2714d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.484728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb37ce-775f-4dec-9664-93a2f3c2714d admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.485404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb37ce-775f-4dec-9664-93a2f3c2714d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.487410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb37ce-775f-4dec-9664-93a2f3c2714d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.509801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 796/1574] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.510714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb37ce-775f-4dec-9664-93a2f3c2714d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.515611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 779/1575] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.515611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df881f7-034e-4450-8a81-e9737e2f7433 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.521143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb37ce-775f-4dec-9664-93a2f3c2714d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.577214 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f48c5-8c42-4286-9a95-1768265480cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.577453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df881f7-034e-4450-8a81-e9737e2f7433 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.577889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f48c5-8c42-4286-9a95-1768265480cc admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.578156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f48c5-8c42-4286-9a95-1768265480cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.578436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f48c5-8c42-4286-9a95-1768265480cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.579209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f48c5-8c42-4286-9a95-1768265480cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.581626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f48c5-8c42-4286-9a95-1768265480cc admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.583166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7591b12-3a3c-4505-8879-fd8f9edd7cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.583830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7591b12-3a3c-4505-8879-fd8f9edd7cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.584241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7591b12-3a3c-4505-8879-fd8f9edd7cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.584524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7591b12-3a3c-4505-8879-fd8f9edd7cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.585221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7591b12-3a3c-4505-8879-fd8f9edd7cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.587230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7591b12-3a3c-4505-8879-fd8f9edd7cc8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.591609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 797/1576] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:10.592389 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f48c5-8c42-4286-9a95-1768265480cc admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.603642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f48c5-8c42-4286-9a95-1768265480cc admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.608289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8e6a0-0a1a-41b9-a090-981f5ae433a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.608936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8e6a0-0a1a-41b9-a090-981f5ae433a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.609051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 780/1577] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.609298 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8e6a0-0a1a-41b9-a090-981f5ae433a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.609629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8e6a0-0a1a-41b9-a090-981f5ae433a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.610325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8e6a0-0a1a-41b9-a090-981f5ae433a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.612741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7591b12-3a3c-4505-8879-fd8f9edd7cc8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.612896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8e6a0-0a1a-41b9-a090-981f5ae433a4 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.623050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7591b12-3a3c-4505-8879-fd8f9edd7cc8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.629383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cc87b-8f54-4a5a-bf6b-2e50babd77f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.630026 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cc87b-8f54-4a5a-bf6b-2e50babd77f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.630320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cc87b-8f54-4a5a-bf6b-2e50babd77f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.630587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cc87b-8f54-4a5a-bf6b-2e50babd77f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.631292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cc87b-8f54-4a5a-bf6b-2e50babd77f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.633219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cc87b-8f54-4a5a-bf6b-2e50babd77f5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.637454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 798/1578] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/users => generated 302 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.637454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8e6a0-0a1a-41b9-a090-981f5ae433a4 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.648450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8e6a0-0a1a-41b9-a090-981f5ae433a4 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.653281 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64219f5c-f64b-455a-8e06-1fc44f242827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.654044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64219f5c-f64b-455a-8e06-1fc44f242827 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.654332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64219f5c-f64b-455a-8e06-1fc44f242827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.654608 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64219f5c-f64b-455a-8e06-1fc44f242827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.655423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64219f5c-f64b-455a-8e06-1fc44f242827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.657019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64219f5c-f64b-455a-8e06-1fc44f242827 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.660059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 781/1579] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.660965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cc87b-8f54-4a5a-bf6b-2e50babd77f5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.669332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 799/1580] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:10.670416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64219f5c-f64b-455a-8e06-1fc44f242827 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.680184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64219f5c-f64b-455a-8e06-1fc44f242827 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.725239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cc87b-8f54-4a5a-bf6b-2e50babd77f5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.730947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d7a8e-e751-43d2-812f-e11c16af46d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.731614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d7a8e-e751-43d2-812f-e11c16af46d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.731899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d7a8e-e751-43d2-812f-e11c16af46d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.732190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d7a8e-e751-43d2-812f-e11c16af46d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.732913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d7a8e-e751-43d2-812f-e11c16af46d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.734601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d7a8e-e751-43d2-812f-e11c16af46d6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.743860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c3dd9-e26e-4ce1-981b-968bc2fb0757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.744610 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c3dd9-e26e-4ce1-981b-968bc2fb0757 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.744968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c3dd9-e26e-4ce1-981b-968bc2fb0757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.745346 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c3dd9-e26e-4ce1-981b-968bc2fb0757 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.745704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 782/1581] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:10.746274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c3dd9-e26e-4ce1-981b-968bc2fb0757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.747732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d7a8e-e751-43d2-812f-e11c16af46d6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.748375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c3dd9-e26e-4ce1-981b-968bc2fb0757 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.758535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d7a8e-e751-43d2-812f-e11c16af46d6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.762683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 800/1582] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:10.762683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c3dd9-e26e-4ce1-981b-968bc2fb0757 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.766149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f039e-0d05-4f1e-8974-bc66574850c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.766892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f039e-0d05-4f1e-8974-bc66574850c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.767175 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f039e-0d05-4f1e-8974-bc66574850c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.767455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f039e-0d05-4f1e-8974-bc66574850c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.768327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f039e-0d05-4f1e-8974-bc66574850c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.770249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f039e-0d05-4f1e-8974-bc66574850c7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.770649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c3dd9-e26e-4ce1-981b-968bc2fb0757 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.775138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8689-eb20-401b-baaa-2e28375fb8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.776023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8689-eb20-401b-baaa-2e28375fb8fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.776308 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8689-eb20-401b-baaa-2e28375fb8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.776589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8689-eb20-401b-baaa-2e28375fb8fc admin admin] PATH_INFO: `/v3/projects/d1a4467fae7e4bdea5a1e00c0379c326/users/de0dccd8f960443894a99baa79198005/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.788565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:10.789781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:10.793184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd8689-eb20-401b-baaa-2e28375fb8fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a4467fae7e4bdea5a1e00c0379c326, user_id=de0dccd8f960443894a99baa79198005, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.794713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: WARNING py.warnings [None req-7dfd8689-eb20-401b-baaa-2e28375fb8fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:15:10.794713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: warnings.warn(msg) Jun 21 08:15:10.794713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: Jun 21 08:15:10.795202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 783/1583] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/users => generated 302 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.796453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f039e-0d05-4f1e-8974-bc66574850c7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.797299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd8689-eb20-401b-baaa-2e28375fb8fc admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.808708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f039e-0d05-4f1e-8974-bc66574850c7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.813453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 801/1584] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:10 2022] PUT /identity/v3/projects/d1a4467fae7e4bdea5a1e00c0379c326/users/de0dccd8f960443894a99baa79198005/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:10.814342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8689-eb20-401b-baaa-2e28375fb8fc admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.867627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7361d0-f54b-42a4-97ae-b43de185ffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.868292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7361d0-f54b-42a4-97ae-b43de185ffb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.868573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7361d0-f54b-42a4-97ae-b43de185ffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.868873 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7361d0-f54b-42a4-97ae-b43de185ffb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.869587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7361d0-f54b-42a4-97ae-b43de185ffb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.871223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7361d0-f54b-42a4-97ae-b43de185ffb3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.876290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8689-eb20-401b-baaa-2e28375fb8fc admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.880894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe85360-6682-455e-bc7f-df278e0441b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.881290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 784/1585] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:10.882191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7361d0-f54b-42a4-97ae-b43de185ffb3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.883152 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe85360-6682-455e-bc7f-df278e0441b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.883545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe85360-6682-455e-bc7f-df278e0441b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.884077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe85360-6682-455e-bc7f-df278e0441b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.884926 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe85360-6682-455e-bc7f-df278e0441b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.886715 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe85360-6682-455e-bc7f-df278e0441b3 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.891696 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7361d0-f54b-42a4-97ae-b43de185ffb3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.896760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e2d13-1a47-4d11-8f6e-554fac102149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.897413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e2d13-1a47-4d11-8f6e-554fac102149 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.900742 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 802/1586] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:10.900874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e2d13-1a47-4d11-8f6e-554fac102149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.900874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e2d13-1a47-4d11-8f6e-554fac102149 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.901017 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe85360-6682-455e-bc7f-df278e0441b3 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.901116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e2d13-1a47-4d11-8f6e-554fac102149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.901116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e2d13-1a47-4d11-8f6e-554fac102149 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.908209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe85360-6682-455e-bc7f-df278e0441b3 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.914210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99083e-2677-4a88-9be1-8d4003286889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.914883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99083e-2677-4a88-9be1-8d4003286889 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.915170 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99083e-2677-4a88-9be1-8d4003286889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.915488 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99083e-2677-4a88-9be1-8d4003286889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.916335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99083e-2677-4a88-9be1-8d4003286889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.917917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99083e-2677-4a88-9be1-8d4003286889 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.924610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 785/1587] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:10.924610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e2d13-1a47-4d11-8f6e-554fac102149 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.932821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 803/1588] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:10.932821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99083e-2677-4a88-9be1-8d4003286889 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.934140 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e2d13-1a47-4d11-8f6e-554fac102149 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.940194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba428701-5cf1-4ffa-b7ee-bfc9a39d425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.940859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba428701-5cf1-4ffa-b7ee-bfc9a39d425c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.940981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99083e-2677-4a88-9be1-8d4003286889 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.941141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba428701-5cf1-4ffa-b7ee-bfc9a39d425c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.941421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba428701-5cf1-4ffa-b7ee-bfc9a39d425c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.942147 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba428701-5cf1-4ffa-b7ee-bfc9a39d425c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.943801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba428701-5cf1-4ffa-b7ee-bfc9a39d425c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.945640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e52c7-706b-422f-a863-e38599bb1bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.946277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e52c7-706b-422f-a863-e38599bb1bec admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.946553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e52c7-706b-422f-a863-e38599bb1bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.946854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e52c7-706b-422f-a863-e38599bb1bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.947564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e52c7-706b-422f-a863-e38599bb1bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.949122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e52c7-706b-422f-a863-e38599bb1bec admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.954776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 786/1589] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:10.957665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba428701-5cf1-4ffa-b7ee-bfc9a39d425c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.961956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 804/1590] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:10.963845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8240b-ce78-4e03-b80c-e9abcd5fb5db None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.964415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8240b-ce78-4e03-b80c-e9abcd5fb5db None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.964864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8240b-ce78-4e03-b80c-e9abcd5fb5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.967280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba428701-5cf1-4ffa-b7ee-bfc9a39d425c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:10.972382 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb5f9-4459-42c2-b655-dda435e2d161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:10.973162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb5f9-4459-42c2-b655-dda435e2d161 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:10.973442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb5f9-4459-42c2-b655-dda435e2d161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:10.973716 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb5f9-4459-42c2-b655-dda435e2d161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:10.974445 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeb5f9-4459-42c2-b655-dda435e2d161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:10.976182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeb5f9-4459-42c2-b655-dda435e2d161 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:10.982855 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-afd8240b-ce78-4e03-b80c-e9abcd5fb5db None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:10.984241 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-afd8240b-ce78-4e03-b80c-e9abcd5fb5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:10.986421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 787/1591] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:10.987881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb5f9-4459-42c2-b655-dda435e2d161 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:10.995383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 805/1592] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:10.996188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8240b-ce78-4e03-b80c-e9abcd5fb5db None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.003566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb5f9-4459-42c2-b655-dda435e2d161 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.006306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8240b-ce78-4e03-b80c-e9abcd5fb5db None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.008404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2bdae-8244-44d0-8a3b-80451f8b3dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.009184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2bdae-8244-44d0-8a3b-80451f8b3dea admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.009471 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2bdae-8244-44d0-8a3b-80451f8b3dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.009760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2bdae-8244-44d0-8a3b-80451f8b3dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.010462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2bdae-8244-44d0-8a3b-80451f8b3dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.011160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c927038-df94-406e-a436-485d1997a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.011806 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c927038-df94-406e-a436-485d1997a90a admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.012088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2bdae-8244-44d0-8a3b-80451f8b3dea admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.012186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c927038-df94-406e-a436-485d1997a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.012366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c927038-df94-406e-a436-485d1997a90a admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.013247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c927038-df94-406e-a436-485d1997a90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.014871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c927038-df94-406e-a436-485d1997a90a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.023159 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 788/1593] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:11.023965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2bdae-8244-44d0-8a3b-80451f8b3dea admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.028626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 806/1594] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:11.029454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c927038-df94-406e-a436-485d1997a90a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.034405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2bdae-8244-44d0-8a3b-80451f8b3dea admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.039165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d478199-1589-4c38-b2e9-f903e2fda47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.039799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d478199-1589-4c38-b2e9-f903e2fda47c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.040079 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d478199-1589-4c38-b2e9-f903e2fda47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.040181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c927038-df94-406e-a436-485d1997a90a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.040350 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d478199-1589-4c38-b2e9-f903e2fda47c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.041058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d478199-1589-4c38-b2e9-f903e2fda47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.042638 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d478199-1589-4c38-b2e9-f903e2fda47c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.044785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df33b8-f722-403c-9cdb-a56e16c64541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.045642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df33b8-f722-403c-9cdb-a56e16c64541 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.045928 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df33b8-f722-403c-9cdb-a56e16c64541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.046336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df33b8-f722-403c-9cdb-a56e16c64541 admin admin] PATH_INFO: `/v3/projects/2001b029fae0472d8ef7b6fd658ad191/users/771f36afce0a4dd8897bb22f3c330856/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.052870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 789/1595] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:11.053639 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d478199-1589-4c38-b2e9-f903e2fda47c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.061375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df33b8-f722-403c-9cdb-a56e16c64541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2001b029fae0472d8ef7b6fd658ad191, user_id=771f36afce0a4dd8897bb22f3c330856, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.064047 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df33b8-f722-403c-9cdb-a56e16c64541 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.064881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d478199-1589-4c38-b2e9-f903e2fda47c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.070174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca844ec-9061-4f2a-8874-e9d68d3f58b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.071249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca844ec-9061-4f2a-8874-e9d68d3f58b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.071530 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca844ec-9061-4f2a-8874-e9d68d3f58b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.071803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca844ec-9061-4f2a-8874-e9d68d3f58b0 admin admin] PATH_INFO: `/v3/projects/a235e9eab43a43458f243023c91a1e7c/users/406f6696b0dc480dbe345d3b2037a532/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.083274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 807/1596] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:11 2022] PUT /identity/v3/projects/2001b029fae0472d8ef7b6fd658ad191/users/771f36afce0a4dd8897bb22f3c330856/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:11.083274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df33b8-f722-403c-9cdb-a56e16c64541 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.091260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca844ec-9061-4f2a-8874-e9d68d3f58b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a235e9eab43a43458f243023c91a1e7c, user_id=406f6696b0dc480dbe345d3b2037a532, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.094101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca844ec-9061-4f2a-8874-e9d68d3f58b0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.110283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 790/1597] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:11 2022] PUT /identity/v3/projects/a235e9eab43a43458f243023c91a1e7c/users/406f6696b0dc480dbe345d3b2037a532/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:11.111183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca844ec-9061-4f2a-8874-e9d68d3f58b0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.144385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df33b8-f722-403c-9cdb-a56e16c64541 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.173504 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca844ec-9061-4f2a-8874-e9d68d3f58b0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.173709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:11.178666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224a298-888e-4670-b662-89736fb52617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.179484 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224a298-888e-4670-b662-89736fb52617 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.179889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224a298-888e-4670-b662-89736fb52617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.180173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224a298-888e-4670-b662-89736fb52617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.180899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224a298-888e-4670-b662-89736fb52617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.182497 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224a298-888e-4670-b662-89736fb52617 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.192636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 791/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:11.193465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224a298-888e-4670-b662-89736fb52617 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.202217 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:11.206201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f086a-5440-4858-856e-ab33a457cf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.207408 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f086a-5440-4858-856e-ab33a457cf1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.207692 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f086a-5440-4858-856e-ab33a457cf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.207971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f086a-5440-4858-856e-ab33a457cf1a admin admin] PATH_INFO: `/v3/projects/6f60bd09c67c4a3ba0f96d5367a3cd76/users/cf94ea4bbf414d2d89cfe3c232f2a54b/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.222934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f086a-5440-4858-856e-ab33a457cf1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f60bd09c67c4a3ba0f96d5367a3cd76, user_id=cf94ea4bbf414d2d89cfe3c232f2a54b, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.225600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f086a-5440-4858-856e-ab33a457cf1a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.238662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 808/1599] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:11 2022] PUT /identity/v3/projects/6f60bd09c67c4a3ba0f96d5367a3cd76/users/cf94ea4bbf414d2d89cfe3c232f2a54b/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:11.239309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f086a-5440-4858-856e-ab33a457cf1a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.254365 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224a298-888e-4670-b662-89736fb52617 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.303792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f086a-5440-4858-856e-ab33a457cf1a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.304468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539b1c2-0aac-4f2c-b5cf-bc2f356c9d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.305114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539b1c2-0aac-4f2c-b5cf-bc2f356c9d1b service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.305403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539b1c2-0aac-4f2c-b5cf-bc2f356c9d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.305675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539b1c2-0aac-4f2c-b5cf-bc2f356c9d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.308865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c77d2-e87a-4df4-8e40-55496be3204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.309960 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c77d2-e87a-4df4-8e40-55496be3204d admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.310288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c77d2-e87a-4df4-8e40-55496be3204d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.310645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c77d2-e87a-4df4-8e40-55496be3204d admin admin] PATH_INFO: `/v3/projects/9c4b18684de44714b4a54442a17720b7/users/62c0039007d641c0aedaa781acaa0abe/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.316387 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539b1c2-0aac-4f2c-b5cf-bc2f356c9d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.317834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539b1c2-0aac-4f2c-b5cf-bc2f356c9d1b service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.326833 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c77d2-e87a-4df4-8e40-55496be3204d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4b18684de44714b4a54442a17720b7, user_id=62c0039007d641c0aedaa781acaa0abe, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.327453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 792/1600] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:11.328226 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539b1c2-0aac-4f2c-b5cf-bc2f356c9d1b service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.329586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c77d2-e87a-4df4-8e40-55496be3204d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.340215 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539b1c2-0aac-4f2c-b5cf-bc2f356c9d1b service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.350987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 809/1601] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:11 2022] PUT /identity/v3/projects/9c4b18684de44714b4a54442a17720b7/users/62c0039007d641c0aedaa781acaa0abe/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:11.350987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c77d2-e87a-4df4-8e40-55496be3204d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.404898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fa409-dca6-4cbf-a8f6-bb2ddf17591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.405958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa409-dca6-4cbf-a8f6-bb2ddf17591d admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.406324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa409-dca6-4cbf-a8f6-bb2ddf17591d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.406706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa409-dca6-4cbf-a8f6-bb2ddf17591d admin admin] PATH_INFO: `/v3/projects/c417067db38c48af9a0f27065b2b690e/users/17536335f4bc45b88471bae149f66ec4/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.425406 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fa409-dca6-4cbf-a8f6-bb2ddf17591d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c417067db38c48af9a0f27065b2b690e, user_id=17536335f4bc45b88471bae149f66ec4, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.426999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c77d2-e87a-4df4-8e40-55496be3204d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.428458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fa409-dca6-4cbf-a8f6-bb2ddf17591d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.432904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb50ad-9fb9-4d48-8f96-8a8744865d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.433802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb50ad-9fb9-4d48-8f96-8a8744865d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.434158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb50ad-9fb9-4d48-8f96-8a8744865d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.434468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb50ad-9fb9-4d48-8f96-8a8744865d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.435446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb50ad-9fb9-4d48-8f96-8a8744865d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.437268 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb50ad-9fb9-4d48-8f96-8a8744865d8c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.445315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 793/1602] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:11 2022] PUT /identity/v3/projects/c417067db38c48af9a0f27065b2b690e/users/17536335f4bc45b88471bae149f66ec4/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:11.446931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34197056-d186-4394-8f71-5ae897a28449 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.447286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34197056-d186-4394-8f71-5ae897a28449 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.447675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34197056-d186-4394-8f71-5ae897a28449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.450734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 810/1603] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:11.450734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22622-d4e4-4f89-b68a-ad930e3e2b62 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.450734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22622-d4e4-4f89-b68a-ad930e3e2b62 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.450734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22622-d4e4-4f89-b68a-ad930e3e2b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.473096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-34197056-d186-4394-8f71-5ae897a28449 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:11.474801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-34197056-d186-4394-8f71-5ae897a28449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:11.483778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-9ea22622-d4e4-4f89-b68a-ad930e3e2b62 None None] MFA Rules not processed for user `406f6696b0dc480dbe345d3b2037a532`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:11.485017 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9ea22622-d4e4-4f89-b68a-ad930e3e2b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:11.510228 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:11.531093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:11.562479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 794/1604] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:11.568422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 811/1605] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:11.568422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea22622-d4e4-4f89-b68a-ad930e3e2b62 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.575391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866dbd7-ce35-4ee6-84cc-999f83296475 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.575691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866dbd7-ce35-4ee6-84cc-999f83296475 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.575958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866dbd7-ce35-4ee6-84cc-999f83296475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.580212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea22622-d4e4-4f89-b68a-ad930e3e2b62 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.587315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b5ed-609c-41e4-8154-99fad32577ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.588219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b5ed-609c-41e4-8154-99fad32577ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.588503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b5ed-609c-41e4-8154-99fad32577ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.589033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b5ed-609c-41e4-8154-99fad32577ad admin admin] PATH_INFO: `/v3/projects/7e65c052cb7742628817e3dd44666cf5/users/ad4eb1d214804f3b93d460d921e1125e/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.595223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f866dbd7-ce35-4ee6-84cc-999f83296475 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:11.596583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f866dbd7-ce35-4ee6-84cc-999f83296475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:11.605713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 795/1606] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:11.605864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1b5ed-609c-41e4-8154-99fad32577ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e65c052cb7742628817e3dd44666cf5, user_id=ad4eb1d214804f3b93d460d921e1125e, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.607347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b191e3-e9bb-4efd-99f3-c15c1213ea8e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.607784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b191e3-e9bb-4efd-99f3-c15c1213ea8e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.608075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b191e3-e9bb-4efd-99f3-c15c1213ea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.608566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1b5ed-609c-41e4-8154-99fad32577ad admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.624648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 812/1607] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:11 2022] PUT /identity/v3/projects/7e65c052cb7742628817e3dd44666cf5/users/ad4eb1d214804f3b93d460d921e1125e/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:11.625487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b5ed-609c-41e4-8154-99fad32577ad admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.632384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-94b191e3-e9bb-4efd-99f3-c15c1213ea8e None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:11.634341 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-94b191e3-e9bb-4efd-99f3-c15c1213ea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:11.704143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 796/1608] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:11.705076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b5ed-609c-41e4-8154-99fad32577ad admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.708742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607d94a-e7d0-4514-8a82-d2f4512804c9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.709201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607d94a-e7d0-4514-8a82-d2f4512804c9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.709725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607d94a-e7d0-4514-8a82-d2f4512804c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.716975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8652d2-9fb8-419f-a0c0-41054762296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.717893 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8652d2-9fb8-419f-a0c0-41054762296c admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.718183 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8652d2-9fb8-419f-a0c0-41054762296c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.718462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8652d2-9fb8-419f-a0c0-41054762296c admin admin] PATH_INFO: `/v3/projects/15e7f6df0b254eeb8eb345de7c40d6ac/users/ad9ade555e804778a014b565d8133205/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.736636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8652d2-9fb8-419f-a0c0-41054762296c admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e7f6df0b254eeb8eb345de7c40d6ac, user_id=ad9ade555e804778a014b565d8133205, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.740770 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8652d2-9fb8-419f-a0c0-41054762296c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.746838 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0607d94a-e7d0-4514-8a82-d2f4512804c9 None None] MFA Rules not processed for user `17536335f4bc45b88471bae149f66ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:11.748920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0607d94a-e7d0-4514-8a82-d2f4512804c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:11.761135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 813/1609] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:11 2022] PUT /identity/v3/projects/15e7f6df0b254eeb8eb345de7c40d6ac/users/ad9ade555e804778a014b565d8133205/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:11.773248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8652d2-9fb8-419f-a0c0-41054762296c admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.829625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 797/1610] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:11.831578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607d94a-e7d0-4514-8a82-d2f4512804c9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.832923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0607d94a-e7d0-4514-8a82-d2f4512804c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:11.857656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8652d2-9fb8-419f-a0c0-41054762296c admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.863165 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e572a-7f9f-4cd7-bacc-89fc841d773d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.863824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e572a-7f9f-4cd7-bacc-89fc841d773d admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.864163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e572a-7f9f-4cd7-bacc-89fc841d773d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.864446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e572a-7f9f-4cd7-bacc-89fc841d773d admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.865142 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e572a-7f9f-4cd7-bacc-89fc841d773d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:11.867093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e572a-7f9f-4cd7-bacc-89fc841d773d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:11.898759 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 814/1611] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:11 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:11.899879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e572a-7f9f-4cd7-bacc-89fc841d773d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:11.900035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607d94a-e7d0-4514-8a82-d2f4512804c9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.910473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:11.929556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:11.957352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35683e0c-f70a-4a41-bf2a-e1f8cfb64e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.958006 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683e0c-f70a-4a41-bf2a-e1f8cfb64e7a service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.958435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683e0c-f70a-4a41-bf2a-e1f8cfb64e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.958739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683e0c-f70a-4a41-bf2a-e1f8cfb64e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:11.971242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e572a-7f9f-4cd7-bacc-89fc841d773d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:11.975752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efe3ed-be9d-4aa2-b5ce-911d437b8499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:11.977302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efe3ed-be9d-4aa2-b5ce-911d437b8499 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:11.977302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efe3ed-be9d-4aa2-b5ce-911d437b8499 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:11.977302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efe3ed-be9d-4aa2-b5ce-911d437b8499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.029691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35683e0c-f70a-4a41-bf2a-e1f8cfb64e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.031263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35683e0c-f70a-4a41-bf2a-e1f8cfb64e7a service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.042868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 798/1612] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:12.044252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf31242-2f77-4936-82a7-5fca17ad1da7 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.044604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf31242-2f77-4936-82a7-5fca17ad1da7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.044885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf31242-2f77-4936-82a7-5fca17ad1da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.072065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6cf31242-2f77-4936-82a7-5fca17ad1da7 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:12.073370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6cf31242-2f77-4936-82a7-5fca17ad1da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:12.086776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 799/1613] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:12.087715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf31242-2f77-4936-82a7-5fca17ad1da7 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.091544 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efe3ed-be9d-4aa2-b5ce-911d437b8499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.093046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efe3ed-be9d-4aa2-b5ce-911d437b8499 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.102122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf31242-2f77-4936-82a7-5fca17ad1da7 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.107185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e080d6-74da-4b41-aa97-a5bca2acf32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.107938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e080d6-74da-4b41-aa97-a5bca2acf32c service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.108272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e080d6-74da-4b41-aa97-a5bca2acf32c service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.108661 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e080d6-74da-4b41-aa97-a5bca2acf32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.122199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e080d6-74da-4b41-aa97-a5bca2acf32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.124158 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e080d6-74da-4b41-aa97-a5bca2acf32c service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.129256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 815/1614] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:12.132950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd05df-e8cf-4ba7-8e9a-6b6eb4fca8c2 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.134361 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd05df-e8cf-4ba7-8e9a-6b6eb4fca8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.134897 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd05df-e8cf-4ba7-8e9a-6b6eb4fca8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.137190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 800/1615] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:12.138072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e080d6-74da-4b41-aa97-a5bca2acf32c service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.152771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e080d6-74da-4b41-aa97-a5bca2acf32c service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.160139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70b48f-6c1f-46b0-86f3-731c948428ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.161585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70b48f-6c1f-46b0-86f3-731c948428ec admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.161876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70b48f-6c1f-46b0-86f3-731c948428ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.162173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70b48f-6c1f-46b0-86f3-731c948428ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.162892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70b48f-6c1f-46b0-86f3-731c948428ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.165490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70b48f-6c1f-46b0-86f3-731c948428ec admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.183835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-42cd05df-e8cf-4ba7-8e9a-6b6eb4fca8c2 None None] MFA Rules not processed for user `ad9ade555e804778a014b565d8133205`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:12.185460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-42cd05df-e8cf-4ba7-8e9a-6b6eb4fca8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:12.202085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 801/1616] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:12 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:12.203066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70b48f-6c1f-46b0-86f3-731c948428ec admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.307792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70b48f-6c1f-46b0-86f3-731c948428ec admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.312898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 816/1617] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:12.315762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa96963-deb6-4703-b8f4-677c6ec2eb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.316800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa96963-deb6-4703-b8f4-677c6ec2eb0d admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.317670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa96963-deb6-4703-b8f4-677c6ec2eb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.318054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa96963-deb6-4703-b8f4-677c6ec2eb0d admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.318945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa96963-deb6-4703-b8f4-677c6ec2eb0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.320001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd05df-e8cf-4ba7-8e9a-6b6eb4fca8c2 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.321420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa96963-deb6-4703-b8f4-677c6ec2eb0d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.347139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd05df-e8cf-4ba7-8e9a-6b6eb4fca8c2 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.353536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 802/1618] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:12 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:12.354681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa96963-deb6-4703-b8f4-677c6ec2eb0d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.377018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa96963-deb6-4703-b8f4-677c6ec2eb0d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.386819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edd1a3-1c94-4683-890f-a3d76e47a6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.388315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edd1a3-1c94-4683-890f-a3d76e47a6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.388927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edd1a3-1c94-4683-890f-a3d76e47a6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.389076 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edd1a3-1c94-4683-890f-a3d76e47a6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.390368 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edd1a3-1c94-4683-890f-a3d76e47a6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.394452 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edd1a3-1c94-4683-890f-a3d76e47a6a2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.430585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 803/1619] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:12 2022] POST /identity/v3/users => generated 309 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:12.431644 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edd1a3-1c94-4683-890f-a3d76e47a6a2 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.452008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:12.456566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:12.458132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b734184-6f36-4d35-bff3-9c4db9dfb42e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.458848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b734184-6f36-4d35-bff3-9c4db9dfb42e service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.459486 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b734184-6f36-4d35-bff3-9c4db9dfb42e service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.459771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b734184-6f36-4d35-bff3-9c4db9dfb42e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.479833 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b734184-6f36-4d35-bff3-9c4db9dfb42e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.483299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b734184-6f36-4d35-bff3-9c4db9dfb42e service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.507626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 817/1620] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:12.510349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b734184-6f36-4d35-bff3-9c4db9dfb42e service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.526438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edd1a3-1c94-4683-890f-a3d76e47a6a2 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.529223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b734184-6f36-4d35-bff3-9c4db9dfb42e service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.531006 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb0625-f153-4c57-a3e9-e9aaafb8bfc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.532191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb0625-f153-4c57-a3e9-e9aaafb8bfc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.532587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb0625-f153-4c57-a3e9-e9aaafb8bfc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.532965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb0625-f153-4c57-a3e9-e9aaafb8bfc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.547379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67e7c8-d006-43f9-8951-f59e6e68210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.548067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67e7c8-d006-43f9-8951-f59e6e68210b admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.548353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67e7c8-d006-43f9-8951-f59e6e68210b admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.548630 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67e7c8-d006-43f9-8951-f59e6e68210b admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.549879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67e7c8-d006-43f9-8951-f59e6e68210b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.551636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67e7c8-d006-43f9-8951-f59e6e68210b admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.573140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 818/1621] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:12.574053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67e7c8-d006-43f9-8951-f59e6e68210b admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.594396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67e7c8-d006-43f9-8951-f59e6e68210b admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.610156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e60ef8-9693-415b-8fc7-472aea505bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.610871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60ef8-9693-415b-8fc7-472aea505bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.611158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60ef8-9693-415b-8fc7-472aea505bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.611438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e60ef8-9693-415b-8fc7-472aea505bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.612718 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e60ef8-9693-415b-8fc7-472aea505bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.614465 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e60ef8-9693-415b-8fc7-472aea505bd4 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.623766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb0625-f153-4c57-a3e9-e9aaafb8bfc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.625368 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb0625-f153-4c57-a3e9-e9aaafb8bfc8 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.636545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 804/1622] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:12.637708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb0625-f153-4c57-a3e9-e9aaafb8bfc8 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.644605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 819/1623] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:12.651990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e60ef8-9693-415b-8fc7-472aea505bd4 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.656470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb0625-f153-4c57-a3e9-e9aaafb8bfc8 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.665756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0cf2a-886f-4483-968e-a0e1d458970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.666732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e60ef8-9693-415b-8fc7-472aea505bd4 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.668653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0cf2a-886f-4483-968e-a0e1d458970b admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.669185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0cf2a-886f-4483-968e-a0e1d458970b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.670980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0cf2a-886f-4483-968e-a0e1d458970b admin admin] PATH_INFO: `/v3/projects/5956b7dd38774cecb49ac02d0320cb6d/users/a8a0920ed0f4436695bce3f2a022530b/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.674892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446152-074f-4fce-888f-9cf5d6b214de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.676998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446152-074f-4fce-888f-9cf5d6b214de admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.678551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446152-074f-4fce-888f-9cf5d6b214de admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.678965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446152-074f-4fce-888f-9cf5d6b214de admin admin] PATH_INFO: `/v3/projects/fcf3e4684b5b4391a990265a17b28055/users/b04fbba804804f27bcf1de28110b5f77/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.709621 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0cf2a-886f-4483-968e-a0e1d458970b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5956b7dd38774cecb49ac02d0320cb6d, user_id=a8a0920ed0f4436695bce3f2a022530b, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.712701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0cf2a-886f-4483-968e-a0e1d458970b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.725000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17446152-074f-4fce-888f-9cf5d6b214de admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf3e4684b5b4391a990265a17b28055, user_id=b04fbba804804f27bcf1de28110b5f77, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.728074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17446152-074f-4fce-888f-9cf5d6b214de admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.740889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 805/1624] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:12 2022] PUT /identity/v3/projects/5956b7dd38774cecb49ac02d0320cb6d/users/a8a0920ed0f4436695bce3f2a022530b/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:12.745229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0cf2a-886f-4483-968e-a0e1d458970b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.771858 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 820/1625] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:12 2022] PUT /identity/v3/projects/fcf3e4684b5b4391a990265a17b28055/users/b04fbba804804f27bcf1de28110b5f77/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:12.774036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446152-074f-4fce-888f-9cf5d6b214de admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.893755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0cf2a-886f-4483-968e-a0e1d458970b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.945523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446152-074f-4fce-888f-9cf5d6b214de admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.950575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e7b47-fef9-41e8-a6a1-b95e83873b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.951472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e7b47-fef9-41e8-a6a1-b95e83873b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.951754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e7b47-fef9-41e8-a6a1-b95e83873b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.952200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e7b47-fef9-41e8-a6a1-b95e83873b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.952933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e7b47-fef9-41e8-a6a1-b95e83873b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.953236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:12.954760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e7b47-fef9-41e8-a6a1-b95e83873b0a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.972665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 821/1626] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:15:12.973640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e7b47-fef9-41e8-a6a1-b95e83873b0a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:12.976173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccb990-df41-4aeb-897d-e45cc9d13023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.978035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccb990-df41-4aeb-897d-e45cc9d13023 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.978426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccb990-df41-4aeb-897d-e45cc9d13023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.978932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccb990-df41-4aeb-897d-e45cc9d13023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.979985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccb990-df41-4aeb-897d-e45cc9d13023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.983787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccb990-df41-4aeb-897d-e45cc9d13023 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:12.985009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e7b47-fef9-41e8-a6a1-b95e83873b0a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:12.992531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20acdc-17df-4cb5-a337-b00bfb7e6a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:12.993656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20acdc-17df-4cb5-a337-b00bfb7e6a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:12.993939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20acdc-17df-4cb5-a337-b00bfb7e6a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:12.994208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20acdc-17df-4cb5-a337-b00bfb7e6a68 admin admin] PATH_INFO: `/v3/projects/fcf3e4684b5b4391a990265a17b28055/users/b04fbba804804f27bcf1de28110b5f77/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:12.996320 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20acdc-17df-4cb5-a337-b00bfb7e6a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf3e4684b5b4391a990265a17b28055, user_id=b04fbba804804f27bcf1de28110b5f77, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:12.999934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20acdc-17df-4cb5-a337-b00bfb7e6a68 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:13.012682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 806/1627] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:13.013812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccb990-df41-4aeb-897d-e45cc9d13023 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:13.031069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccb990-df41-4aeb-897d-e45cc9d13023 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:13.036072 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 822/1628] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:12 2022] PUT /identity/v3/projects/fcf3e4684b5b4391a990265a17b28055/users/b04fbba804804f27bcf1de28110b5f77/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:13.040493 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449133-d6b0-43c4-8a61-fa70fe6b1180 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:13.040779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449133-d6b0-43c4-8a61-fa70fe6b1180 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:13.041108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449133-d6b0-43c4-8a61-fa70fe6b1180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:13.110966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ce449133-d6b0-43c4-8a61-fa70fe6b1180 None None] MFA Rules not processed for user `b04fbba804804f27bcf1de28110b5f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:13.113911 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ce449133-d6b0-43c4-8a61-fa70fe6b1180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:13.128933 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079d3fc-057c-4603-a48f-639ad27eb13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:13.129736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079d3fc-057c-4603-a48f-639ad27eb13d admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:13.130343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079d3fc-057c-4603-a48f-639ad27eb13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:13.130882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079d3fc-057c-4603-a48f-639ad27eb13d admin admin] PATH_INFO: `/v3/projects/5956b7dd38774cecb49ac02d0320cb6d/users/a8a0920ed0f4436695bce3f2a022530b/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:13.133205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079d3fc-057c-4603-a48f-639ad27eb13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5956b7dd38774cecb49ac02d0320cb6d, user_id=a8a0920ed0f4436695bce3f2a022530b, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:13.137156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079d3fc-057c-4603-a48f-639ad27eb13d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:13.167726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 807/1629] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:13 2022] PUT /identity/v3/projects/5956b7dd38774cecb49ac02d0320cb6d/users/a8a0920ed0f4436695bce3f2a022530b/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:13.169428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753726ba-8289-4e9b-baf8-2492c63b12c6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:13.170888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753726ba-8289-4e9b-baf8-2492c63b12c6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:13.171696 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753726ba-8289-4e9b-baf8-2492c63b12c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:13.219962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-753726ba-8289-4e9b-baf8-2492c63b12c6 None None] MFA Rules not processed for user `a8a0920ed0f4436695bce3f2a022530b`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:13.221549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-753726ba-8289-4e9b-baf8-2492c63b12c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:13.267952 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 823/1630] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:13.283795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449133-d6b0-43c4-8a61-fa70fe6b1180 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:13.312378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:13.335252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 808/1631] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:13.400296 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449133-d6b0-43c4-8a61-fa70fe6b1180 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:13.478717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd934-b7b1-4d8a-860f-b8f998e3a04f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:13.479941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd934-b7b1-4d8a-860f-b8f998e3a04f service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:13.480064 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd934-b7b1-4d8a-860f-b8f998e3a04f service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:13.480435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd934-b7b1-4d8a-860f-b8f998e3a04f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:13.504060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753726ba-8289-4e9b-baf8-2492c63b12c6 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:13.518864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753726ba-8289-4e9b-baf8-2492c63b12c6 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:13.527913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad3b47-7ba4-48bf-86d2-6fd3969d13ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:13.528579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad3b47-7ba4-48bf-86d2-6fd3969d13ff service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:13.528863 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad3b47-7ba4-48bf-86d2-6fd3969d13ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:13.529142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad3b47-7ba4-48bf-86d2-6fd3969d13ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:13.549682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad3b47-7ba4-48bf-86d2-6fd3969d13ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:13.555635 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad3b47-7ba4-48bf-86d2-6fd3969d13ff service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:13.606883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 809/1632] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:15:13.644793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd934-b7b1-4d8a-860f-b8f998e3a04f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:13.646814 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd934-b7b1-4d8a-860f-b8f998e3a04f service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:13.667886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 824/1633] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:13 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:13.860665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad3b47-7ba4-48bf-86d2-6fd3969d13ff service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:13.860665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad3b47-7ba4-48bf-86d2-6fd3969d13ff service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:13.860665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b354ed7-47b4-47ff-bf04-256f2e2da439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:13.860665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b354ed7-47b4-47ff-bf04-256f2e2da439 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:13.873682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b354ed7-47b4-47ff-bf04-256f2e2da439 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:13.873682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b354ed7-47b4-47ff-bf04-256f2e2da439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:13.936556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:13.968711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b354ed7-47b4-47ff-bf04-256f2e2da439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:13.971119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b354ed7-47b4-47ff-bf04-256f2e2da439 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:14.003752 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 810/1634] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:14.125163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd934-b7b1-4d8a-860f-b8f998e3a04f service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:14.224280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487310-049d-4704-8710-af10d65058a8 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:14.224614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487310-049d-4704-8710-af10d65058a8 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:14.224848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487310-049d-4704-8710-af10d65058a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:14.277899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd934-b7b1-4d8a-860f-b8f998e3a04f service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:14.284833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-bd487310-049d-4704-8710-af10d65058a8 None None] MFA Rules not processed for user `ad4eb1d214804f3b93d460d921e1125e`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:14.286084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-bd487310-049d-4704-8710-af10d65058a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:14.288241 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c84d69-7a1e-4bf7-8526-666229ce4751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:14.292835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c84d69-7a1e-4bf7-8526-666229ce4751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:14.294414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c84d69-7a1e-4bf7-8526-666229ce4751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:14.295241 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c84d69-7a1e-4bf7-8526-666229ce4751 admin admin] PATH_INFO: `/v3/users/17536335f4bc45b88471bae149f66ec4` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:14.298528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c84d69-7a1e-4bf7-8526-666229ce4751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17536335f4bc45b88471bae149f66ec4)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:14.300881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: WARNING py.warnings [None req-43c84d69-7a1e-4bf7-8526-666229ce4751 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:15:14.300881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: warnings.warn(msg) Jun 21 08:15:14.300881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: Jun 21 08:15:14.306131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c84d69-7a1e-4bf7-8526-666229ce4751 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:14.420306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:14.508418 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-43c84d69-7a1e-4bf7-8526-666229ce4751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17536335f4bc45b88471bae149f66ec4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:14.522549 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-43c84d69-7a1e-4bf7-8526-666229ce4751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17536335f4bc45b88471bae149f66ec4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:14.524063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-43c84d69-7a1e-4bf7-8526-666229ce4751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17536335f4bc45b88471bae149f66ec4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:14.525106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-43c84d69-7a1e-4bf7-8526-666229ce4751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17536335f4bc45b88471bae149f66ec4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:14.528716 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 811/1635] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:14.531257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd487310-049d-4704-8710-af10d65058a8 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:14.574332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd487310-049d-4704-8710-af10d65058a8 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:14.583405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-43c84d69-7a1e-4bf7-8526-666229ce4751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17536335f4bc45b88471bae149f66ec4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:14.595949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4b595-4387-4df4-99da-71689232b950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:14.598377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b595-4387-4df4-99da-71689232b950 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:14.599485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b595-4387-4df4-99da-71689232b950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:14.600734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4b595-4387-4df4-99da-71689232b950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:14.602536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4b595-4387-4df4-99da-71689232b950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:14.607795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4b595-4387-4df4-99da-71689232b950 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:14.612319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 825/1636] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:14 2022] DELETE /identity/v3/users/17536335f4bc45b88471bae149f66ec4 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:14.614218 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2f3fc-e5b4-456f-8d37-77641bf8d01e None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:14.614632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2f3fc-e5b4-456f-8d37-77641bf8d01e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:14.615044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2f3fc-e5b4-456f-8d37-77641bf8d01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:14.656168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-21c2f3fc-e5b4-456f-8d37-77641bf8d01e None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:14.660072 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-21c2f3fc-e5b4-456f-8d37-77641bf8d01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:14.673917 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 812/1637] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:14 2022] POST /identity/v3/projects => generated 405 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:14.678980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4b595-4387-4df4-99da-71689232b950 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:14.681597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a6e4b595-4387-4df4-99da-71689232b950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:14.786019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4b595-4387-4df4-99da-71689232b950 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:14.788847 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 826/1638] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:14.792554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3f943-77ce-4d9b-b622-e8b0ae2d9c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:14.793439 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3f943-77ce-4d9b-b622-e8b0ae2d9c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:14.793929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3f943-77ce-4d9b-b622-e8b0ae2d9c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:14.794395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3f943-77ce-4d9b-b622-e8b0ae2d9c0c admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:14.795560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3f943-77ce-4d9b-b622-e8b0ae2d9c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:14.798001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2f3fc-e5b4-456f-8d37-77641bf8d01e None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:14.799832 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-21c2f3fc-e5b4-456f-8d37-77641bf8d01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:14.801985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3f943-77ce-4d9b-b622-e8b0ae2d9c0c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:14.844435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 813/1639] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:14 2022] POST /identity/v3/users => generated 309 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:14.845607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3f943-77ce-4d9b-b622-e8b0ae2d9c0c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:14.866798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2f3fc-e5b4-456f-8d37-77641bf8d01e None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:14.872579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3f943-77ce-4d9b-b622-e8b0ae2d9c0c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:14.887089 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628be879-60db-4612-a1f3-bc67e4feb108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:14.887878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628be879-60db-4612-a1f3-bc67e4feb108 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:14.888168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628be879-60db-4612-a1f3-bc67e4feb108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:14.888490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628be879-60db-4612-a1f3-bc67e4feb108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:14.889231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628be879-60db-4612-a1f3-bc67e4feb108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:14.894905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628be879-60db-4612-a1f3-bc67e4feb108 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:14.930083 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 814/1640] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:14.933839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628be879-60db-4612-a1f3-bc67e4feb108 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:14.950553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628be879-60db-4612-a1f3-bc67e4feb108 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:14.957010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62b378-da3d-432b-ba17-c90cedbab7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:14.958118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62b378-da3d-432b-ba17-c90cedbab7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:14.958607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62b378-da3d-432b-ba17-c90cedbab7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:14.959094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62b378-da3d-432b-ba17-c90cedbab7d0 admin admin] PATH_INFO: `/v3/projects/71a1d38491a0458490b0edf534b8a0f7/users/fd8c6893db604598b9e467ecf58c8edb/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:14.983268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62b378-da3d-432b-ba17-c90cedbab7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a1d38491a0458490b0edf534b8a0f7, user_id=fd8c6893db604598b9e467ecf58c8edb, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:14.987071 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62b378-da3d-432b-ba17-c90cedbab7d0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:14.997810 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4229f-1373-4bbf-8261-065ee7f5b06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:15.000172 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4229f-1373-4bbf-8261-065ee7f5b06b service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:15.000414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4229f-1373-4bbf-8261-065ee7f5b06b service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:15.000875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4229f-1373-4bbf-8261-065ee7f5b06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:15.027283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:15.030008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 815/1641] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:14 2022] PUT /identity/v3/projects/71a1d38491a0458490b0edf534b8a0f7/users/fd8c6893db604598b9e467ecf58c8edb/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:15.031717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4229f-1373-4bbf-8261-065ee7f5b06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:15.034164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62b378-da3d-432b-ba17-c90cedbab7d0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:15.045912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4229f-1373-4bbf-8261-065ee7f5b06b service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:15.055208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:15.074757 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 827/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:15.180966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62b378-da3d-432b-ba17-c90cedbab7d0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:15.188287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb12b7-e7e1-4163-b9d8-9738e4e9071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:15.189406 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb12b7-e7e1-4163-b9d8-9738e4e9071d admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:15.190093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb12b7-e7e1-4163-b9d8-9738e4e9071d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:15.190570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb12b7-e7e1-4163-b9d8-9738e4e9071d admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:15.191624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb12b7-e7e1-4163-b9d8-9738e4e9071d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:15.194369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb12b7-e7e1-4163-b9d8-9738e4e9071d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:15.214364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 816/1643] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:15.218407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4229f-1373-4bbf-8261-065ee7f5b06b service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:15.229576 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4229f-1373-4bbf-8261-065ee7f5b06b service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:15.242223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23724b78-7459-49d0-a272-90cb6d116c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:15.244299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724b78-7459-49d0-a272-90cb6d116c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:15.246755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724b78-7459-49d0-a272-90cb6d116c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:15.247068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724b78-7459-49d0-a272-90cb6d116c2a admin admin] PATH_INFO: `/v3/projects/71a1d38491a0458490b0edf534b8a0f7/users/fd8c6893db604598b9e467ecf58c8edb/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:15.249482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23724b78-7459-49d0-a272-90cb6d116c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a1d38491a0458490b0edf534b8a0f7, user_id=fd8c6893db604598b9e467ecf58c8edb, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:15.257477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23724b78-7459-49d0-a272-90cb6d116c2a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:15.285050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 828/1644] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:15 2022] PUT /identity/v3/projects/71a1d38491a0458490b0edf534b8a0f7/users/fd8c6893db604598b9e467ecf58c8edb/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:15.410906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682e31c-cad9-4ff3-9f44-6ad098ce4c56 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:15.411572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682e31c-cad9-4ff3-9f44-6ad098ce4c56 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:15.412194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682e31c-cad9-4ff3-9f44-6ad098ce4c56 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:15.414837 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 817/1645] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jun 21 08:15:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:15:15.426201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a709f-853d-41c1-bd7f-ba42de96bde2 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:15.426902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a709f-853d-41c1-bd7f-ba42de96bde2 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:15.427743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a709f-853d-41c1-bd7f-ba42de96bde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:15.458733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-002a709f-853d-41c1-bd7f-ba42de96bde2 None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:15.460040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-002a709f-853d-41c1-bd7f-ba42de96bde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:15.552406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 829/1646] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jun 21 08:15:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:15:15.554178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd3b39-4554-4bd0-bf7b-f5709f4c309a None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:15.554466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd3b39-4554-4bd0-bf7b-f5709f4c309a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:15.554785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd3b39-4554-4bd0-bf7b-f5709f4c309a None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:15.556889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 818/1647] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jun 21 08:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:15:15.578162 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bcefb-884c-434f-8074-54fcb357023f None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:15.579777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bcefb-884c-434f-8074-54fcb357023f None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:15.580217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bcefb-884c-434f-8074-54fcb357023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:15.615264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-dd1bcefb-884c-434f-8074-54fcb357023f None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:15.618798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-dd1bcefb-884c-434f-8074-54fcb357023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:15.663753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 830/1648] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:15:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:15.671007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd3b39-4554-4bd0-bf7b-f5709f4c309a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:15.675433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b1cd3b39-4554-4bd0-bf7b-f5709f4c309a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:15.852036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd3b39-4554-4bd0-bf7b-f5709f4c309a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:15.873355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bea65-d906-45c4-a518-46b6d6d0b35a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:15.874181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bea65-d906-45c4-a518-46b6d6d0b35a service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:15.874716 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bea65-d906-45c4-a518-46b6d6d0b35a service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:15.875094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bea65-d906-45c4-a518-46b6d6d0b35a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:15.902748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bea65-d906-45c4-a518-46b6d6d0b35a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:15.903298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bea65-d906-45c4-a518-46b6d6d0b35a service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:15.939754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 819/1649] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:16.403417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bcefb-884c-434f-8074-54fcb357023f None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:16.405007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-dd1bcefb-884c-434f-8074-54fcb357023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:16.577082 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bcefb-884c-434f-8074-54fcb357023f None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:16.595240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:16.600153 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:16.602085 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:16.602572 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] PATH_INFO: `/v3/projects/c417067db38c48af9a0f27065b2b690e` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:16.606824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c417067db38c48af9a0f27065b2b690e)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:16.614726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:16.832756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c417067db38c48af9a0f27065b2b690e', 'request_id': 'req-963e3228-507a-47dd-a2d2-eb24f63027a2'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:16.845759 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c417067db38c48af9a0f27065b2b690e', 'request_id': 'req-963e3228-507a-47dd-a2d2-eb24f63027a2'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:16.853718 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c417067db38c48af9a0f27065b2b690e', 'request_id': 'req-963e3228-507a-47dd-a2d2-eb24f63027a2'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:16.864988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:16.871205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] The token cache is being invalidate because project c417067db38c48af9a0f27065b2b690e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:16.871536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:16.872666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:16.879673 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 831/1650] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:16 2022] DELETE /identity/v3/projects/c417067db38c48af9a0f27065b2b690e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:16.881103 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bea65-d906-45c4-a518-46b6d6d0b35a service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:16.898820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bea65-d906-45c4-a518-46b6d6d0b35a service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:17.072568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc7138-2094-4a07-889f-b2377e78d404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:17.074689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc7138-2094-4a07-889f-b2377e78d404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:17.075430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc7138-2094-4a07-889f-b2377e78d404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:17.075948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc7138-2094-4a07-889f-b2377e78d404 admin admin] PATH_INFO: `/v3/users/b04fbba804804f27bcf1de28110b5f77` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:17.077892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc7138-2094-4a07-889f-b2377e78d404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04fbba804804f27bcf1de28110b5f77)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:17.083234 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc7138-2094-4a07-889f-b2377e78d404 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:17.167367 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0bdc7138-2094-4a07-889f-b2377e78d404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04fbba804804f27bcf1de28110b5f77'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:17.172159 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:17.182075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0bdc7138-2094-4a07-889f-b2377e78d404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04fbba804804f27bcf1de28110b5f77'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:17.193251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0bdc7138-2094-4a07-889f-b2377e78d404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04fbba804804f27bcf1de28110b5f77'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:17.193972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0bdc7138-2094-4a07-889f-b2377e78d404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04fbba804804f27bcf1de28110b5f77'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:17.194736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0bdc7138-2094-4a07-889f-b2377e78d404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04fbba804804f27bcf1de28110b5f77'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:17.225196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 820/1651] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:16 2022] DELETE /identity/v3/users/b04fbba804804f27bcf1de28110b5f77 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:18.526028 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:18.531875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:18.574526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e3228-507a-47dd-a2d2-eb24f63027a2 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:18.602458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c41c67-3716-45f5-a4c1-0221c70a7d41 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:18.603554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c41c67-3716-45f5-a4c1-0221c70a7d41 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:18.604010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c41c67-3716-45f5-a4c1-0221c70a7d41 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:18.613143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 821/1652] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jun 21 08:15:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:15:18.620678 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a6944-2f91-4cb0-81c5-f4145bc1f555 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:18.621193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a6944-2f91-4cb0-81c5-f4145bc1f555 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:18.622280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a6944-2f91-4cb0-81c5-f4145bc1f555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:18.688132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c89a6944-2f91-4cb0-81c5-f4145bc1f555 None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:18.689791 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c89a6944-2f91-4cb0-81c5-f4145bc1f555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:18.833402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf9f8a-42b7-4799-8036-bf280a783311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:18.835031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9f8a-42b7-4799-8036-bf280a783311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:18.839189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9f8a-42b7-4799-8036-bf280a783311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:18.839189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9f8a-42b7-4799-8036-bf280a783311 admin admin] PATH_INFO: `/v3/projects/fcf3e4684b5b4391a990265a17b28055` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:18.856458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf9f8a-42b7-4799-8036-bf280a783311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf3e4684b5b4391a990265a17b28055)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:18.869201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf9f8a-42b7-4799-8036-bf280a783311 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:18.976210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 822/1653] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jun 21 08:15:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:18.978088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a85a8-2586-497e-b8cf-1b6c9813f0c5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:18.978384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a85a8-2586-497e-b8cf-1b6c9813f0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:18.980806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a85a8-2586-497e-b8cf-1b6c9813f0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:19.024786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1acf9f8a-42b7-4799-8036-bf280a783311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf3e4684b5b4391a990265a17b28055', 'request_id': 'req-1acf9f8a-42b7-4799-8036-bf280a783311'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:19.041213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5e2a85a8-2586-497e-b8cf-1b6c9813f0c5 None None] MFA Rules not processed for user `fd8c6893db604598b9e467ecf58c8edb`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:19.043313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5e2a85a8-2586-497e-b8cf-1b6c9813f0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:19.044504 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1acf9f8a-42b7-4799-8036-bf280a783311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf3e4684b5b4391a990265a17b28055', 'request_id': 'req-1acf9f8a-42b7-4799-8036-bf280a783311'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:19.053597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1acf9f8a-42b7-4799-8036-bf280a783311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf3e4684b5b4391a990265a17b28055', 'request_id': 'req-1acf9f8a-42b7-4799-8036-bf280a783311'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:19.088346 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1acf9f8a-42b7-4799-8036-bf280a783311 admin admin] The token cache is being invalidate because project fcf3e4684b5b4391a990265a17b28055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:19.088346 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1acf9f8a-42b7-4799-8036-bf280a783311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:19.089085 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1acf9f8a-42b7-4799-8036-bf280a783311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:19.091841 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 832/1654] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:18 2022] DELETE /identity/v3/projects/fcf3e4684b5b4391a990265a17b28055 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:19.099668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648340f-50d9-4898-98c8-092ea9faedea None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:19.105754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648340f-50d9-4898-98c8-092ea9faedea None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:19.106462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648340f-50d9-4898-98c8-092ea9faedea None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:19.108910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 833/1655] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jun 21 08:15:19 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:15:19.110996 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0edb-c0e4-43bf-a5b7-609671ec5443 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:19.111487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0edb-c0e4-43bf-a5b7-609671ec5443 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:19.112618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0edb-c0e4-43bf-a5b7-609671ec5443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:19.146373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-6ccb0edb-c0e4-43bf-a5b7-609671ec5443 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:19.153202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6ccb0edb-c0e4-43bf-a5b7-609671ec5443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:19.214358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 823/1656] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:19.216266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bca3b-f4dc-4aba-b218-c66892b994c5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:19.221179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bca3b-f4dc-4aba-b218-c66892b994c5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:19.222008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bca3b-f4dc-4aba-b218-c66892b994c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:19.279799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-771bca3b-f4dc-4aba-b218-c66892b994c5 None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:19.282144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-771bca3b-f4dc-4aba-b218-c66892b994c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:19.297270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 834/1657] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:19.310928 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864b019-0c88-42df-ba1b-e8ef3d322b3d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:19.311271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864b019-0c88-42df-ba1b-e8ef3d322b3d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:19.311526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864b019-0c88-42df-ba1b-e8ef3d322b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:19.360263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-b864b019-0c88-42df-ba1b-e8ef3d322b3d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:19.362423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b864b019-0c88-42df-ba1b-e8ef3d322b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:19.385808 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:19.402006 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 835/1658] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:19.409076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864b019-0c88-42df-ba1b-e8ef3d322b3d None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:19.430480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 824/1659] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:15:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:19.433109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bca3b-f4dc-4aba-b218-c66892b994c5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:19.434569 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-771bca3b-f4dc-4aba-b218-c66892b994c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:19.436097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864b019-0c88-42df-ba1b-e8ef3d322b3d None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:19.448143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bb6b7-a418-4cc5-bfb1-04a620ea45ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:19.448831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bb6b7-a418-4cc5-bfb1-04a620ea45ed admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:19.449115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bb6b7-a418-4cc5-bfb1-04a620ea45ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:19.449391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bb6b7-a418-4cc5-bfb1-04a620ea45ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:19.452652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bb6b7-a418-4cc5-bfb1-04a620ea45ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:19.452866 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bb6b7-a418-4cc5-bfb1-04a620ea45ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:19.457872 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bb6b7-a418-4cc5-bfb1-04a620ea45ed admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:19.462387 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bca3b-f4dc-4aba-b218-c66892b994c5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:19.477645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:19.482195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:19.483437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:19.484077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] PATH_INFO: `/v3/users/406f6696b0dc480dbe345d3b2037a532` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:19.490265 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=406f6696b0dc480dbe345d3b2037a532)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:19.494911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:19.499335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 836/1660] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:19.500294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bb6b7-a418-4cc5-bfb1-04a620ea45ed admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:19.509534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e26bb6b7-a418-4cc5-bfb1-04a620ea45ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:19.544786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:19.636761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406f6696b0dc480dbe345d3b2037a532'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:19.655582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406f6696b0dc480dbe345d3b2037a532'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:19.668447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bb6b7-a418-4cc5-bfb1-04a620ea45ed admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:19.679547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8f999-d925-4c21-97b9-62dfe13165dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:19.680229 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8f999-d925-4c21-97b9-62dfe13165dd service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:19.680510 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8f999-d925-4c21-97b9-62dfe13165dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:19.680868 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8f999-d925-4c21-97b9-62dfe13165dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:19.682801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406f6696b0dc480dbe345d3b2037a532'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:19.683540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406f6696b0dc480dbe345d3b2037a532'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:19.684417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406f6696b0dc480dbe345d3b2037a532'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:19.718275 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8f999-d925-4c21-97b9-62dfe13165dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:19.724646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8f999-d925-4c21-97b9-62dfe13165dd service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:19.745891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 825/1661] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:19 2022] DELETE /identity/v3/users/406f6696b0dc480dbe345d3b2037a532 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:19.750096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:19.754417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:19.781875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 837/1662] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:19.782649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cf41b-b2b3-445b-8112-b293332496b4 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:19.788098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cf41b-b2b3-445b-8112-b293332496b4 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:19.789319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cf41b-b2b3-445b-8112-b293332496b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:19.862053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e72cf41b-b2b3-445b-8112-b293332496b4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:19.863465 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e72cf41b-b2b3-445b-8112-b293332496b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:19.976423 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00818e61-e445-4426-82e1-b658931782d4 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:19.986598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce89ad6-f6a0-4d66-94aa-85992e0512f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:19.989140 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce89ad6-f6a0-4d66-94aa-85992e0512f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:19.989435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce89ad6-f6a0-4d66-94aa-85992e0512f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:19.989718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce89ad6-f6a0-4d66-94aa-85992e0512f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:19.990582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce89ad6-f6a0-4d66-94aa-85992e0512f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:19.992784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce89ad6-f6a0-4d66-94aa-85992e0512f5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:20.032176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 838/1663] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:20.041711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 826/1664] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:19 2022] POST /identity/v3/projects => generated 379 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:20.046074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cf41b-b2b3-445b-8112-b293332496b4 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:20.062893 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cf41b-b2b3-445b-8112-b293332496b4 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:20.082864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce89ad6-f6a0-4d66-94aa-85992e0512f5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:20.085084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3ce89ad6-f6a0-4d66-94aa-85992e0512f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:20.198903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:20.251550 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce89ad6-f6a0-4d66-94aa-85992e0512f5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:20.253657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358363a4-5ba6-4ffa-b7b5-a5f07a22541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:20.254235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358363a4-5ba6-4ffa-b7b5-a5f07a22541b admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:20.254534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358363a4-5ba6-4ffa-b7b5-a5f07a22541b admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:20.255135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358363a4-5ba6-4ffa-b7b5-a5f07a22541b admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:20.255850 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358363a4-5ba6-4ffa-b7b5-a5f07a22541b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:20.260916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358363a4-5ba6-4ffa-b7b5-a5f07a22541b admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:20.267455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f649379-28b6-4d41-a995-bab1ca308af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:20.268869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f649379-28b6-4d41-a995-bab1ca308af2 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:20.269587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f649379-28b6-4d41-a995-bab1ca308af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:20.269932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f649379-28b6-4d41-a995-bab1ca308af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:20.286455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f649379-28b6-4d41-a995-bab1ca308af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:20.296999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f649379-28b6-4d41-a995-bab1ca308af2 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:20.306719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 839/1665] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:20 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:20.310657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358363a4-5ba6-4ffa-b7b5-a5f07a22541b admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:20.327333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 827/1666] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:15:20.333295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358363a4-5ba6-4ffa-b7b5-a5f07a22541b admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:20.345269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00f890-7e76-4b2d-b2b7-3f0d70974083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:20.345957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00f890-7e76-4b2d-b2b7-3f0d70974083 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:20.346934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00f890-7e76-4b2d-b2b7-3f0d70974083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:20.347245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00f890-7e76-4b2d-b2b7-3f0d70974083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:20.347994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00f890-7e76-4b2d-b2b7-3f0d70974083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:20.349620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00f890-7e76-4b2d-b2b7-3f0d70974083 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:20.385811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 840/1667] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:15:20.390663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f649379-28b6-4d41-a995-bab1ca308af2 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:20.411420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f649379-28b6-4d41-a995-bab1ca308af2 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:20.417420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b484c7f-4e73-4078-a28a-2d8437dadeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:20.418214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b484c7f-4e73-4078-a28a-2d8437dadeac admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:20.418559 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b484c7f-4e73-4078-a28a-2d8437dadeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:20.418876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b484c7f-4e73-4078-a28a-2d8437dadeac admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:20.420433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b484c7f-4e73-4078-a28a-2d8437dadeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:20.422497 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b484c7f-4e73-4078-a28a-2d8437dadeac admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:20.447594 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00f890-7e76-4b2d-b2b7-3f0d70974083 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:20.455105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 828/1668] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:20.463405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00f890-7e76-4b2d-b2b7-3f0d70974083 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:20.476242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1eb4b-2f1b-4242-ab6b-37d86328af26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:20.478874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1eb4b-2f1b-4242-ab6b-37d86328af26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:20.480140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1eb4b-2f1b-4242-ab6b-37d86328af26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:20.480566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1eb4b-2f1b-4242-ab6b-37d86328af26 admin admin] PATH_INFO: `/v3/projects/78db0cbacb2b470399da8af5ea723ed3/users/315150bb4ee0480b9d3f0abf5e4f298a/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:20.522667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1eb4b-2f1b-4242-ab6b-37d86328af26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78db0cbacb2b470399da8af5ea723ed3, user_id=315150bb4ee0480b9d3f0abf5e4f298a, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:20.524808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1eb4b-2f1b-4242-ab6b-37d86328af26 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:20.560309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 841/1669] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:20 2022] PUT /identity/v3/projects/78db0cbacb2b470399da8af5ea723ed3/users/315150bb4ee0480b9d3f0abf5e4f298a/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:15:20.572184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278fea2-0369-4a38-8621-a18ae95e64af None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:20.572475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278fea2-0369-4a38-8621-a18ae95e64af None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:20.572749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278fea2-0369-4a38-8621-a18ae95e64af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:20.650979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7278fea2-0369-4a38-8621-a18ae95e64af None None] MFA Rules not processed for user `315150bb4ee0480b9d3f0abf5e4f298a`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:20.663055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7278fea2-0369-4a38-8621-a18ae95e64af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:20.888509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 829/1670] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:20.890200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1eb4b-2f1b-4242-ab6b-37d86328af26 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:20.912284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:21.102818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1eb4b-2f1b-4242-ab6b-37d86328af26 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:21.114400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7004da-b504-4e33-909d-0f10b1d99c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:21.120248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7004da-b504-4e33-909d-0f10b1d99c32 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:21.120423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7004da-b504-4e33-909d-0f10b1d99c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:21.120649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7004da-b504-4e33-909d-0f10b1d99c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:21.121978 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7004da-b504-4e33-909d-0f10b1d99c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:21.124735 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7004da-b504-4e33-909d-0f10b1d99c32 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:21.179903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 842/1671] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:20 2022] POST /identity/v3/projects => generated 377 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:21.183630 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278fea2-0369-4a38-8621-a18ae95e64af None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:21.198907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278fea2-0369-4a38-8621-a18ae95e64af None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:21.342421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097419b2-d656-4bb3-8f00-e6675995d991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:21.343173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097419b2-d656-4bb3-8f00-e6675995d991 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:21.343535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097419b2-d656-4bb3-8f00-e6675995d991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:21.343888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097419b2-d656-4bb3-8f00-e6675995d991 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:21.344803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097419b2-d656-4bb3-8f00-e6675995d991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:21.352809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097419b2-d656-4bb3-8f00-e6675995d991 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:21.404937 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 830/1672] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:21 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:21.409422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7004da-b504-4e33-909d-0f10b1d99c32 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:21.425307 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7004da-b504-4e33-909d-0f10b1d99c32 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:21.436787 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385629c-8cfa-4549-a7ab-f48b44c78913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:21.437486 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385629c-8cfa-4549-a7ab-f48b44c78913 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:21.437777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385629c-8cfa-4549-a7ab-f48b44c78913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:21.438053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385629c-8cfa-4549-a7ab-f48b44c78913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:21.438835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385629c-8cfa-4549-a7ab-f48b44c78913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:21.440808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385629c-8cfa-4549-a7ab-f48b44c78913 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:21.474690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 843/1673] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:21.479295 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097419b2-d656-4bb3-8f00-e6675995d991 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:21.500279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097419b2-d656-4bb3-8f00-e6675995d991 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:21.520274 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edbccd-b65c-4e83-b33f-e9a8bb33b41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:21.521741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edbccd-b65c-4e83-b33f-e9a8bb33b41d admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:21.522050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edbccd-b65c-4e83-b33f-e9a8bb33b41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:21.522338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edbccd-b65c-4e83-b33f-e9a8bb33b41d admin admin] PATH_INFO: `/v3/projects/92f12415c94640a497ddb44631823f5d/users/e4f94089581c470bab732639b7fc80ad/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:21.561085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edbccd-b65c-4e83-b33f-e9a8bb33b41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f12415c94640a497ddb44631823f5d, user_id=e4f94089581c470bab732639b7fc80ad, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:21.563895 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edbccd-b65c-4e83-b33f-e9a8bb33b41d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:21.610256 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 831/1674] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:21 2022] PUT /identity/v3/projects/92f12415c94640a497ddb44631823f5d/users/e4f94089581c470bab732639b7fc80ad/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:21.614999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385629c-8cfa-4549-a7ab-f48b44c78913 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:21.632998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385629c-8cfa-4549-a7ab-f48b44c78913 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:21.760907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e98b5-b26e-4327-948b-d27057bce769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:21.761603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e98b5-b26e-4327-948b-d27057bce769 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:21.762302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e98b5-b26e-4327-948b-d27057bce769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:21.764545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e98b5-b26e-4327-948b-d27057bce769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:21.765669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e98b5-b26e-4327-948b-d27057bce769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:21.771218 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e98b5-b26e-4327-948b-d27057bce769 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:21.807215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 844/1675] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:21.811238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edbccd-b65c-4e83-b33f-e9a8bb33b41d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:21.833569 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edbccd-b65c-4e83-b33f-e9a8bb33b41d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:21.853104 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121faf4-b816-46f9-bf5d-4d857fb25e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:21.853883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121faf4-b816-46f9-bf5d-4d857fb25e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:21.854480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121faf4-b816-46f9-bf5d-4d857fb25e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:21.854480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121faf4-b816-46f9-bf5d-4d857fb25e1e admin admin] PATH_INFO: `/v3/projects/92f12415c94640a497ddb44631823f5d/users/e4f94089581c470bab732639b7fc80ad/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:21.864111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121faf4-b816-46f9-bf5d-4d857fb25e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f12415c94640a497ddb44631823f5d, user_id=e4f94089581c470bab732639b7fc80ad, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:21.875238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121faf4-b816-46f9-bf5d-4d857fb25e1e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:21.901276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 832/1676] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:21 2022] PUT /identity/v3/projects/92f12415c94640a497ddb44631823f5d/users/e4f94089581c470bab732639b7fc80ad/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:21.914261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4508c7c-f535-4e35-9614-05d98fa1ee71 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:21.914867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4508c7c-f535-4e35-9614-05d98fa1ee71 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:21.915400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4508c7c-f535-4e35-9614-05d98fa1ee71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:22.009399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e4508c7c-f535-4e35-9614-05d98fa1ee71 None None] MFA Rules not processed for user `e4f94089581c470bab732639b7fc80ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:22.013249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e4508c7c-f535-4e35-9614-05d98fa1ee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:22.029284 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121faf4-b816-46f9-bf5d-4d857fb25e1e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:22.031812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9121faf4-b816-46f9-bf5d-4d857fb25e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:22.051117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:22.228153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121faf4-b816-46f9-bf5d-4d857fb25e1e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:22.242981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:22.243811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:22.244095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:22.244374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] PATH_INFO: `/v3/projects/a235e9eab43a43458f243023c91a1e7c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:22.245620 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a235e9eab43a43458f243023c91a1e7c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:22.246715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: WARNING py.warnings [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 08:15:22.246715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: warnings.warn(msg) Jun 21 08:15:22.246715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: Jun 21 08:15:22.248330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:22.311482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 845/1677] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:22.326059 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4508c7c-f535-4e35-9614-05d98fa1ee71 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:22.327366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e4508c7c-f535-4e35-9614-05d98fa1ee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:22.339903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:22.388903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a235e9eab43a43458f243023c91a1e7c', 'request_id': 'req-fbefe2b7-5fbb-4ea6-8836-edceb8357391'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:22.423362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a235e9eab43a43458f243023c91a1e7c', 'request_id': 'req-fbefe2b7-5fbb-4ea6-8836-edceb8357391'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:22.431612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a235e9eab43a43458f243023c91a1e7c', 'request_id': 'req-fbefe2b7-5fbb-4ea6-8836-edceb8357391'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:22.460978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] The token cache is being invalidate because project a235e9eab43a43458f243023c91a1e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:22.461336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:22.461950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fbefe2b7-5fbb-4ea6-8836-edceb8357391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:22.463870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 833/1678] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:22 2022] DELETE /identity/v3/projects/a235e9eab43a43458f243023c91a1e7c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:22.465249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce51abe-c834-4dc7-946b-c9635834f10e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:22.465542 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce51abe-c834-4dc7-946b-c9635834f10e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:22.465649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4508c7c-f535-4e35-9614-05d98fa1ee71 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:22.465824 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce51abe-c834-4dc7-946b-c9635834f10e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:22.472959 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 834/1679] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:15:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:15:22.473622 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce51abe-c834-4dc7-946b-c9635834f10e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:22.482982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-dce51abe-c834-4dc7-946b-c9635834f10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:22.573534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe2174-66d1-4cfb-b978-622ba36c87ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:22.576652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe2174-66d1-4cfb-b978-622ba36c87ed service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:22.576798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe2174-66d1-4cfb-b978-622ba36c87ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:22.577169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe2174-66d1-4cfb-b978-622ba36c87ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:22.583734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-11fe2174-66d1-4cfb-b978-622ba36c87ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:22.627048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce51abe-c834-4dc7-946b-c9635834f10e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:22.642695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:22.643782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:22.644481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:22.645408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] PATH_INFO: `/v3/users/a8a0920ed0f4436695bce3f2a022530b` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:22.650508 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a0920ed0f4436695bce3f2a022530b)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:22.669700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:22.755025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe2174-66d1-4cfb-b978-622ba36c87ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:22.756516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe2174-66d1-4cfb-b978-622ba36c87ed service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:22.768782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:22.784824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 846/1680] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:22.786413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3046170-a157-4761-87f3-c445a4fde0a4 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:22.786731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3046170-a157-4761-87f3-c445a4fde0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:22.787018 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3046170-a157-4761-87f3-c445a4fde0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:22.792080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a0920ed0f4436695bce3f2a022530b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:22.823469 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a0920ed0f4436695bce3f2a022530b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:22.840345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-a3046170-a157-4761-87f3-c445a4fde0a4 None None] MFA Rules not processed for user `53dfc3572d05469ca7e2de1acea3629a`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:22.841662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-a3046170-a157-4761-87f3-c445a4fde0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:22.854428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a0920ed0f4436695bce3f2a022530b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:22.855114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a0920ed0f4436695bce3f2a022530b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:22.857828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a0920ed0f4436695bce3f2a022530b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:22.921142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 835/1681] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:22 2022] DELETE /identity/v3/users/a8a0920ed0f4436695bce3f2a022530b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:23.013764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 847/1682] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:15:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:23.038466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:23.039977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:23.087849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782095-0c78-4ebd-9626-02c9dee8c04a None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:23.088146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782095-0c78-4ebd-9626-02c9dee8c04a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:23.088428 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782095-0c78-4ebd-9626-02c9dee8c04a None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:23.090016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 848/1683] 10.222.0.36 () {54 vars in 960 bytes} [Tue Jun 21 08:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:15:23.096464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79040-6deb-43f2-bee0-e3de8a705a09 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:23.096758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79040-6deb-43f2-bee0-e3de8a705a09 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:23.097231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79040-6deb-43f2-bee0-e3de8a705a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:23.111441 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:23.161205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-2eb79040-6deb-43f2-bee0-e3de8a705a09 None None] MFA Rules not processed for user `53dfc3572d05469ca7e2de1acea3629a`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:23.165756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2eb79040-6deb-43f2-bee0-e3de8a705a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:23.233491 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda63d2-cfcf-4158-9250-28595013558f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:23.245534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f6934-e372-4b9b-bc61-a3ae76bb1c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:23.246199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6934-e372-4b9b-bc61-a3ae76bb1c5b service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:23.246487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6934-e372-4b9b-bc61-a3ae76bb1c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:23.247428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6934-e372-4b9b-bc61-a3ae76bb1c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:23.249795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-355f6934-e372-4b9b-bc61-a3ae76bb1c5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:23.345238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f6934-e372-4b9b-bc61-a3ae76bb1c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:23.348246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f6934-e372-4b9b-bc61-a3ae76bb1c5b service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:23.366189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 836/1684] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:23.436351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 849/1685] 10.222.0.36 () {58 vars in 1057 bytes} [Tue Jun 21 08:15:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:23.444675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f6934-e372-4b9b-bc61-a3ae76bb1c5b service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:23.480481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f6934-e372-4b9b-bc61-a3ae76bb1c5b service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:23.502875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a20c1-ae6d-4f3f-83a8-6004e31969c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:23.503743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a20c1-ae6d-4f3f-83a8-6004e31969c9 service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:23.504032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a20c1-ae6d-4f3f-83a8-6004e31969c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:23.504312 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a20c1-ae6d-4f3f-83a8-6004e31969c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:23.531802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a20c1-ae6d-4f3f-83a8-6004e31969c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:23.534013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a20c1-ae6d-4f3f-83a8-6004e31969c9 service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:23.546323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 837/1686] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:25.633744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb79040-6deb-43f2-bee0-e3de8a705a09 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:25.636312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2eb79040-6deb-43f2-bee0-e3de8a705a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:25.827695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb79040-6deb-43f2-bee0-e3de8a705a09 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:25.837744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:25.839036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:25.839719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:25.840744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44 admin admin] PATH_INFO: `/v3/projects/5956b7dd38774cecb49ac02d0320cb6d` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:25.865848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5956b7dd38774cecb49ac02d0320cb6d)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:25.869703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:25.959438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5956b7dd38774cecb49ac02d0320cb6d', 'request_id': 'req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:25.971294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5956b7dd38774cecb49ac02d0320cb6d', 'request_id': 'req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:25.982751 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5956b7dd38774cecb49ac02d0320cb6d', 'request_id': 'req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:26.009106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44 admin admin] The token cache is being invalidate because project 5956b7dd38774cecb49ac02d0320cb6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:26.010189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:26.011297 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-2638e2da-ce5a-47fd-bbb1-5468ee6e0e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:26.014644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 850/1687] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:25 2022] DELETE /identity/v3/projects/5956b7dd38774cecb49ac02d0320cb6d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:26.019373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc371f9c-8ef0-49d2-af14-66ac596ed559 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:26.019889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc371f9c-8ef0-49d2-af14-66ac596ed559 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:26.019998 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc371f9c-8ef0-49d2-af14-66ac596ed559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:26.046485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-fc371f9c-8ef0-49d2-af14-66ac596ed559 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:26.050321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fc371f9c-8ef0-49d2-af14-66ac596ed559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:26.136708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:26.156606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 838/1688] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:15:26.165665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29fe48-9b61-4d9c-8f6b-7464e75d2b6b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:26.166219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29fe48-9b61-4d9c-8f6b-7464e75d2b6b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:26.166587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29fe48-9b61-4d9c-8f6b-7464e75d2b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:26.192984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-9b29fe48-9b61-4d9c-8f6b-7464e75d2b6b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:26.195391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9b29fe48-9b61-4d9c-8f6b-7464e75d2b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:26.211603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 851/1689] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:26.213780 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc371f9c-8ef0-49d2-af14-66ac596ed559 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:26.234212 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc371f9c-8ef0-49d2-af14-66ac596ed559 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:26.242974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e14c6-f79e-46fc-bd75-6536095640b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:26.244558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e14c6-f79e-46fc-bd75-6536095640b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:26.244839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e14c6-f79e-46fc-bd75-6536095640b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:26.245116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e14c6-f79e-46fc-bd75-6536095640b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:26.246542 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e14c6-f79e-46fc-bd75-6536095640b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:26.248054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e14c6-f79e-46fc-bd75-6536095640b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:26.250993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e14c6-f79e-46fc-bd75-6536095640b0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:26.281004 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 839/1690] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:26.285531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29fe48-9b61-4d9c-8f6b-7464e75d2b6b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:26.297366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29fe48-9b61-4d9c-8f6b-7464e75d2b6b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:26.303641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbbfdf-709a-44fd-a548-a2e324163e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:26.304324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbbfdf-709a-44fd-a548-a2e324163e0d admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:26.304782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbbfdf-709a-44fd-a548-a2e324163e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:26.305134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbbfdf-709a-44fd-a548-a2e324163e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:26.305864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbbfdf-709a-44fd-a548-a2e324163e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:26.309278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbbfdf-709a-44fd-a548-a2e324163e0d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:26.391423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 852/1691] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:26 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:26.393846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e14c6-f79e-46fc-bd75-6536095640b0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:26.409840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e14c6-f79e-46fc-bd75-6536095640b0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:26.545632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df71175-67fa-405b-aaa1-b47151866fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:26.548971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df71175-67fa-405b-aaa1-b47151866fca admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:26.549381 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df71175-67fa-405b-aaa1-b47151866fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:26.549669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df71175-67fa-405b-aaa1-b47151866fca admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:26.550442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df71175-67fa-405b-aaa1-b47151866fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:26.552485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df71175-67fa-405b-aaa1-b47151866fca admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:26.623192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 840/1692] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:26 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:26.625102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbbfdf-709a-44fd-a548-a2e324163e0d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:26.633108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:26.634992 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c72020-5324-4c45-8e1d-aeccb2a387f6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:26.635342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c72020-5324-4c45-8e1d-aeccb2a387f6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:26.636390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c72020-5324-4c45-8e1d-aeccb2a387f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:26.654787 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbbfdf-709a-44fd-a548-a2e324163e0d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:26.697391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ec9c9-210c-4976-94e1-2efe23af8ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:26.698085 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ec9c9-210c-4976-94e1-2efe23af8ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:26.698365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ec9c9-210c-4976-94e1-2efe23af8ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:26.698651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ec9c9-210c-4976-94e1-2efe23af8ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:26.710917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ec9c9-210c-4976-94e1-2efe23af8ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:26.717229 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ec9c9-210c-4976-94e1-2efe23af8ae1 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:26.727028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-54c72020-5324-4c45-8e1d-aeccb2a387f6 None None] MFA Rules not processed for user `de0dccd8f960443894a99baa79198005`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:26.729506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-54c72020-5324-4c45-8e1d-aeccb2a387f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:26.771670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 853/1693] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:26.800887 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ec9c9-210c-4976-94e1-2efe23af8ae1 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:26.862077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ec9c9-210c-4976-94e1-2efe23af8ae1 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:26.888346 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dab47d-5fd0-4e4f-9c3b-9fa58438e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:26.892054 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dab47d-5fd0-4e4f-9c3b-9fa58438e591 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:26.892351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dab47d-5fd0-4e4f-9c3b-9fa58438e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:26.903411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dab47d-5fd0-4e4f-9c3b-9fa58438e591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:26.909402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dab47d-5fd0-4e4f-9c3b-9fa58438e591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:26.914749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dab47d-5fd0-4e4f-9c3b-9fa58438e591 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:26.923483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 841/1694] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:26.939326 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c72020-5324-4c45-8e1d-aeccb2a387f6 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:26.941408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-54c72020-5324-4c45-8e1d-aeccb2a387f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:26.974174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 854/1695] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:26.979444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dab47d-5fd0-4e4f-9c3b-9fa58438e591 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:26.989011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-52dab47d-5fd0-4e4f-9c3b-9fa58438e591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:27.077573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dab47d-5fd0-4e4f-9c3b-9fa58438e591 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:27.110569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554c8a9-21bf-4013-a344-c268370e0ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:27.111497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554c8a9-21bf-4013-a344-c268370e0ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:27.111928 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554c8a9-21bf-4013-a344-c268370e0ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:27.124297 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554c8a9-21bf-4013-a344-c268370e0ba2 admin admin] PATH_INFO: `/v3/users/ad4eb1d214804f3b93d460d921e1125e` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:27.128626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554c8a9-21bf-4013-a344-c268370e0ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4eb1d214804f3b93d460d921e1125e)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:27.134488 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554c8a9-21bf-4013-a344-c268370e0ba2 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:27.326158 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:27.333967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-6554c8a9-21bf-4013-a344-c268370e0ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4eb1d214804f3b93d460d921e1125e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:27.340923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c72020-5324-4c45-8e1d-aeccb2a387f6 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:27.356042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632f88d-f382-4a9f-acb1-d07299f16f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:27.357019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632f88d-f382-4a9f-acb1-d07299f16f56 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:27.357574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632f88d-f382-4a9f-acb1-d07299f16f56 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:27.358199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632f88d-f382-4a9f-acb1-d07299f16f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:27.365764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-6554c8a9-21bf-4013-a344-c268370e0ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4eb1d214804f3b93d460d921e1125e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:27.369428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632f88d-f382-4a9f-acb1-d07299f16f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:27.371908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632f88d-f382-4a9f-acb1-d07299f16f56 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:27.375623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-6554c8a9-21bf-4013-a344-c268370e0ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4eb1d214804f3b93d460d921e1125e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:27.383434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-6554c8a9-21bf-4013-a344-c268370e0ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4eb1d214804f3b93d460d921e1125e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:27.433569 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 842/1696] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:15:27.436161 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632f88d-f382-4a9f-acb1-d07299f16f56 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:27.447661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-6554c8a9-21bf-4013-a344-c268370e0ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4eb1d214804f3b93d460d921e1125e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:27.471449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632f88d-f382-4a9f-acb1-d07299f16f56 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:27.492240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2242449-782b-4fd1-8d04-4b09ad637701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:27.493436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2242449-782b-4fd1-8d04-4b09ad637701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:27.493874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2242449-782b-4fd1-8d04-4b09ad637701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:27.494302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2242449-782b-4fd1-8d04-4b09ad637701 admin admin] PATH_INFO: `/v3/projects/94ac3a9e918d4df0a5280cf5a7a6bb7f/users/9de16ae70f294fc18af409666da1ecf6/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:27.496686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 855/1697] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:26 2022] DELETE /identity/v3/users/ad4eb1d214804f3b93d460d921e1125e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:27.543431 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2242449-782b-4fd1-8d04-4b09ad637701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ac3a9e918d4df0a5280cf5a7a6bb7f, user_id=9de16ae70f294fc18af409666da1ecf6, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:27.552451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2242449-782b-4fd1-8d04-4b09ad637701 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:27.616607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 843/1698] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:27 2022] PUT /identity/v3/projects/94ac3a9e918d4df0a5280cf5a7a6bb7f/users/9de16ae70f294fc18af409666da1ecf6/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:27.627604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198764b-3c65-4053-bfea-f02bbd13103c None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:27.627994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198764b-3c65-4053-bfea-f02bbd13103c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:27.628379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198764b-3c65-4053-bfea-f02bbd13103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:27.694820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-4198764b-3c65-4053-bfea-f02bbd13103c None None] MFA Rules not processed for user `9de16ae70f294fc18af409666da1ecf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:27.696871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4198764b-3c65-4053-bfea-f02bbd13103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:27.834740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2242449-782b-4fd1-8d04-4b09ad637701 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:27.836421 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 856/1699] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:15:27.837339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e2242449-782b-4fd1-8d04-4b09ad637701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:28.046480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2242449-782b-4fd1-8d04-4b09ad637701 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:28.067411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc618966-ff75-4e91-bd40-e35c2ce04c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:28.069098 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc618966-ff75-4e91-bd40-e35c2ce04c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:28.069604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc618966-ff75-4e91-bd40-e35c2ce04c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:28.070935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc618966-ff75-4e91-bd40-e35c2ce04c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:28.089294 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc618966-ff75-4e91-bd40-e35c2ce04c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:28.097964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc618966-ff75-4e91-bd40-e35c2ce04c94 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:28.173636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198764b-3c65-4053-bfea-f02bbd13103c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:28.177313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 844/1700] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:27 2022] POST /identity/v3/projects => generated 381 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:15:28.196290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198764b-3c65-4053-bfea-f02bbd13103c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:28.272941 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc618966-ff75-4e91-bd40-e35c2ce04c94 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:28.275106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cc618966-ff75-4e91-bd40-e35c2ce04c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:28.406759 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:28.460100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f7887-3d4a-4ebd-8a5c-ca4e2e47691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:28.462783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f7887-3d4a-4ebd-8a5c-ca4e2e47691c admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:28.463697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f7887-3d4a-4ebd-8a5c-ca4e2e47691c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:28.464207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f7887-3d4a-4ebd-8a5c-ca4e2e47691c admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:28.466313 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f7887-3d4a-4ebd-8a5c-ca4e2e47691c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:28.468743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f7887-3d4a-4ebd-8a5c-ca4e2e47691c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:28.498348 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc618966-ff75-4e91-bd40-e35c2ce04c94 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:28.519230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b885e1a-00c5-478d-add4-8daaca533a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:28.524253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b885e1a-00c5-478d-add4-8daaca533a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:28.524637 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b885e1a-00c5-478d-add4-8daaca533a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:28.526526 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b885e1a-00c5-478d-add4-8daaca533a26 admin admin] PATH_INFO: `/v3/users/ad9ade555e804778a014b565d8133205` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:28.531065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 857/1701] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:28 2022] POST /identity/v3/users => generated 297 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:28.532341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f7887-3d4a-4ebd-8a5c-ca4e2e47691c admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:28.533336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b885e1a-00c5-478d-add4-8daaca533a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9ade555e804778a014b565d8133205)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:28.541045 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b885e1a-00c5-478d-add4-8daaca533a26 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:28.579157 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f7887-3d4a-4ebd-8a5c-ca4e2e47691c admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:28.595419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0f870-2347-4ad2-9791-1392b622228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:28.597008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0f870-2347-4ad2-9791-1392b622228c admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:28.597400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0f870-2347-4ad2-9791-1392b622228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:28.598172 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0f870-2347-4ad2-9791-1392b622228c admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:28.599124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0f870-2347-4ad2-9791-1392b622228c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:28.600910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0f870-2347-4ad2-9791-1392b622228c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:28.618309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 858/1702] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:28.626362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0f870-2347-4ad2-9791-1392b622228c admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:28.653652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0f870-2347-4ad2-9791-1392b622228c admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:28.673417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf32a8-957c-4f0e-a132-8ea975806f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:28.675803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf32a8-957c-4f0e-a132-8ea975806f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:28.676189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf32a8-957c-4f0e-a132-8ea975806f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:28.676568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf32a8-957c-4f0e-a132-8ea975806f95 admin admin] PATH_INFO: `/v3/projects/1081266c028a4bff93f570640ca21132/users/61868ef7d80f4748a06f5400fcd84cf8/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:28.704776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf32a8-957c-4f0e-a132-8ea975806f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1081266c028a4bff93f570640ca21132, user_id=61868ef7d80f4748a06f5400fcd84cf8, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:28.708181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1b885e1a-00c5-478d-add4-8daaca533a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9ade555e804778a014b565d8133205'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:28.713623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf32a8-957c-4f0e-a132-8ea975806f95 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:28.727247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:28.739538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 859/1703] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:28 2022] PUT /identity/v3/projects/1081266c028a4bff93f570640ca21132/users/61868ef7d80f4748a06f5400fcd84cf8/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:28.739792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1b885e1a-00c5-478d-add4-8daaca533a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9ade555e804778a014b565d8133205'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:28.743526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf32a8-957c-4f0e-a132-8ea975806f95 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:28.774139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1b885e1a-00c5-478d-add4-8daaca533a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9ade555e804778a014b565d8133205'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:28.775177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1b885e1a-00c5-478d-add4-8daaca533a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9ade555e804778a014b565d8133205'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:28.775769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1b885e1a-00c5-478d-add4-8daaca533a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9ade555e804778a014b565d8133205'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:28.830874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 845/1704] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:28 2022] DELETE /identity/v3/users/ad9ade555e804778a014b565d8133205 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:28.836847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2ed2d-4a5e-4316-8927-5c1179bd2d2f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:28.837184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2ed2d-4a5e-4316-8927-5c1179bd2d2f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:28.837933 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2ed2d-4a5e-4316-8927-5c1179bd2d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:28.890366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf32a8-957c-4f0e-a132-8ea975806f95 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:28.911592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ecc2ed2d-4a5e-4316-8927-5c1179bd2d2f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:28.918967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ecc2ed2d-4a5e-4316-8927-5c1179bd2d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:28.993445 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6fa4e-82f4-44a0-b6f8-e66ad30aca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:28.994301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6fa4e-82f4-44a0-b6f8-e66ad30aca5c admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:28.994596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6fa4e-82f4-44a0-b6f8-e66ad30aca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:28.994912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6fa4e-82f4-44a0-b6f8-e66ad30aca5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:28.995896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6fa4e-82f4-44a0-b6f8-e66ad30aca5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:28.997836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6fa4e-82f4-44a0-b6f8-e66ad30aca5c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:29.023375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 860/1705] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:29.025420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6fa4e-82f4-44a0-b6f8-e66ad30aca5c admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:29.027359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8cc6fa4e-82f4-44a0-b6f8-e66ad30aca5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:29.052706 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6fa4e-82f4-44a0-b6f8-e66ad30aca5c admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:29.058543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f01260-1f28-4e1d-818e-3e45ba63f2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:29.059632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f01260-1f28-4e1d-818e-3e45ba63f2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:29.059974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f01260-1f28-4e1d-818e-3e45ba63f2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:29.060259 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f01260-1f28-4e1d-818e-3e45ba63f2e0 admin admin] PATH_INFO: `/v3/projects/1081266c028a4bff93f570640ca21132/users/61868ef7d80f4748a06f5400fcd84cf8/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:29.062433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f01260-1f28-4e1d-818e-3e45ba63f2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1081266c028a4bff93f570640ca21132, user_id=61868ef7d80f4748a06f5400fcd84cf8, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:29.091589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f01260-1f28-4e1d-818e-3e45ba63f2e0 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:29.117152 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 861/1706] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:29 2022] PUT /identity/v3/projects/1081266c028a4bff93f570640ca21132/users/61868ef7d80f4748a06f5400fcd84cf8/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:29.132846 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486260-8c16-4ee7-81f5-93869174c4f6 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:29.133127 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486260-8c16-4ee7-81f5-93869174c4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:29.133399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486260-8c16-4ee7-81f5-93869174c4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:29.156289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 846/1707] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:29.184690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-24486260-8c16-4ee7-81f5-93869174c4f6 None None] MFA Rules not processed for user `61868ef7d80f4748a06f5400fcd84cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:29.185948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-24486260-8c16-4ee7-81f5-93869174c4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:29.205134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:29.209385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2ed2d-4a5e-4316-8927-5c1179bd2d2f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:29.211703 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ecc2ed2d-4a5e-4316-8927-5c1179bd2d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:29.304761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 862/1708] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:29.318238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24486260-8c16-4ee7-81f5-93869174c4f6 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:29.321518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-24486260-8c16-4ee7-81f5-93869174c4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:29.372135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2ed2d-4a5e-4316-8927-5c1179bd2d2f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:29.437869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24486260-8c16-4ee7-81f5-93869174c4f6 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:29.451811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf36f3-63f0-40a7-b43b-ac8db34c469f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:29.452979 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf36f3-63f0-40a7-b43b-ac8db34c469f service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:29.454484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf36f3-63f0-40a7-b43b-ac8db34c469f service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:29.454802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf36f3-63f0-40a7-b43b-ac8db34c469f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:29.492193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf36f3-63f0-40a7-b43b-ac8db34c469f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:29.494854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf36f3-63f0-40a7-b43b-ac8db34c469f service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:29.526278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 863/1709] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:15:29.709962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf36f3-63f0-40a7-b43b-ac8db34c469f service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:29.720339 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf36f3-63f0-40a7-b43b-ac8db34c469f service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:29.725890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02cbed-2d7a-4363-926c-d326afa65e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:29.726668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02cbed-2d7a-4363-926c-d326afa65e2a service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:29.726971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02cbed-2d7a-4363-926c-d326afa65e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:29.727331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02cbed-2d7a-4363-926c-d326afa65e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:29.728869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafed42-0137-4f73-b010-1553272411bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:29.729312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4e02cbed-2d7a-4363-926c-d326afa65e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:29.730260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafed42-0137-4f73-b010-1553272411bc service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:29.730767 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafed42-0137-4f73-b010-1553272411bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:29.736337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafed42-0137-4f73-b010-1553272411bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:29.889137 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:29.913519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02cbed-2d7a-4363-926c-d326afa65e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:29.915744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02cbed-2d7a-4363-926c-d326afa65e2a service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:29.946449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 864/1710] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:29.957026 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafed42-0137-4f73-b010-1553272411bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:29.960792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafed42-0137-4f73-b010-1553272411bc service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:29.989507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 847/1711] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 781 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:15:30.191075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02cbed-2d7a-4363-926c-d326afa65e2a service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:30.195140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4e02cbed-2d7a-4363-926c-d326afa65e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:30.241812 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02cbed-2d7a-4363-926c-d326afa65e2a service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:30.260951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73e0ad-3d33-472f-b234-350a4139af89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:30.263074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73e0ad-3d33-472f-b234-350a4139af89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:30.263364 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73e0ad-3d33-472f-b234-350a4139af89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:30.265961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73e0ad-3d33-472f-b234-350a4139af89 admin admin] PATH_INFO: `/v3/projects/7e65c052cb7742628817e3dd44666cf5` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:30.267548 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73e0ad-3d33-472f-b234-350a4139af89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e65c052cb7742628817e3dd44666cf5)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:30.275461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73e0ad-3d33-472f-b234-350a4139af89 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:30.442541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:30.451781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9d73e0ad-3d33-472f-b234-350a4139af89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e65c052cb7742628817e3dd44666cf5', 'request_id': 'req-9d73e0ad-3d33-472f-b234-350a4139af89'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:30.469676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9d73e0ad-3d33-472f-b234-350a4139af89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e65c052cb7742628817e3dd44666cf5', 'request_id': 'req-9d73e0ad-3d33-472f-b234-350a4139af89'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:30.479838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9d73e0ad-3d33-472f-b234-350a4139af89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e65c052cb7742628817e3dd44666cf5', 'request_id': 'req-9d73e0ad-3d33-472f-b234-350a4139af89'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:30.509551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9d73e0ad-3d33-472f-b234-350a4139af89 admin admin] The token cache is being invalidate because project 7e65c052cb7742628817e3dd44666cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:30.510007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9d73e0ad-3d33-472f-b234-350a4139af89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:30.510846 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9d73e0ad-3d33-472f-b234-350a4139af89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:30.516783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 865/1712] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:30 2022] DELETE /identity/v3/projects/7e65c052cb7742628817e3dd44666cf5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:30.520871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafed42-0137-4f73-b010-1553272411bc service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:30.535449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafed42-0137-4f73-b010-1553272411bc service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:30.746352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3100d-584c-4d9f-b83e-5c1c5e79f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:30.749372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3100d-584c-4d9f-b83e-5c1c5e79f0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:30.749735 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3100d-584c-4d9f-b83e-5c1c5e79f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:30.749959 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3100d-584c-4d9f-b83e-5c1c5e79f0b8 admin admin] PATH_INFO: `/v3/users/fd8c6893db604598b9e467ecf58c8edb` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:30.759988 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3100d-584c-4d9f-b83e-5c1c5e79f0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8c6893db604598b9e467ecf58c8edb)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:30.762207 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3100d-584c-4d9f-b83e-5c1c5e79f0b8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:30.764890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003abb3-d1c0-4285-87ad-40cd08e5a24e None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:30.765354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003abb3-d1c0-4285-87ad-40cd08e5a24e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:30.765496 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003abb3-d1c0-4285-87ad-40cd08e5a24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:30.879239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-6003abb3-d1c0-4285-87ad-40cd08e5a24e None None] MFA Rules not processed for user `62c0039007d641c0aedaa781acaa0abe`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:30.884199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5be3100d-584c-4d9f-b83e-5c1c5e79f0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8c6893db604598b9e467ecf58c8edb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:30.888011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6003abb3-d1c0-4285-87ad-40cd08e5a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:30.905114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5be3100d-584c-4d9f-b83e-5c1c5e79f0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8c6893db604598b9e467ecf58c8edb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:30.921639 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5be3100d-584c-4d9f-b83e-5c1c5e79f0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8c6893db604598b9e467ecf58c8edb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:30.922298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5be3100d-584c-4d9f-b83e-5c1c5e79f0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8c6893db604598b9e467ecf58c8edb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:30.924710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5be3100d-584c-4d9f-b83e-5c1c5e79f0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8c6893db604598b9e467ecf58c8edb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:30.983755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 848/1713] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:30 2022] DELETE /identity/v3/users/fd8c6893db604598b9e467ecf58c8edb => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:30.989163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ad5fb-f40e-4917-a65b-a610ed0d3c9f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:30.989775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ad5fb-f40e-4917-a65b-a610ed0d3c9f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:30.991471 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ad5fb-f40e-4917-a65b-a610ed0d3c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:31.070863 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-816ad5fb-f40e-4917-a65b-a610ed0d3c9f None None] MFA Rules not processed for user `cf94ea4bbf414d2d89cfe3c232f2a54b`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:31.075760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-816ad5fb-f40e-4917-a65b-a610ed0d3c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:31.105562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 866/1714] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:15:31.129007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003abb3-d1c0-4285-87ad-40cd08e5a24e None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:31.130536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6003abb3-d1c0-4285-87ad-40cd08e5a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:31.246788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:31.313193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 849/1715] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:31.351031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7847e-e018-4436-8292-6bd6aa789d13 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:31.351031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7847e-e018-4436-8292-6bd6aa789d13 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:31.351258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7847e-e018-4436-8292-6bd6aa789d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:31.415313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-99a7847e-e018-4436-8292-6bd6aa789d13 None None] MFA Rules not processed for user `cf94ea4bbf414d2d89cfe3c232f2a54b`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:31.416543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-99a7847e-e018-4436-8292-6bd6aa789d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:31.417572 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003abb3-d1c0-4285-87ad-40cd08e5a24e None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:31.437208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 850/1716] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:31.449663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7847e-e018-4436-8292-6bd6aa789d13 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:31.452671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-99a7847e-e018-4436-8292-6bd6aa789d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:31.675972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:31.704548 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25982601-973a-4853-b68d-d08298942163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:31.705878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25982601-973a-4853-b68d-d08298942163 service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:31.706258 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25982601-973a-4853-b68d-d08298942163 service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:31.706839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25982601-973a-4853-b68d-d08298942163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:31.838501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7847e-e018-4436-8292-6bd6aa789d13 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:31.863401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66db8f2-7b08-494e-a0cc-b39776d9d7ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:31.873996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66db8f2-7b08-494e-a0cc-b39776d9d7ae service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:31.881039 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66db8f2-7b08-494e-a0cc-b39776d9d7ae service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:31.881363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66db8f2-7b08-494e-a0cc-b39776d9d7ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:31.926457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66db8f2-7b08-494e-a0cc-b39776d9d7ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:31.927787 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25982601-973a-4853-b68d-d08298942163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:31.928425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66db8f2-7b08-494e-a0cc-b39776d9d7ae service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:31.929453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25982601-973a-4853-b68d-d08298942163 service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:31.957691 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 867/1717] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:31.973594 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25982601-973a-4853-b68d-d08298942163 service nova] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:31.981700 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-25982601-973a-4853-b68d-d08298942163 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:32.008928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 851/1718] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:32.013097 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66db8f2-7b08-494e-a0cc-b39776d9d7ae service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:32.017431 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b66db8f2-7b08-494e-a0cc-b39776d9d7ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:32.308089 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25982601-973a-4853-b68d-d08298942163 service nova] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:32.318051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b6794-67d1-4a1d-86df-92c580e332ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:32.319116 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b6794-67d1-4a1d-86df-92c580e332ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:32.319580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b6794-67d1-4a1d-86df-92c580e332ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:32.319913 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b6794-67d1-4a1d-86df-92c580e332ac admin admin] PATH_INFO: `/v3/projects/15e7f6df0b254eeb8eb345de7c40d6ac` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:32.322771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b6794-67d1-4a1d-86df-92c580e332ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e7f6df0b254eeb8eb345de7c40d6ac)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:32.325175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b6794-67d1-4a1d-86df-92c580e332ac admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:32.372179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66db8f2-7b08-494e-a0cc-b39776d9d7ae service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:32.399416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d33ba0-ea58-45db-9013-9077883c0f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:32.400461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33ba0-ea58-45db-9013-9077883c0f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:32.403677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33ba0-ea58-45db-9013-9077883c0f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:32.404267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33ba0-ea58-45db-9013-9077883c0f25 admin admin] PATH_INFO: `/v3/projects/71a1d38491a0458490b0edf534b8a0f7` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:32.406260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d33ba0-ea58-45db-9013-9077883c0f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a1d38491a0458490b0edf534b8a0f7)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:32.408552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d33ba0-ea58-45db-9013-9077883c0f25 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:32.472393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-c92b6794-67d1-4a1d-86df-92c580e332ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e7f6df0b254eeb8eb345de7c40d6ac', 'request_id': 'req-c92b6794-67d1-4a1d-86df-92c580e332ac'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:32.484841 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-c92b6794-67d1-4a1d-86df-92c580e332ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e7f6df0b254eeb8eb345de7c40d6ac', 'request_id': 'req-c92b6794-67d1-4a1d-86df-92c580e332ac'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:32.501603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-c92b6794-67d1-4a1d-86df-92c580e332ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e7f6df0b254eeb8eb345de7c40d6ac', 'request_id': 'req-c92b6794-67d1-4a1d-86df-92c580e332ac'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:32.531802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-c92b6794-67d1-4a1d-86df-92c580e332ac admin admin] The token cache is being invalidate because project 15e7f6df0b254eeb8eb345de7c40d6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:32.532230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-c92b6794-67d1-4a1d-86df-92c580e332ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:32.533037 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-c92b6794-67d1-4a1d-86df-92c580e332ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:32.536648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 868/1719] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:31 2022] DELETE /identity/v3/projects/15e7f6df0b254eeb8eb345de7c40d6ac => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:32.556830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae52923-eadb-474f-a044-a07c96d78c15 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:32.557377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae52923-eadb-474f-a044-a07c96d78c15 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:32.559101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae52923-eadb-474f-a044-a07c96d78c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:32.603472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-44d33ba0-ea58-45db-9013-9077883c0f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a1d38491a0458490b0edf534b8a0f7', 'request_id': 'req-44d33ba0-ea58-45db-9013-9077883c0f25'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:32.619596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-44d33ba0-ea58-45db-9013-9077883c0f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a1d38491a0458490b0edf534b8a0f7', 'request_id': 'req-44d33ba0-ea58-45db-9013-9077883c0f25'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:32.636619 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-44d33ba0-ea58-45db-9013-9077883c0f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a1d38491a0458490b0edf534b8a0f7', 'request_id': 'req-44d33ba0-ea58-45db-9013-9077883c0f25'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:32.646145 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:32.654387 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-0ae52923-eadb-474f-a044-a07c96d78c15 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:32.657497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0ae52923-eadb-474f-a044-a07c96d78c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:32.667949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-44d33ba0-ea58-45db-9013-9077883c0f25 admin admin] The token cache is being invalidate because project 71a1d38491a0458490b0edf534b8a0f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:32.668254 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-44d33ba0-ea58-45db-9013-9077883c0f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:32.673233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-44d33ba0-ea58-45db-9013-9077883c0f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:32.674980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 852/1720] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:32 2022] DELETE /identity/v3/projects/71a1d38491a0458490b0edf534b8a0f7 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:32.679937 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9434057-8bb2-4733-a74c-560414289f8f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:32.680233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9434057-8bb2-4733-a74c-560414289f8f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:32.680517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9434057-8bb2-4733-a74c-560414289f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:32.705149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:32.766238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c9434057-8bb2-4733-a74c-560414289f8f None None] MFA Rules not processed for user `771f36afce0a4dd8897bb22f3c330856`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:32.767539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c9434057-8bb2-4733-a74c-560414289f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:32.791839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 869/1721] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:32.798873 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44fcee-146c-4eb6-8955-7f9aa6bf8b4c None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:32.801929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44fcee-146c-4eb6-8955-7f9aa6bf8b4c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:32.802418 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44fcee-146c-4eb6-8955-7f9aa6bf8b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:32.878762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-fd44fcee-146c-4eb6-8955-7f9aa6bf8b4c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:32.882403 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-fd44fcee-146c-4eb6-8955-7f9aa6bf8b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:32.910828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 870/1722] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:32.912520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2fe2-ea69-42c9-966d-0d844b7cb8e0 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:32.912813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2fe2-ea69-42c9-966d-0d844b7cb8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:32.913091 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2fe2-ea69-42c9-966d-0d844b7cb8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:32.940013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 853/1723] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:32.941546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66624252-2806-4a77-9d9a-bafc4c4f0c0c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:32.941840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66624252-2806-4a77-9d9a-bafc4c4f0c0c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:32.942122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66624252-2806-4a77-9d9a-bafc4c4f0c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:32.962247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-7b1b2fe2-ea69-42c9-966d-0d844b7cb8e0 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:32.966322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-7b1b2fe2-ea69-42c9-966d-0d844b7cb8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:32.986078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-66624252-2806-4a77-9d9a-bafc4c4f0c0c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:32.989283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-66624252-2806-4a77-9d9a-bafc4c4f0c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:32.993563 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 871/1724] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:32.995396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a870e97-1cd5-48a6-8b83-05e6ff8c2f50 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:32.995690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a870e97-1cd5-48a6-8b83-05e6ff8c2f50 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:32.995968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a870e97-1cd5-48a6-8b83-05e6ff8c2f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.010051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 854/1725] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:33.014152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66624252-2806-4a77-9d9a-bafc4c4f0c0c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:33.028549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66624252-2806-4a77-9d9a-bafc4c4f0c0c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:33.040128 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19353838-9bba-4e8b-a595-0f6b618d8b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:33.040375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-5a870e97-1cd5-48a6-8b83-05e6ff8c2f50 None None] MFA Rules not processed for user `771f36afce0a4dd8897bb22f3c330856`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:33.041078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19353838-9bba-4e8b-a595-0f6b618d8b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:33.041374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19353838-9bba-4e8b-a595-0f6b618d8b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:33.041483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-5a870e97-1cd5-48a6-8b83-05e6ff8c2f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:33.041650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19353838-9bba-4e8b-a595-0f6b618d8b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.042400 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19353838-9bba-4e8b-a595-0f6b618d8b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:33.042744 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19353838-9bba-4e8b-a595-0f6b618d8b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:33.044386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19353838-9bba-4e8b-a595-0f6b618d8b9f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:33.062721 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 872/1726] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:33.063703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a870e97-1cd5-48a6-8b83-05e6ff8c2f50 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:33.076485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 855/1727] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:33.077371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19353838-9bba-4e8b-a595-0f6b618d8b9f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:33.082447 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-19353838-9bba-4e8b-a595-0f6b618d8b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:33.091194 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a870e97-1cd5-48a6-8b83-05e6ff8c2f50 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:33.097039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7731-a9d9-4b26-bbd5-cae9986719aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:33.097634 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7731-a9d9-4b26-bbd5-cae9986719aa admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:33.098026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7731-a9d9-4b26-bbd5-cae9986719aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:33.098652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7731-a9d9-4b26-bbd5-cae9986719aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.099897 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7731-a9d9-4b26-bbd5-cae9986719aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:33.099897 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7731-a9d9-4b26-bbd5-cae9986719aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:33.101434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7731-a9d9-4b26-bbd5-cae9986719aa admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:33.120394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 873/1728] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:33.121359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7731-a9d9-4b26-bbd5-cae9986719aa admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:33.133331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7731-a9d9-4b26-bbd5-cae9986719aa admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:33.140432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bd705-f1be-4e14-a6d1-38565e0f4262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:33.141315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd705-f1be-4e14-a6d1-38565e0f4262 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:33.141602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd705-f1be-4e14-a6d1-38565e0f4262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:33.142040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd705-f1be-4e14-a6d1-38565e0f4262 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.143391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bd705-f1be-4e14-a6d1-38565e0f4262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:33.145790 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bd705-f1be-4e14-a6d1-38565e0f4262 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:33.193631 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 874/1729] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:33 2022] POST /identity/v3/projects => generated 355 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:33.195680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bd705-f1be-4e14-a6d1-38565e0f4262 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:33.287036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19353838-9bba-4e8b-a595-0f6b618d8b9f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:33.364225 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bd705-f1be-4e14-a6d1-38565e0f4262 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:33.375628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:33.386895 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1d580-13b2-4379-a22c-7e029d7d6a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:33.387594 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1d580-13b2-4379-a22c-7e029d7d6a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:33.388436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1d580-13b2-4379-a22c-7e029d7d6a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:33.388436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1d580-13b2-4379-a22c-7e029d7d6a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.389038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1d580-13b2-4379-a22c-7e029d7d6a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:33.391673 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1d580-13b2-4379-a22c-7e029d7d6a1c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:33.394055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad75382-9cac-4e93-905d-6373e4f489bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:33.395354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad75382-9cac-4e93-905d-6373e4f489bd service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:33.395650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad75382-9cac-4e93-905d-6373e4f489bd service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:33.395932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad75382-9cac-4e93-905d-6373e4f489bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.452615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 875/1730] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:33 2022] POST /identity/v3/projects => generated 365 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:33.454016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1d580-13b2-4379-a22c-7e029d7d6a1c admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:33.487873 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad75382-9cac-4e93-905d-6373e4f489bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:33.489590 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad75382-9cac-4e93-905d-6373e4f489bd service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:33.517191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 856/1731] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:33.517912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad75382-9cac-4e93-905d-6373e4f489bd service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:33.539604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad75382-9cac-4e93-905d-6373e4f489bd service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:33.580971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1d580-13b2-4379-a22c-7e029d7d6a1c admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:33.601940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca86a-2b33-4570-b49a-799f874094bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:33.603701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca86a-2b33-4570-b49a-799f874094bc admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:33.604122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca86a-2b33-4570-b49a-799f874094bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:33.604502 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca86a-2b33-4570-b49a-799f874094bc admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.605401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cca86a-2b33-4570-b49a-799f874094bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:33.615831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cca86a-2b33-4570-b49a-799f874094bc admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:33.637179 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:33.664025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 876/1732] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:33 2022] POST /identity/v3/users => generated 278 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:33.665442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca86a-2b33-4570-b49a-799f874094bc admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:33.671170 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d6cca86a-2b33-4570-b49a-799f874094bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:33.676492 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d488e3-a283-472e-a339-01fc4275805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:33.682887 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d488e3-a283-472e-a339-01fc4275805a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:33.683257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d488e3-a283-472e-a339-01fc4275805a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:33.684142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d488e3-a283-472e-a339-01fc4275805a admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.689553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d488e3-a283-472e-a339-01fc4275805a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:33.700625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d488e3-a283-472e-a339-01fc4275805a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:33.717241 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca86a-2b33-4570-b49a-799f874094bc admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:33.728385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:33.729326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:33.729612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:33.729928 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] PATH_INFO: `/v3/users/9de16ae70f294fc18af409666da1ecf6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.731671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de16ae70f294fc18af409666da1ecf6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:33.733646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:33.749120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 857/1733] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:33 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:33.749120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbbade-c442-4720-b571-0c90bb9a2064 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:33.749120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbbade-c442-4720-b571-0c90bb9a2064 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:33.749120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbbade-c442-4720-b571-0c90bb9a2064 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.753285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 858/1734] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jun 21 08:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:15:33.754909 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbbade-c442-4720-b571-0c90bb9a2064 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:33.787186 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbbade-c442-4720-b571-0c90bb9a2064 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:33.797180 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5e827-79a6-4eef-94c4-243f13b4b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:33.797858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e827-79a6-4eef-94c4-243f13b4b6be admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:33.798144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e827-79a6-4eef-94c4-243f13b4b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:33.798455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e827-79a6-4eef-94c4-243f13b4b6be admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.799893 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5e827-79a6-4eef-94c4-243f13b4b6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:33.802405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5e827-79a6-4eef-94c4-243f13b4b6be admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:33.852836 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 859/1735] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:33.856793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5e827-79a6-4eef-94c4-243f13b4b6be admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:33.859453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de16ae70f294fc18af409666da1ecf6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:33.872033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5e827-79a6-4eef-94c4-243f13b4b6be admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:33.876204 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de16ae70f294fc18af409666da1ecf6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:33.877312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de16ae70f294fc18af409666da1ecf6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:33.878262 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de16ae70f294fc18af409666da1ecf6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:33.883641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb4455-fd87-4cf7-a91c-19ec8c9a88b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:33.884332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb4455-fd87-4cf7-a91c-19ec8c9a88b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:33.884613 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb4455-fd87-4cf7-a91c-19ec8c9a88b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:33.884888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb4455-fd87-4cf7-a91c-19ec8c9a88b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.885625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb4455-fd87-4cf7-a91c-19ec8c9a88b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:33.887262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb4455-fd87-4cf7-a91c-19ec8c9a88b2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:33.905584 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de16ae70f294fc18af409666da1ecf6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:33.911423 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 860/1736] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:33.914410 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8c763-8223-43ef-9317-640aa732e251 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:33.915337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8c763-8223-43ef-9317-640aa732e251 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:33.916039 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8c763-8223-43ef-9317-640aa732e251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:33.939632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 877/1737] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:33 2022] DELETE /identity/v3/users/9de16ae70f294fc18af409666da1ecf6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:33.941184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:33.944664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:34.004066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f5e8c763-8223-43ef-9317-640aa732e251 None None] MFA Rules not processed for user `cdac6ddece434ed7abddcffe841476ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:34.006420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f5e8c763-8223-43ef-9317-640aa732e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:34.120322 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 861/1738] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:15:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:34.121322 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8c763-8223-43ef-9317-640aa732e251 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:34.122937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652d7ec-3004-4d43-ab03-240eceaf7a67 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:34.125068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f5e8c763-8223-43ef-9317-640aa732e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:34.134340 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b037333-fa8d-4752-b04b-6d892bd1ba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:34.135482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b037333-fa8d-4752-b04b-6d892bd1ba44 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:34.137553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b037333-fa8d-4752-b04b-6d892bd1ba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:34.138136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b037333-fa8d-4752-b04b-6d892bd1ba44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:34.138864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b037333-fa8d-4752-b04b-6d892bd1ba44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:34.141301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b037333-fa8d-4752-b04b-6d892bd1ba44 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:34.143812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:34.161499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8c763-8223-43ef-9317-640aa732e251 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:34.173611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 878/1739] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:34.173611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569620af-ec79-4a6d-afaa-4d7ec0d16b7e None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:34.173611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569620af-ec79-4a6d-afaa-4d7ec0d16b7e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:34.173611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569620af-ec79-4a6d-afaa-4d7ec0d16b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:34.177354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206beefe-9791-4c5c-b08e-5eae04188fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:34.178196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206beefe-9791-4c5c-b08e-5eae04188fef admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:34.178595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206beefe-9791-4c5c-b08e-5eae04188fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:34.179033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206beefe-9791-4c5c-b08e-5eae04188fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:34.180482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206beefe-9791-4c5c-b08e-5eae04188fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:34.187865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206beefe-9791-4c5c-b08e-5eae04188fef admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:34.231692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 862/1740] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:34.235701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206beefe-9791-4c5c-b08e-5eae04188fef admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:34.241891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-569620af-ec79-4a6d-afaa-4d7ec0d16b7e None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:34.243526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-569620af-ec79-4a6d-afaa-4d7ec0d16b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:34.249947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206beefe-9791-4c5c-b08e-5eae04188fef admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:34.254985 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 879/1741] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:34.256235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569620af-ec79-4a6d-afaa-4d7ec0d16b7e None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:34.258118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-569620af-ec79-4a6d-afaa-4d7ec0d16b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:34.259906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e7d13-dadb-403b-b4b9-d542501a831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:34.260836 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e7d13-dadb-403b-b4b9-d542501a831b admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:34.261171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e7d13-dadb-403b-b4b9-d542501a831b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:34.265575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e7d13-dadb-403b-b4b9-d542501a831b admin admin] PATH_INFO: `/v3/projects/f4589c6c27d54a23a97f1f39d333f81d/users/9f209ddb2cbb453a944790560a15a38b/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:34.288830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569620af-ec79-4a6d-afaa-4d7ec0d16b7e None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:34.301437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb9822-7520-4ea8-b80e-2d81d3fef997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:34.303052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb9822-7520-4ea8-b80e-2d81d3fef997 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:34.307389 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb9822-7520-4ea8-b80e-2d81d3fef997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:34.307877 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb9822-7520-4ea8-b80e-2d81d3fef997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:34.326176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e7d13-dadb-403b-b4b9-d542501a831b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4589c6c27d54a23a97f1f39d333f81d, user_id=9f209ddb2cbb453a944790560a15a38b, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:34.333264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e7d13-dadb-403b-b4b9-d542501a831b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:34.334408 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb9822-7520-4ea8-b80e-2d81d3fef997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:34.336046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb9822-7520-4ea8-b80e-2d81d3fef997 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:34.376010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 880/1742] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:34.378313 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb9822-7520-4ea8-b80e-2d81d3fef997 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:34.378964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 863/1743] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:34 2022] PUT /identity/v3/projects/f4589c6c27d54a23a97f1f39d333f81d/users/9f209ddb2cbb453a944790560a15a38b/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:34.382166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76461970-5d26-4e0c-99b6-07a6b9070980 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:34.387142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76461970-5d26-4e0c-99b6-07a6b9070980 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:34.387563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76461970-5d26-4e0c-99b6-07a6b9070980 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:34.391829 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 864/1744] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jun 21 08:15:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:15:34.395088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76461970-5d26-4e0c-99b6-07a6b9070980 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:34.414483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb9822-7520-4ea8-b80e-2d81d3fef997 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:34.496958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:34.537792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214167f-d929-492d-a8e5-2ad9218d41c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:34.540662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214167f-d929-492d-a8e5-2ad9218d41c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:34.541031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214167f-d929-492d-a8e5-2ad9218d41c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:34.541386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214167f-d929-492d-a8e5-2ad9218d41c6 admin admin] PATH_INFO: `/v3/projects/386eff650c204593aa57fb9addb5982e/users/7eb27972f7994f859a155353d779ce51/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:34.552290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76461970-5d26-4e0c-99b6-07a6b9070980 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:34.568461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214167f-d929-492d-a8e5-2ad9218d41c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386eff650c204593aa57fb9addb5982e, user_id=7eb27972f7994f859a155353d779ce51, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:34.572358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214167f-d929-492d-a8e5-2ad9218d41c6 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:34.574229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c265f-df2c-4f84-9a28-1e22339f82c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:34.577403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c265f-df2c-4f84-9a28-1e22339f82c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:34.577704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c265f-df2c-4f84-9a28-1e22339f82c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:34.577989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c265f-df2c-4f84-9a28-1e22339f82c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:34.604964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 881/1745] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:34 2022] PUT /identity/v3/projects/386eff650c204593aa57fb9addb5982e/users/7eb27972f7994f859a155353d779ce51/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:34.614946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d3c1-14b2-4608-ac18-8b61dbb7ad2b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:34.614946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d3c1-14b2-4608-ac18-8b61dbb7ad2b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:34.614946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d3c1-14b2-4608-ac18-8b61dbb7ad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:34.615193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c265f-df2c-4f84-9a28-1e22339f82c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:34.615193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c265f-df2c-4f84-9a28-1e22339f82c2 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:34.637572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 865/1746] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:34.638846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc30e75-fdf2-4ae8-aac3-84483af57f12 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:34.639151 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc30e75-fdf2-4ae8-aac3-84483af57f12 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:34.639416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc30e75-fdf2-4ae8-aac3-84483af57f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:34.683198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d309d3c1-14b2-4608-ac18-8b61dbb7ad2b None None] MFA Rules not processed for user `9f209ddb2cbb453a944790560a15a38b`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:34.684480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d309d3c1-14b2-4608-ac18-8b61dbb7ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:34.687287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2cc30e75-fdf2-4ae8-aac3-84483af57f12 None None] MFA Rules not processed for user `cdac6ddece434ed7abddcffe841476ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:34.688536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2cc30e75-fdf2-4ae8-aac3-84483af57f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:34.814661 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 866/1747] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:15:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:34.815947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29ed18-4450-4c21-9b8e-5c19a4e54e40 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:34.816240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29ed18-4450-4c21-9b8e-5c19a4e54e40 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:34.816517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29ed18-4450-4c21-9b8e-5c19a4e54e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:34.837282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 882/1748] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:34 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:34.838274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d3c1-14b2-4608-ac18-8b61dbb7ad2b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:34.856886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d309d3c1-14b2-4608-ac18-8b61dbb7ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:34.887310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9c29ed18-4450-4c21-9b8e-5c19a4e54e40 None None] MFA Rules not processed for user `7eb27972f7994f859a155353d779ce51`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:34.888605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9c29ed18-4450-4c21-9b8e-5c19a4e54e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:35.021640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d3c1-14b2-4608-ac18-8b61dbb7ad2b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:35.043338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:35.044518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:35.044797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:35.045069 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] PATH_INFO: `/v3/users/315150bb4ee0480b9d3f0abf5e4f298a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:35.046410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=315150bb4ee0480b9d3f0abf5e4f298a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:35.048726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:35.057695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 867/1749] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:35.058573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29ed18-4450-4c21-9b8e-5c19a4e54e40 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:35.062265 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9c29ed18-4450-4c21-9b8e-5c19a4e54e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:35.098685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29ed18-4450-4c21-9b8e-5c19a4e54e40 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:35.114512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b7d71-8524-475c-a765-09b2944d4454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:35.115378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b7d71-8524-475c-a765-09b2944d4454 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:35.115469 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b7d71-8524-475c-a765-09b2944d4454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:35.115749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b7d71-8524-475c-a765-09b2944d4454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:35.128082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:35.134769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b7d71-8524-475c-a765-09b2944d4454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:35.136150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b7d71-8524-475c-a765-09b2944d4454 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:35.165146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 868/1750] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:35.165780 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315150bb4ee0480b9d3f0abf5e4f298a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:35.166257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b7d71-8524-475c-a765-09b2944d4454 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:35.198060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:35.203238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315150bb4ee0480b9d3f0abf5e4f298a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:35.204814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b7d71-8524-475c-a765-09b2944d4454 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:35.205407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315150bb4ee0480b9d3f0abf5e4f298a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:35.208202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315150bb4ee0480b9d3f0abf5e4f298a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:35.230656 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409bf4a-2a84-4510-829f-ecf84287484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:35.230859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409bf4a-2a84-4510-829f-ecf84287484f admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:35.232322 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409bf4a-2a84-4510-829f-ecf84287484f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:35.232528 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409bf4a-2a84-4510-829f-ecf84287484f admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:35.233247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409bf4a-2a84-4510-829f-ecf84287484f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:35.235231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409bf4a-2a84-4510-829f-ecf84287484f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:35.271936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315150bb4ee0480b9d3f0abf5e4f298a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:35.307226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 883/1751] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:34 2022] DELETE /identity/v3/users/315150bb4ee0480b9d3f0abf5e4f298a => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:35.310226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:35.316935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:35.369676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 869/1752] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:35 2022] POST /identity/v3/projects => generated 355 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:35.371690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327836e-3a6e-4b6e-82b6-813dc9b88b3b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:35.372375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327836e-3a6e-4b6e-82b6-813dc9b88b3b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:35.373259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327836e-3a6e-4b6e-82b6-813dc9b88b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:35.404597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f327836e-3a6e-4b6e-82b6-813dc9b88b3b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:35.405898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f327836e-3a6e-4b6e-82b6-813dc9b88b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:35.593284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e60d1-ff91-4af3-93b5-59d81a0b3de2 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:35.623754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 870/1753] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:35.624545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327836e-3a6e-4b6e-82b6-813dc9b88b3b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:35.629345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f327836e-3a6e-4b6e-82b6-813dc9b88b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:35.654203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327836e-3a6e-4b6e-82b6-813dc9b88b3b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:35.669123 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d4546-eea1-4bc9-a9d3-8eacfa2fa562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:35.669810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d4546-eea1-4bc9-a9d3-8eacfa2fa562 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:35.670198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d4546-eea1-4bc9-a9d3-8eacfa2fa562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:35.670784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d4546-eea1-4bc9-a9d3-8eacfa2fa562 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:35.671488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d4546-eea1-4bc9-a9d3-8eacfa2fa562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:35.674731 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d4546-eea1-4bc9-a9d3-8eacfa2fa562 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:35.724409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 871/1754] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:35 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:35.728397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d4546-eea1-4bc9-a9d3-8eacfa2fa562 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:35.730777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-634d4546-eea1-4bc9-a9d3-8eacfa2fa562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:35.732843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ba98b-bd11-4d16-871b-f8b75a7a19e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:35.736408 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ba98b-bd11-4d16-871b-f8b75a7a19e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:35.737732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ba98b-bd11-4d16-871b-f8b75a7a19e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:35.738020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ba98b-bd11-4d16-871b-f8b75a7a19e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:35.740322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ba98b-bd11-4d16-871b-f8b75a7a19e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:35.749401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ba98b-bd11-4d16-871b-f8b75a7a19e4 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:35.844478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 884/1755] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:35 2022] POST /identity/v3/projects => generated 365 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:35.845439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ba98b-bd11-4d16-871b-f8b75a7a19e4 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:35.858673 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d4546-eea1-4bc9-a9d3-8eacfa2fa562 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:36.014574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ba98b-bd11-4d16-871b-f8b75a7a19e4 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:36.021884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345e5b7-559b-45e9-8bd9-a00c18e6830a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:36.022563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345e5b7-559b-45e9-8bd9-a00c18e6830a service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:36.023019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345e5b7-559b-45e9-8bd9-a00c18e6830a service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:36.023304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345e5b7-559b-45e9-8bd9-a00c18e6830a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:36.030506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099f313-0f01-40e6-9554-15dfb1fec039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:36.031339 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099f313-0f01-40e6-9554-15dfb1fec039 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:36.031624 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099f313-0f01-40e6-9554-15dfb1fec039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:36.031900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099f313-0f01-40e6-9554-15dfb1fec039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:36.032642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099f313-0f01-40e6-9554-15dfb1fec039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:36.038931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099f313-0f01-40e6-9554-15dfb1fec039 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:36.042670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345e5b7-559b-45e9-8bd9-a00c18e6830a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:36.047586 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345e5b7-559b-45e9-8bd9-a00c18e6830a service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:36.055921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:36.067627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 885/1756] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:36.068603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099f313-0f01-40e6-9554-15dfb1fec039 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:36.079035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 872/1757] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:36.079943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345e5b7-559b-45e9-8bd9-a00c18e6830a service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:36.097513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099f313-0f01-40e6-9554-15dfb1fec039 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:36.099805 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345e5b7-559b-45e9-8bd9-a00c18e6830a service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:36.123907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cd897-556f-4ada-9a3f-8e0d895a5992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:36.124755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cd897-556f-4ada-9a3f-8e0d895a5992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:36.125031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cd897-556f-4ada-9a3f-8e0d895a5992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:36.125329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cd897-556f-4ada-9a3f-8e0d895a5992 admin admin] PATH_INFO: `/v3/projects/f56691c0fa2142ac9782358f3e3c0292/users/06daa2396ac94109957a85599bd66f43/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:36.143778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dfe72-007a-42e9-99ae-50d7132f1ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:36.145405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dfe72-007a-42e9-99ae-50d7132f1ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:36.145705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dfe72-007a-42e9-99ae-50d7132f1ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:36.145986 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dfe72-007a-42e9-99ae-50d7132f1ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:36.146727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dfe72-007a-42e9-99ae-50d7132f1ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:36.154485 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dfe72-007a-42e9-99ae-50d7132f1ce8 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:36.158935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:36.165452 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cd897-556f-4ada-9a3f-8e0d895a5992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56691c0fa2142ac9782358f3e3c0292, user_id=06daa2396ac94109957a85599bd66f43, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:36.174537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cd897-556f-4ada-9a3f-8e0d895a5992 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:36.210323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 873/1758] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:36 2022] PUT /identity/v3/projects/f56691c0fa2142ac9782358f3e3c0292/users/06daa2396ac94109957a85599bd66f43/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:36.214953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cd897-556f-4ada-9a3f-8e0d895a5992 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:36.241921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 886/1759] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:36 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:36.247632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dfe72-007a-42e9-99ae-50d7132f1ce8 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:36.288315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dfe72-007a-42e9-99ae-50d7132f1ce8 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:36.355599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cd897-556f-4ada-9a3f-8e0d895a5992 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:36.362494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aba9c-badd-4774-84f0-86a64dcee1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:36.363474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aba9c-badd-4774-84f0-86a64dcee1ad admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:36.363787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aba9c-badd-4774-84f0-86a64dcee1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:36.364030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aba9c-badd-4774-84f0-86a64dcee1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:36.364929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38aba9c-badd-4774-84f0-86a64dcee1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:36.366932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38aba9c-badd-4774-84f0-86a64dcee1ad admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:36.396929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 874/1760] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:36.400739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aba9c-badd-4774-84f0-86a64dcee1ad admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:36.486568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aba9c-badd-4774-84f0-86a64dcee1ad admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:36.506832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16460d40-65d1-450c-a115-3cf48b0e86a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:36.507748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16460d40-65d1-450c-a115-3cf48b0e86a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:36.508029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16460d40-65d1-450c-a115-3cf48b0e86a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:36.508305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16460d40-65d1-450c-a115-3cf48b0e86a1 admin admin] PATH_INFO: `/v3/projects/f56691c0fa2142ac9782358f3e3c0292/users/06daa2396ac94109957a85599bd66f43/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:36.510610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16460d40-65d1-450c-a115-3cf48b0e86a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56691c0fa2142ac9782358f3e3c0292, user_id=06daa2396ac94109957a85599bd66f43, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:36.513322 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16460d40-65d1-450c-a115-3cf48b0e86a1 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:36.572812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 875/1761] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:36 2022] PUT /identity/v3/projects/f56691c0fa2142ac9782358f3e3c0292/users/06daa2396ac94109957a85599bd66f43/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:36.573882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16460d40-65d1-450c-a115-3cf48b0e86a1 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:36.576222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-16460d40-65d1-450c-a115-3cf48b0e86a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:36.613687 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccecca-521e-4fa9-91d0-7c42f9b0d2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:36.614380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccecca-521e-4fa9-91d0-7c42f9b0d2fe admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:36.614677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccecca-521e-4fa9-91d0-7c42f9b0d2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:36.614953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccecca-521e-4fa9-91d0-7c42f9b0d2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:36.615696 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccecca-521e-4fa9-91d0-7c42f9b0d2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:36.617333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccecca-521e-4fa9-91d0-7c42f9b0d2fe admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:36.646370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 887/1762] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:36.646865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd90a2-5373-417d-9d73-0956f46d7ea4 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:36.647155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd90a2-5373-417d-9d73-0956f46d7ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:36.647550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd90a2-5373-417d-9d73-0956f46d7ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:36.737934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-53dd90a2-5373-417d-9d73-0956f46d7ea4 None None] MFA Rules not processed for user `06daa2396ac94109957a85599bd66f43`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:36.738906 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-53dd90a2-5373-417d-9d73-0956f46d7ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:36.801218 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16460d40-65d1-450c-a115-3cf48b0e86a1 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:36.821838 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081260f-f7f9-4248-9f80-50f59107bce5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:36.822501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081260f-f7f9-4248-9f80-50f59107bce5 service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:36.823638 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081260f-f7f9-4248-9f80-50f59107bce5 service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:36.823923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081260f-f7f9-4248-9f80-50f59107bce5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:36.829001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d081260f-f7f9-4248-9f80-50f59107bce5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:36.861081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081260f-f7f9-4248-9f80-50f59107bce5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:36.869313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081260f-f7f9-4248-9f80-50f59107bce5 service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:36.898507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 876/1763] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:36.899670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081260f-f7f9-4248-9f80-50f59107bce5 service placement] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:36.946561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 888/1764] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:36 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:36.949410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd90a2-5373-417d-9d73-0956f46d7ea4 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:36.953222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-53dd90a2-5373-417d-9d73-0956f46d7ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:36.985942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd90a2-5373-417d-9d73-0956f46d7ea4 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:37.000281 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde7491-42c1-46f7-bc28-9fbaa0813020 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:37.004022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde7491-42c1-46f7-bc28-9fbaa0813020 service placement] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:37.004453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde7491-42c1-46f7-bc28-9fbaa0813020 service placement] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:37.005803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde7491-42c1-46f7-bc28-9fbaa0813020 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:37.030099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde7491-42c1-46f7-bc28-9fbaa0813020 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:37.036180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde7491-42c1-46f7-bc28-9fbaa0813020 service placement] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:37.077367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 889/1765] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:37.078542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde7491-42c1-46f7-bc28-9fbaa0813020 service placement] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:37.088509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ddde7491-42c1-46f7-bc28-9fbaa0813020 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:37.132847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081260f-f7f9-4248-9f80-50f59107bce5 service placement] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:37.137913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d39af-7cc5-4820-9886-5897bd22ea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:37.139806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d39af-7cc5-4820-9886-5897bd22ea1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:37.140911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d39af-7cc5-4820-9886-5897bd22ea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:37.141554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d39af-7cc5-4820-9886-5897bd22ea1b admin admin] PATH_INFO: `/v3/projects/9fb027f5167a469f9ee786bc58ebdae0/users/0e4b8f1c004743d292813f685520c6b6/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:37.152840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:37.170749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d39af-7cc5-4820-9886-5897bd22ea1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb027f5167a469f9ee786bc58ebdae0, user_id=0e4b8f1c004743d292813f685520c6b6, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:37.179057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d39af-7cc5-4820-9886-5897bd22ea1b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:37.204930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde7491-42c1-46f7-bc28-9fbaa0813020 service placement] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:37.209081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 877/1766] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:36 2022] PUT /identity/v3/projects/9fb027f5167a469f9ee786bc58ebdae0/users/0e4b8f1c004743d292813f685520c6b6/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:37.212723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:37.217891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0896398-23ae-4e7c-81bd-ff0da0919a85 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:37.218478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0896398-23ae-4e7c-81bd-ff0da0919a85 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:37.219060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0896398-23ae-4e7c-81bd-ff0da0919a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:37.256953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b0896398-23ae-4e7c-81bd-ff0da0919a85 None None] MFA Rules not processed for user `de0dccd8f960443894a99baa79198005`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:37.258572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b0896398-23ae-4e7c-81bd-ff0da0919a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:37.344066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8117f02-e979-4902-b1dc-6f4e5e5c5bfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:37.344066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8117f02-e979-4902-b1dc-6f4e5e5c5bfd service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:37.345086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8117f02-e979-4902-b1dc-6f4e5e5c5bfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:37.346947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8117f02-e979-4902-b1dc-6f4e5e5c5bfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:37.444624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 878/1767] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:37.446481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ad65-f8ee-4b58-87c7-05f8949c6eda None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:37.446983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ad65-f8ee-4b58-87c7-05f8949c6eda None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:37.447196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ad65-f8ee-4b58-87c7-05f8949c6eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:37.480222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8e32ad65-f8ee-4b58-87c7-05f8949c6eda None None] MFA Rules not processed for user `771f36afce0a4dd8897bb22f3c330856`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:37.482918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8e32ad65-f8ee-4b58-87c7-05f8949c6eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:37.654905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8117f02-e979-4902-b1dc-6f4e5e5c5bfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:37.663484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8117f02-e979-4902-b1dc-6f4e5e5c5bfd service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:37.695552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 879/1768] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:37.703466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ad65-f8ee-4b58-87c7-05f8949c6eda None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:37.710134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 890/1769] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:37 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:37.711038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8117f02-e979-4902-b1dc-6f4e5e5c5bfd service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:37.719217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f8117f02-e979-4902-b1dc-6f4e5e5c5bfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:37.948658 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ad65-f8ee-4b58-87c7-05f8949c6eda None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:37.962155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8117f02-e979-4902-b1dc-6f4e5e5c5bfd service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:37.963541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aed7c-f71c-4451-bbcb-8fffdb1a8d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:37.964243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aed7c-f71c-4451-bbcb-8fffdb1a8d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:37.964520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aed7c-f71c-4451-bbcb-8fffdb1a8d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:37.964984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aed7c-f71c-4451-bbcb-8fffdb1a8d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:37.965740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978aed7c-f71c-4451-bbcb-8fffdb1a8d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:37.970270 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978aed7c-f71c-4451-bbcb-8fffdb1a8d05 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:37.994409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:37.995620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:37.995788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:37.996139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] PATH_INFO: `/v3/projects/94ac3a9e918d4df0a5280cf5a7a6bb7f` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:38.003260 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ac3a9e918d4df0a5280cf5a7a6bb7f)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:38.005255 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:38.008003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 880/1770] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:38.008707 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aed7c-f71c-4451-bbcb-8fffdb1a8d05 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:38.019343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-978aed7c-f71c-4451-bbcb-8fffdb1a8d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:38.055340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aed7c-f71c-4451-bbcb-8fffdb1a8d05 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:38.072787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:38.073850 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:38.074297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:38.074744 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] PATH_INFO: `/v3/projects/78db0cbacb2b470399da8af5ea723ed3` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:38.076777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=78db0cbacb2b470399da8af5ea723ed3)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:38.082027 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:38.151355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ac3a9e918d4df0a5280cf5a7a6bb7f', 'request_id': 'req-8ee4192e-7733-46c0-b5e7-2b55670f12d4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.196137 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ac3a9e918d4df0a5280cf5a7a6bb7f', 'request_id': 'req-8ee4192e-7733-46c0-b5e7-2b55670f12d4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.198899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:38.201131 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:38.223322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ac3a9e918d4df0a5280cf5a7a6bb7f', 'request_id': 'req-8ee4192e-7733-46c0-b5e7-2b55670f12d4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.233794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78db0cbacb2b470399da8af5ea723ed3', 'request_id': 'req-99b5a242-1d78-4762-ab3d-aa97b025e9fc'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.244808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] The token cache is being invalidate because project 94ac3a9e918d4df0a5280cf5a7a6bb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:38.245223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.257932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.261584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78db0cbacb2b470399da8af5ea723ed3', 'request_id': 'req-99b5a242-1d78-4762-ab3d-aa97b025e9fc'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.264143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 891/1771] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:37 2022] DELETE /identity/v3/projects/94ac3a9e918d4df0a5280cf5a7a6bb7f => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:38.275083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:38.275758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:38.295333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78db0cbacb2b470399da8af5ea723ed3', 'request_id': 'req-99b5a242-1d78-4762-ab3d-aa97b025e9fc'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.322373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] The token cache is being invalidate because project 78db0cbacb2b470399da8af5ea723ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:38.322705 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.327068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.332379 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 881/1772] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:38 2022] DELETE /identity/v3/projects/78db0cbacb2b470399da8af5ea723ed3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:38.333091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:38.336454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:38.427005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4192e-7733-46c0-b5e7-2b55670f12d4 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:38.491908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f5e55-795e-443f-8d3d-4ee3dc238d82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:38.492737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f5e55-795e-443f-8d3d-4ee3dc238d82 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:38.493126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f5e55-795e-443f-8d3d-4ee3dc238d82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:38.493516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f5e55-795e-443f-8d3d-4ee3dc238d82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:38.495678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2d2f5e55-795e-443f-8d3d-4ee3dc238d82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:38.538478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5a242-1d78-4762-ab3d-aa97b025e9fc admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:38.553407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0053b-8a06-45d1-8a05-ab93d913501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:38.554317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0053b-8a06-45d1-8a05-ab93d913501c admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:38.554605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0053b-8a06-45d1-8a05-ab93d913501c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:38.554904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0053b-8a06-45d1-8a05-ab93d913501c admin admin] PATH_INFO: `/v3/projects/9fb027f5167a469f9ee786bc58ebdae0/users/0e4b8f1c004743d292813f685520c6b6/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:38.566492 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f5e55-795e-443f-8d3d-4ee3dc238d82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:38.568268 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f5e55-795e-443f-8d3d-4ee3dc238d82 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:38.576535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0053b-8a06-45d1-8a05-ab93d913501c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb027f5167a469f9ee786bc58ebdae0, user_id=0e4b8f1c004743d292813f685520c6b6, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:38.579337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0053b-8a06-45d1-8a05-ab93d913501c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:38.586883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 892/1773] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:38 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:38.587876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f5e55-795e-443f-8d3d-4ee3dc238d82 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:38.594925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2d2f5e55-795e-443f-8d3d-4ee3dc238d82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:38.606487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 882/1774] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:38 2022] PUT /identity/v3/projects/9fb027f5167a469f9ee786bc58ebdae0/users/0e4b8f1c004743d292813f685520c6b6/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:38.607426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0053b-8a06-45d1-8a05-ab93d913501c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:38.620071 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f7b0053b-8a06-45d1-8a05-ab93d913501c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:38.646531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f5e55-795e-443f-8d3d-4ee3dc238d82 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:38.740666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0053b-8a06-45d1-8a05-ab93d913501c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:38.749238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bba04-b73c-44bd-b057-f4f7506130ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:38.750940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bba04-b73c-44bd-b057-f4f7506130ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:38.751760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bba04-b73c-44bd-b057-f4f7506130ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:38.753023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bba04-b73c-44bd-b057-f4f7506130ce admin admin] PATH_INFO: `/v3/users/e4f94089581c470bab732639b7fc80ad` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:38.755067 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bba04-b73c-44bd-b057-f4f7506130ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f94089581c470bab732639b7fc80ad)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:38.759816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bba04-b73c-44bd-b057-f4f7506130ce admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:38.780900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:38.806310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0b3c6-21d9-4974-83a8-a2717b0ee760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:38.807095 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0b3c6-21d9-4974-83a8-a2717b0ee760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:38.807433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0b3c6-21d9-4974-83a8-a2717b0ee760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:38.807793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0b3c6-21d9-4974-83a8-a2717b0ee760 admin admin] PATH_INFO: `/v3/users/61868ef7d80f4748a06f5400fcd84cf8` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:38.809949 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0b3c6-21d9-4974-83a8-a2717b0ee760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61868ef7d80f4748a06f5400fcd84cf8)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:38.823207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0b3c6-21d9-4974-83a8-a2717b0ee760 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:38.859478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0d4bba04-b73c-44bd-b057-f4f7506130ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f94089581c470bab732639b7fc80ad'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.866444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:38.873393 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0d4bba04-b73c-44bd-b057-f4f7506130ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f94089581c470bab732639b7fc80ad'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.890166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0d4bba04-b73c-44bd-b057-f4f7506130ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f94089581c470bab732639b7fc80ad'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.891063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0d4bba04-b73c-44bd-b057-f4f7506130ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f94089581c470bab732639b7fc80ad'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.892081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0d4bba04-b73c-44bd-b057-f4f7506130ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f94089581c470bab732639b7fc80ad'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.940100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 883/1775] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:38 2022] DELETE /identity/v3/users/e4f94089581c470bab732639b7fc80ad => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:38.940100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a720ad-ee94-4768-a2da-3e796d714b84 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:38.940100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a720ad-ee94-4768-a2da-3e796d714b84 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:38.940100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a720ad-ee94-4768-a2da-3e796d714b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:38.977007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-2ef0b3c6-21d9-4974-83a8-a2717b0ee760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61868ef7d80f4748a06f5400fcd84cf8'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.996117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-2ef0b3c6-21d9-4974-83a8-a2717b0ee760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61868ef7d80f4748a06f5400fcd84cf8'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.996963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-2ef0b3c6-21d9-4974-83a8-a2717b0ee760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61868ef7d80f4748a06f5400fcd84cf8'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:38.999013 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-2ef0b3c6-21d9-4974-83a8-a2717b0ee760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61868ef7d80f4748a06f5400fcd84cf8'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:39.009813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-84a720ad-ee94-4768-a2da-3e796d714b84 None None] MFA Rules not processed for user `0e4b8f1c004743d292813f685520c6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:39.028261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-84a720ad-ee94-4768-a2da-3e796d714b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:39.030437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-2ef0b3c6-21d9-4974-83a8-a2717b0ee760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61868ef7d80f4748a06f5400fcd84cf8'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:39.062730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 893/1776] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:38 2022] DELETE /identity/v3/users/61868ef7d80f4748a06f5400fcd84cf8 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:39.067691 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cfae2-5650-4417-8044-7bbe00e4cbf4 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:39.067991 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cfae2-5650-4417-8044-7bbe00e4cbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:39.068279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cfae2-5650-4417-8044-7bbe00e4cbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:39.124882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-9b0cfae2-5650-4417-8044-7bbe00e4cbf4 None None] MFA Rules not processed for user `62c0039007d641c0aedaa781acaa0abe`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:39.128205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9b0cfae2-5650-4417-8044-7bbe00e4cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:39.218991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 884/1777] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:39.240650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a720ad-ee94-4768-a2da-3e796d714b84 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:39.251344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-84a720ad-ee94-4768-a2da-3e796d714b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:39.303972 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 894/1778] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:39.450597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a720ad-ee94-4768-a2da-3e796d714b84 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:39.603478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aecfb-8ea6-4dd3-891f-29de149ec3eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:39.604149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aecfb-8ea6-4dd3-891f-29de149ec3eb service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:39.604438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aecfb-8ea6-4dd3-891f-29de149ec3eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:39.604717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aecfb-8ea6-4dd3-891f-29de149ec3eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:39.640098 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:39.706888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084aecfb-8ea6-4dd3-891f-29de149ec3eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:39.708835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084aecfb-8ea6-4dd3-891f-29de149ec3eb service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:39.721248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 885/1779] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:39.876599 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cfae2-5650-4417-8044-7bbe00e4cbf4 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:39.880020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9b0cfae2-5650-4417-8044-7bbe00e4cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:40.122125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cfae2-5650-4417-8044-7bbe00e4cbf4 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:40.150654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf843870-4c18-43f6-b0e6-3943e405d143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:40.152243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf843870-4c18-43f6-b0e6-3943e405d143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:40.156055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf843870-4c18-43f6-b0e6-3943e405d143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:40.156958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf843870-4c18-43f6-b0e6-3943e405d143 admin admin] PATH_INFO: `/v3/projects/1081266c028a4bff93f570640ca21132` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:40.170288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aecfb-8ea6-4dd3-891f-29de149ec3eb service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:40.172176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-084aecfb-8ea6-4dd3-891f-29de149ec3eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:40.172594 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf843870-4c18-43f6-b0e6-3943e405d143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1081266c028a4bff93f570640ca21132)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:40.179922 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf843870-4c18-43f6-b0e6-3943e405d143 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:40.201522 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aecfb-8ea6-4dd3-891f-29de149ec3eb service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:40.222053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84683a58-20e6-47cb-98ea-a555ab82d549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:40.252789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84683a58-20e6-47cb-98ea-a555ab82d549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:40.253878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84683a58-20e6-47cb-98ea-a555ab82d549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:40.254858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84683a58-20e6-47cb-98ea-a555ab82d549 admin admin] PATH_INFO: `/v3/projects/92f12415c94640a497ddb44631823f5d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:40.266904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84683a58-20e6-47cb-98ea-a555ab82d549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f12415c94640a497ddb44631823f5d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:40.279797 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84683a58-20e6-47cb-98ea-a555ab82d549 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:40.312402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:40.398940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cf843870-4c18-43f6-b0e6-3943e405d143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1081266c028a4bff93f570640ca21132', 'request_id': 'req-cf843870-4c18-43f6-b0e6-3943e405d143'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:40.424416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cf843870-4c18-43f6-b0e6-3943e405d143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1081266c028a4bff93f570640ca21132', 'request_id': 'req-cf843870-4c18-43f6-b0e6-3943e405d143'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:40.458452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cf843870-4c18-43f6-b0e6-3943e405d143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1081266c028a4bff93f570640ca21132', 'request_id': 'req-cf843870-4c18-43f6-b0e6-3943e405d143'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:40.523424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cf843870-4c18-43f6-b0e6-3943e405d143 admin admin] The token cache is being invalidate because project 1081266c028a4bff93f570640ca21132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:40.523727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cf843870-4c18-43f6-b0e6-3943e405d143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:40.531175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cf843870-4c18-43f6-b0e6-3943e405d143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:40.551349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 895/1780] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:39 2022] DELETE /identity/v3/projects/1081266c028a4bff93f570640ca21132 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:40.566042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04241b-a6d1-43f6-9652-188f922e102e None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:40.571094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04241b-a6d1-43f6-9652-188f922e102e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:40.576315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04241b-a6d1-43f6-9652-188f922e102e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:40.612332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-84683a58-20e6-47cb-98ea-a555ab82d549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f12415c94640a497ddb44631823f5d', 'request_id': 'req-84683a58-20e6-47cb-98ea-a555ab82d549'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:40.641485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-84683a58-20e6-47cb-98ea-a555ab82d549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f12415c94640a497ddb44631823f5d', 'request_id': 'req-84683a58-20e6-47cb-98ea-a555ab82d549'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:40.665992 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-84683a58-20e6-47cb-98ea-a555ab82d549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f12415c94640a497ddb44631823f5d', 'request_id': 'req-84683a58-20e6-47cb-98ea-a555ab82d549'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:40.684623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ae04241b-a6d1-43f6-9652-188f922e102e None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:40.686269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ae04241b-a6d1-43f6-9652-188f922e102e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:40.726047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-84683a58-20e6-47cb-98ea-a555ab82d549 admin admin] The token cache is being invalidate because project 92f12415c94640a497ddb44631823f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:40.727038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-84683a58-20e6-47cb-98ea-a555ab82d549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:40.729297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-84683a58-20e6-47cb-98ea-a555ab82d549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:40.738132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 886/1781] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:40 2022] DELETE /identity/v3/projects/92f12415c94640a497ddb44631823f5d => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:40.746075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47db8b-5562-4c84-8af8-7765a65f97e4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:40.747160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47db8b-5562-4c84-8af8-7765a65f97e4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:40.747443 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47db8b-5562-4c84-8af8-7765a65f97e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:40.896286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9c47db8b-5562-4c84-8af8-7765a65f97e4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:40.904665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9c47db8b-5562-4c84-8af8-7765a65f97e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:40.975848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 896/1782] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:40.990173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 887/1783] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:40.992308 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d71ab-1ce7-45a4-b6b6-6da630ed9e4b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:40.992784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d71ab-1ce7-45a4-b6b6-6da630ed9e4b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:40.993505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d71ab-1ce7-45a4-b6b6-6da630ed9e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:40.996112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7088a-59c9-4479-b0ed-003cec90991e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:40.996112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7088a-59c9-4479-b0ed-003cec90991e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:41.005446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7088a-59c9-4479-b0ed-003cec90991e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:41.025061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-088d71ab-1ce7-45a4-b6b6-6da630ed9e4b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:41.026321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-088d71ab-1ce7-45a4-b6b6-6da630ed9e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:41.052237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 897/1784] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:41.053245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d71ab-1ce7-45a4-b6b6-6da630ed9e4b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:41.094321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d71ab-1ce7-45a4-b6b6-6da630ed9e4b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:41.098233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-92b7088a-59c9-4479-b0ed-003cec90991e None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:41.100685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-92b7088a-59c9-4479-b0ed-003cec90991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:41.131261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 888/1785] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:41.136938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7088a-59c9-4479-b0ed-003cec90991e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:41.137041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e64785-8a45-4b38-b95c-b0b35c7064c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:41.141246 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e64785-8a45-4b38-b95c-b0b35c7064c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:41.141417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e64785-8a45-4b38-b95c-b0b35c7064c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:41.141683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e64785-8a45-4b38-b95c-b0b35c7064c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:41.143482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e64785-8a45-4b38-b95c-b0b35c7064c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:41.143629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e64785-8a45-4b38-b95c-b0b35c7064c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:41.162240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e64785-8a45-4b38-b95c-b0b35c7064c2 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:41.163899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7088a-59c9-4479-b0ed-003cec90991e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:41.173295 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf9db3-5a72-4f2a-9177-0ecaef2edbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:41.177018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf9db3-5a72-4f2a-9177-0ecaef2edbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:41.177430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf9db3-5a72-4f2a-9177-0ecaef2edbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:41.178100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf9db3-5a72-4f2a-9177-0ecaef2edbd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:41.186997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf9db3-5a72-4f2a-9177-0ecaef2edbd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:41.188520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf9db3-5a72-4f2a-9177-0ecaef2edbd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:41.194588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf9db3-5a72-4f2a-9177-0ecaef2edbd1 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:41.213634 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 898/1786] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:41.216808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e64785-8a45-4b38-b95c-b0b35c7064c2 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:41.225735 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b1e64785-8a45-4b38-b95c-b0b35c7064c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:41.235537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 889/1787] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:15:41.239441 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf9db3-5a72-4f2a-9177-0ecaef2edbd1 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:41.276930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf9db3-5a72-4f2a-9177-0ecaef2edbd1 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:41.292689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e64785-8a45-4b38-b95c-b0b35c7064c2 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:41.296005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921accb7-0da7-4087-a119-620a51343b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:41.296943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921accb7-0da7-4087-a119-620a51343b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:41.297397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921accb7-0da7-4087-a119-620a51343b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:41.297797 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921accb7-0da7-4087-a119-620a51343b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:41.298633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921accb7-0da7-4087-a119-620a51343b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:41.306260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921accb7-0da7-4087-a119-620a51343b8e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:41.317460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:41.318559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:41.319042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:41.319444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] PATH_INFO: `/v3/users/7eb27972f7994f859a155353d779ce51` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:41.322375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb27972f7994f859a155353d779ce51)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:41.330413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:41.384426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 890/1788] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:41 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:41.386321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc0ed4-5e07-43dc-9cef-234648feed4d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:41.390935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc0ed4-5e07-43dc-9cef-234648feed4d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:41.393280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc0ed4-5e07-43dc-9cef-234648feed4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:41.430689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e5dc0ed4-5e07-43dc-9cef-234648feed4d None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:41.433767 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e5dc0ed4-5e07-43dc-9cef-234648feed4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:41.500721 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb27972f7994f859a155353d779ce51'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:41.524902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb27972f7994f859a155353d779ce51'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:41.525930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb27972f7994f859a155353d779ce51'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:41.527889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb27972f7994f859a155353d779ce51'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:41.562802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb27972f7994f859a155353d779ce51'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:41.563927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:41.575712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 891/1789] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:15:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:41.577060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc0ed4-5e07-43dc-9cef-234648feed4d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:41.579015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e5dc0ed4-5e07-43dc-9cef-234648feed4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:41.605335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 899/1790] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:41 2022] DELETE /identity/v3/users/7eb27972f7994f859a155353d779ce51 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:41.606202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:41.619624 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:41.627843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:41.777421 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd28a8e-3266-40d5-85e8-e7ab9f092aa4 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:41.803109 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aa780-d7bc-458b-8296-b3f48c9a0ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:41.803811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aa780-d7bc-458b-8296-b3f48c9a0ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:41.804095 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aa780-d7bc-458b-8296-b3f48c9a0ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:41.804376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aa780-d7bc-458b-8296-b3f48c9a0ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:41.805078 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845aa780-d7bc-458b-8296-b3f48c9a0ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:41.807068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845aa780-d7bc-458b-8296-b3f48c9a0ce0 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:41.858363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc0ed4-5e07-43dc-9cef-234648feed4d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:41.862842 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 900/1791] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:41 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:41.864336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474de20-4b91-4174-a204-26d3919edf9e None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:41.864635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474de20-4b91-4174-a204-26d3919edf9e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:41.864918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474de20-4b91-4174-a204-26d3919edf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:41.872650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce9ee8-c20e-4edc-9ca9-ca69d09ddc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:41.873813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce9ee8-c20e-4edc-9ca9-ca69d09ddc48 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:41.874244 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce9ee8-c20e-4edc-9ca9-ca69d09ddc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:41.874686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce9ee8-c20e-4edc-9ca9-ca69d09ddc48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:41.875548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce9ee8-c20e-4edc-9ca9-ca69d09ddc48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:41.895264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce9ee8-c20e-4edc-9ca9-ca69d09ddc48 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:41.906544 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-8474de20-4b91-4174-a204-26d3919edf9e None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:41.907865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8474de20-4b91-4174-a204-26d3919edf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:41.935455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 901/1792] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:41.936479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474de20-4b91-4174-a204-26d3919edf9e None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:41.955435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 892/1793] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:41 2022] POST /identity/v3/projects => generated 367 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:41.956906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce9ee8-c20e-4edc-9ca9-ca69d09ddc48 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:41.961536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474de20-4b91-4174-a204-26d3919edf9e None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:42.071157 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce9ee8-c20e-4edc-9ca9-ca69d09ddc48 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:42.076132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae08f7-91b5-41cb-b143-dff294c93101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:42.076817 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae08f7-91b5-41cb-b143-dff294c93101 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:42.077111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae08f7-91b5-41cb-b143-dff294c93101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:42.077381 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae08f7-91b5-41cb-b143-dff294c93101 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:42.078085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae08f7-91b5-41cb-b143-dff294c93101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:42.080665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae08f7-91b5-41cb-b143-dff294c93101 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:42.114875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85740ee6-6d9e-49a9-a1c9-c9b8dad58894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:42.118079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85740ee6-6d9e-49a9-a1c9-c9b8dad58894 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:42.120023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85740ee6-6d9e-49a9-a1c9-c9b8dad58894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:42.121123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85740ee6-6d9e-49a9-a1c9-c9b8dad58894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:42.124629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85740ee6-6d9e-49a9-a1c9-c9b8dad58894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:42.130195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85740ee6-6d9e-49a9-a1c9-c9b8dad58894 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:42.136798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 893/1794] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:41 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:15:42.144774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae08f7-91b5-41cb-b143-dff294c93101 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:42.156888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-06ae08f7-91b5-41cb-b143-dff294c93101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:42.163545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 902/1795] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:42.164803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85740ee6-6d9e-49a9-a1c9-c9b8dad58894 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:42.170141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-85740ee6-6d9e-49a9-a1c9-c9b8dad58894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:42.342407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85740ee6-6d9e-49a9-a1c9-c9b8dad58894 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:42.359663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebefc0-4e79-496c-868e-9966240aae92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:42.360502 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebefc0-4e79-496c-868e-9966240aae92 service swift] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:42.361009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebefc0-4e79-496c-868e-9966240aae92 service swift] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:42.361920 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebefc0-4e79-496c-868e-9966240aae92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:42.370095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae08f7-91b5-41cb-b143-dff294c93101 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:42.387176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ad25d-e035-4aa3-bc1a-5afbcf8f57f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:42.387885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ad25d-e035-4aa3-bc1a-5afbcf8f57f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:42.388155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ad25d-e035-4aa3-bc1a-5afbcf8f57f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:42.388436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ad25d-e035-4aa3-bc1a-5afbcf8f57f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:42.427614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:42.429290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ad25d-e035-4aa3-bc1a-5afbcf8f57f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:42.430919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ad25d-e035-4aa3-bc1a-5afbcf8f57f2 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:42.454684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 894/1796] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:42.456138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ad25d-e035-4aa3-bc1a-5afbcf8f57f2 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:42.482269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ad25d-e035-4aa3-bc1a-5afbcf8f57f2 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:42.493055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b043c-5028-4366-a2ca-e2463d1d254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:42.493915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b043c-5028-4366-a2ca-e2463d1d254b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:42.494343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b043c-5028-4366-a2ca-e2463d1d254b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:42.494819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b043c-5028-4366-a2ca-e2463d1d254b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:42.496710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b043c-5028-4366-a2ca-e2463d1d254b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:42.498819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b043c-5028-4366-a2ca-e2463d1d254b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:42.523023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 895/1797] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:42.524224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b043c-5028-4366-a2ca-e2463d1d254b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:42.526098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebefc0-4e79-496c-868e-9966240aae92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:42.548476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b043c-5028-4366-a2ca-e2463d1d254b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:42.549126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebefc0-4e79-496c-868e-9966240aae92 service swift] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:42.566175 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4aad5-4851-40a1-a28d-a3e57b56d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:42.566440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 903/1798] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:15:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:15:42.569060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebefc0-4e79-496c-868e-9966240aae92 service swift] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:42.575419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4aad5-4851-40a1-a28d-a3e57b56d65c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:42.576084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4aad5-4851-40a1-a28d-a3e57b56d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:42.595120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4aad5-4851-40a1-a28d-a3e57b56d65c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:42.599315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebefc0-4e79-496c-868e-9966240aae92 service swift] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:42.610900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3b9eb-8a09-40ed-958a-33a81a0769e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:42.611640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4aad5-4851-40a1-a28d-a3e57b56d65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:42.611762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3b9eb-8a09-40ed-958a-33a81a0769e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:42.612266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3b9eb-8a09-40ed-958a-33a81a0769e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:42.612545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3b9eb-8a09-40ed-958a-33a81a0769e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:42.614269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3b9eb-8a09-40ed-958a-33a81a0769e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:42.617263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3b9eb-8a09-40ed-958a-33a81a0769e0 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:42.624073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4aad5-4851-40a1-a28d-a3e57b56d65c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:42.642910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 904/1799] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:42.647224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3b9eb-8a09-40ed-958a-33a81a0769e0 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:42.668559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3b9eb-8a09-40ed-958a-33a81a0769e0 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:42.670453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:42.683391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9001a2d-a511-4aff-a719-b3cfcd6bd9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:42.692510 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001a2d-a511-4aff-a719-b3cfcd6bd9b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:42.695414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001a2d-a511-4aff-a719-b3cfcd6bd9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:42.695720 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001a2d-a511-4aff-a719-b3cfcd6bd9b0 admin admin] PATH_INFO: `/v3/projects/5e3876e8272847b0a0672088d7eac729/users/b20a94f91b9a4ed0a78db1633a559074/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:42.723511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 896/1800] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:42.733758 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4aad5-4851-40a1-a28d-a3e57b56d65c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:42.781605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9001a2d-a511-4aff-a719-b3cfcd6bd9b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3876e8272847b0a0672088d7eac729, user_id=b20a94f91b9a4ed0a78db1633a559074, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:42.785798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4aad5-4851-40a1-a28d-a3e57b56d65c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:42.792035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9001a2d-a511-4aff-a719-b3cfcd6bd9b0 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:42.821787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8aac66-f704-41ac-8c08-64d4af4cda5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:42.824175 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aac66-f704-41ac-8c08-64d4af4cda5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:42.824474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aac66-f704-41ac-8c08-64d4af4cda5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:42.824760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aac66-f704-41ac-8c08-64d4af4cda5f admin admin] PATH_INFO: `/v3/projects/c7cb8eeea674403b81c939cf0c746785/users/5753f329dc214548a1659b2e73092c0f/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:42.892840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 905/1801] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:42 2022] PUT /identity/v3/projects/5e3876e8272847b0a0672088d7eac729/users/b20a94f91b9a4ed0a78db1633a559074/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:42.899449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84679d9a-408b-40ff-b070-613630f0fa86 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:42.902060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84679d9a-408b-40ff-b070-613630f0fa86 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:42.904618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84679d9a-408b-40ff-b070-613630f0fa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:42.915848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8aac66-f704-41ac-8c08-64d4af4cda5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7cb8eeea674403b81c939cf0c746785, user_id=5753f329dc214548a1659b2e73092c0f, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:42.918600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8aac66-f704-41ac-8c08-64d4af4cda5f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:42.997611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 897/1802] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:42 2022] PUT /identity/v3/projects/c7cb8eeea674403b81c939cf0c746785/users/5753f329dc214548a1659b2e73092c0f/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:43.009461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb652e2-9f37-4abe-aa3c-a5b60b8d3492 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:43.009773 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb652e2-9f37-4abe-aa3c-a5b60b8d3492 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:43.011572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb652e2-9f37-4abe-aa3c-a5b60b8d3492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:43.057912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-84679d9a-408b-40ff-b070-613630f0fa86 None None] MFA Rules not processed for user `b20a94f91b9a4ed0a78db1633a559074`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:43.061261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-84679d9a-408b-40ff-b070-613630f0fa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:43.146227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1fb652e2-9f37-4abe-aa3c-a5b60b8d3492 None None] MFA Rules not processed for user `5753f329dc214548a1659b2e73092c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:43.147734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1fb652e2-9f37-4abe-aa3c-a5b60b8d3492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:43.338995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 906/1803] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:43.342895 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84679d9a-408b-40ff-b070-613630f0fa86 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:43.473535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 898/1804] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:15:43.477986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb652e2-9f37-4abe-aa3c-a5b60b8d3492 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:43.481952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1fb652e2-9f37-4abe-aa3c-a5b60b8d3492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:43.545790 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84679d9a-408b-40ff-b070-613630f0fa86 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:43.575411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41386b-e12c-4a51-aa88-342d8f7388c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:43.576103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41386b-e12c-4a51-aa88-342d8f7388c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:43.576392 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41386b-e12c-4a51-aa88-342d8f7388c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:43.576678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41386b-e12c-4a51-aa88-342d8f7388c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:43.577391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41386b-e12c-4a51-aa88-342d8f7388c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:43.579378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41386b-e12c-4a51-aa88-342d8f7388c1 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:43.669298 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 907/1805] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:43 2022] POST /identity/v3/projects => generated 367 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:43.670818 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb652e2-9f37-4abe-aa3c-a5b60b8d3492 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:43.673185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41386b-e12c-4a51-aa88-342d8f7388c1 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:43.684731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:43.860260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca36af3-74dc-4376-b5ae-aa1fd0f587e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:43.864156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca36af3-74dc-4376-b5ae-aa1fd0f587e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:43.865906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca36af3-74dc-4376-b5ae-aa1fd0f587e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:43.867003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca36af3-74dc-4376-b5ae-aa1fd0f587e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:43.979598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:43.983909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41386b-e12c-4a51-aa88-342d8f7388c1 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:43.991307 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cf6a3-240d-4176-9ce7-4ccd636d4585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:43.992055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cf6a3-240d-4176-9ce7-4ccd636d4585 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:43.992344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cf6a3-240d-4176-9ce7-4ccd636d4585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:43.992631 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cf6a3-240d-4176-9ce7-4ccd636d4585 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:43.993868 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cf6a3-240d-4176-9ce7-4ccd636d4585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:43.995522 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cf6a3-240d-4176-9ce7-4ccd636d4585 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:44.044637 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca36af3-74dc-4376-b5ae-aa1fd0f587e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:44.048124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca36af3-74dc-4376-b5ae-aa1fd0f587e9 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:44.048271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 908/1806] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:43 2022] POST /identity/v3/users => generated 290 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:15:44.050015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cf6a3-240d-4176-9ce7-4ccd636d4585 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:44.060429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 899/1807] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:15:44.083148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cf6a3-240d-4176-9ce7-4ccd636d4585 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:44.098421 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda85e-41a0-40c6-b09f-608feca03cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:44.100142 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda85e-41a0-40c6-b09f-608feca03cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:44.101366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda85e-41a0-40c6-b09f-608feca03cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:44.101551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda85e-41a0-40c6-b09f-608feca03cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:44.107739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdda85e-41a0-40c6-b09f-608feca03cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:44.112278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdda85e-41a0-40c6-b09f-608feca03cfb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:44.123942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca36af3-74dc-4376-b5ae-aa1fd0f587e9 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:44.144725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca36af3-74dc-4376-b5ae-aa1fd0f587e9 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:44.152945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 909/1808] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:44.154649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda85e-41a0-40c6-b09f-608feca03cfb admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:44.165266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf50119-b591-468a-bf3a-2fca0b5c83fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:44.166164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50119-b591-468a-bf3a-2fca0b5c83fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:44.166453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50119-b591-468a-bf3a-2fca0b5c83fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:44.166834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50119-b591-468a-bf3a-2fca0b5c83fc admin admin] PATH_INFO: `/v3/users/5753f329dc214548a1659b2e73092c0f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:44.169165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf50119-b591-468a-bf3a-2fca0b5c83fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5753f329dc214548a1659b2e73092c0f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:44.171164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf50119-b591-468a-bf3a-2fca0b5c83fc admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:44.211158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda85e-41a0-40c6-b09f-608feca03cfb admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:44.239115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29dc63-0e73-459f-9684-7eb918fee173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:44.240036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29dc63-0e73-459f-9684-7eb918fee173 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:44.243692 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29dc63-0e73-459f-9684-7eb918fee173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:44.244567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29dc63-0e73-459f-9684-7eb918fee173 admin admin] PATH_INFO: `/v3/projects/1927d42c0d284230add255810ccf56a5/users/b18c2477769d48f391ed8f682c8a264d/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:44.292245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6bf50119-b591-468a-bf3a-2fca0b5c83fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5753f329dc214548a1659b2e73092c0f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:44.301531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29dc63-0e73-459f-9684-7eb918fee173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1927d42c0d284230add255810ccf56a5, user_id=b18c2477769d48f391ed8f682c8a264d, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:44.310604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29dc63-0e73-459f-9684-7eb918fee173 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:44.318180 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6bf50119-b591-468a-bf3a-2fca0b5c83fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5753f329dc214548a1659b2e73092c0f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:44.351254 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6bf50119-b591-468a-bf3a-2fca0b5c83fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5753f329dc214548a1659b2e73092c0f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:44.354195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6bf50119-b591-468a-bf3a-2fca0b5c83fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5753f329dc214548a1659b2e73092c0f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:44.354955 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6bf50119-b591-468a-bf3a-2fca0b5c83fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5753f329dc214548a1659b2e73092c0f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:44.416881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 900/1809] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:44 2022] DELETE /identity/v3/users/5753f329dc214548a1659b2e73092c0f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:44.418420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c615e-bf9f-47e6-8566-1b67f9809f56 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:44.418792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c615e-bf9f-47e6-8566-1b67f9809f56 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:44.419081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c615e-bf9f-47e6-8566-1b67f9809f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:44.421323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 910/1810] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:44 2022] PUT /identity/v3/projects/1927d42c0d284230add255810ccf56a5/users/b18c2477769d48f391ed8f682c8a264d/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:44.426151 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29dc63-0e73-459f-9684-7eb918fee173 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:44.435503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2d29dc63-0e73-459f-9684-7eb918fee173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:44.491790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-aa4c615e-bf9f-47e6-8566-1b67f9809f56 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:44.493076 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-aa4c615e-bf9f-47e6-8566-1b67f9809f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:44.681714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 901/1811] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:44.691966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29dc63-0e73-459f-9684-7eb918fee173 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:44.779358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6d8db-0d32-4095-bf1f-63c50ae2c4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:44.781822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6d8db-0d32-4095-bf1f-63c50ae2c4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:44.782133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6d8db-0d32-4095-bf1f-63c50ae2c4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:44.782413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6d8db-0d32-4095-bf1f-63c50ae2c4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:44.783261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6d8db-0d32-4095-bf1f-63c50ae2c4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:44.784909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6d8db-0d32-4095-bf1f-63c50ae2c4b5 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:44.798450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c615e-bf9f-47e6-8566-1b67f9809f56 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:44.801435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-aa4c615e-bf9f-47e6-8566-1b67f9809f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:44.863239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 911/1812] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:15:44.864733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6d8db-0d32-4095-bf1f-63c50ae2c4b5 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:44.941119 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6d8db-0d32-4095-bf1f-63c50ae2c4b5 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:44.964511 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e3068-14cf-46ae-b200-4a8152ef0439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:44.974052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e3068-14cf-46ae-b200-4a8152ef0439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:44.974357 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e3068-14cf-46ae-b200-4a8152ef0439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:44.974689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e3068-14cf-46ae-b200-4a8152ef0439 admin admin] PATH_INFO: `/v3/projects/1927d42c0d284230add255810ccf56a5/users/b18c2477769d48f391ed8f682c8a264d/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:44.985874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e3068-14cf-46ae-b200-4a8152ef0439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1927d42c0d284230add255810ccf56a5, user_id=b18c2477769d48f391ed8f682c8a264d, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:44.999937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e3068-14cf-46ae-b200-4a8152ef0439 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:45.056699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:45.075422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 912/1813] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:44 2022] PUT /identity/v3/projects/1927d42c0d284230add255810ccf56a5/users/b18c2477769d48f391ed8f682c8a264d/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:45.077825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e013b-1e9d-4659-901e-92da5286275d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:45.078112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e013b-1e9d-4659-901e-92da5286275d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:45.078439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e013b-1e9d-4659-901e-92da5286275d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:45.097929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c615e-bf9f-47e6-8566-1b67f9809f56 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:45.206877 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-509e013b-1e9d-4659-901e-92da5286275d None None] MFA Rules not processed for user `b18c2477769d48f391ed8f682c8a264d`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:45.208201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-509e013b-1e9d-4659-901e-92da5286275d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:45.265667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ebb6d-afd0-4d09-85bc-66e0d23dde16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:45.266459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ebb6d-afd0-4d09-85bc-66e0d23dde16 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:45.266898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ebb6d-afd0-4d09-85bc-66e0d23dde16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:45.267230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ebb6d-afd0-4d09-85bc-66e0d23dde16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:45.282021 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:45.347134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 913/1814] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:45.366323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e013b-1e9d-4659-901e-92da5286275d None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:45.372461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-509e013b-1e9d-4659-901e-92da5286275d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:45.494665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ebb6d-afd0-4d09-85bc-66e0d23dde16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:45.497650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ebb6d-afd0-4d09-85bc-66e0d23dde16 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:45.550877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 902/1815] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:15:45.567436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e013b-1e9d-4659-901e-92da5286275d None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:45.584451 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abf9d5-093b-40db-9ce0-c675ef17c40d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:45.586034 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abf9d5-093b-40db-9ce0-c675ef17c40d service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:45.586321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abf9d5-093b-40db-9ce0-c675ef17c40d service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:45.586601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abf9d5-093b-40db-9ce0-c675ef17c40d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:45.608592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abf9d5-093b-40db-9ce0-c675ef17c40d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:45.612917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abf9d5-093b-40db-9ce0-c675ef17c40d service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:45.635318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 914/1816] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:45.765101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ebb6d-afd0-4d09-85bc-66e0d23dde16 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:45.769993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-210ebb6d-afd0-4d09-85bc-66e0d23dde16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:45.829533 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ebb6d-afd0-4d09-85bc-66e0d23dde16 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:45.870821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9ca2b-7838-45da-99b7-22dc2f5f786b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:45.871405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9ca2b-7838-45da-99b7-22dc2f5f786b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:45.871883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9ca2b-7838-45da-99b7-22dc2f5f786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:45.875424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:45.876320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:45.876611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:45.889612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] PATH_INFO: `/v3/projects/386eff650c204593aa57fb9addb5982e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:45.899254 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] RBAC: Authorizing `identity:delete_project(project_id=386eff650c204593aa57fb9addb5982e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:45.901467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:45.930010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-60c9ca2b-7838-45da-99b7-22dc2f5f786b None None] MFA Rules not processed for user `cdac6ddece434ed7abddcffe841476ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:45.931433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-60c9ca2b-7838-45da-99b7-22dc2f5f786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:45.968292 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 915/1817] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Jun 21 08:15:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:15:46.075651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9ca2b-7838-45da-99b7-22dc2f5f786b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:46.077590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-60c9ca2b-7838-45da-99b7-22dc2f5f786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:46.101625 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9ca2b-7838-45da-99b7-22dc2f5f786b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:46.110101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386eff650c204593aa57fb9addb5982e', 'request_id': 'req-8b357efa-6285-4551-a55b-45ed6402982c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:46.160515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386eff650c204593aa57fb9addb5982e', 'request_id': 'req-8b357efa-6285-4551-a55b-45ed6402982c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:46.178698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386eff650c204593aa57fb9addb5982e', 'request_id': 'req-8b357efa-6285-4551-a55b-45ed6402982c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:46.205530 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] The token cache is being invalidate because project 386eff650c204593aa57fb9addb5982e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:46.205838 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:46.207402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:46.242793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 903/1818] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:45 2022] DELETE /identity/v3/projects/386eff650c204593aa57fb9addb5982e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:15:46.244669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:46.249980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:46.279340 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b304938-395c-4293-a5b7-b92d8be8c46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:46.280266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b304938-395c-4293-a5b7-b92d8be8c46c service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:46.280715 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b304938-395c-4293-a5b7-b92d8be8c46c service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:46.281138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b304938-395c-4293-a5b7-b92d8be8c46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:46.288032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4b304938-395c-4293-a5b7-b92d8be8c46c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:46.310850 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b304938-395c-4293-a5b7-b92d8be8c46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:46.312737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b304938-395c-4293-a5b7-b92d8be8c46c service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:46.335411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 916/1819] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:15:46.391166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:46.461949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b357efa-6285-4551-a55b-45ed6402982c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:46.476182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:46.477093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:46.477376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:46.477841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] PATH_INFO: `/v3/users/0e4b8f1c004743d292813f685520c6b6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:46.480277 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4b8f1c004743d292813f685520c6b6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:46.482386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:46.600667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4b8f1c004743d292813f685520c6b6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:46.618232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4b8f1c004743d292813f685520c6b6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:46.635107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4b8f1c004743d292813f685520c6b6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:46.636618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4b8f1c004743d292813f685520c6b6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:46.639215 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4b8f1c004743d292813f685520c6b6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:46.734273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 904/1820] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:46 2022] DELETE /identity/v3/users/0e4b8f1c004743d292813f685520c6b6 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:48.997116 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b304938-395c-4293-a5b7-b92d8be8c46c service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:49.035483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b304938-395c-4293-a5b7-b92d8be8c46c service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:49.242645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:49.244099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:49.261525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:49.262400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:49.262712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:49.263001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1 admin admin] PATH_INFO: `/v3/projects/9fb027f5167a469f9ee786bc58ebdae0` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:49.283711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb027f5167a469f9ee786bc58ebdae0)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:49.292207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:49.295346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58d7fa-aabf-4a2e-96c6-bc0dd4bf5e07 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:49.313416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:49.343918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30662e2-0536-469e-ab8d-6ca0c614ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:49.360577 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30662e2-0536-469e-ab8d-6ca0c614ede3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:49.362597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30662e2-0536-469e-ab8d-6ca0c614ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:49.363204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30662e2-0536-469e-ab8d-6ca0c614ede3 admin admin] PATH_INFO: `/v3/users/b20a94f91b9a4ed0a78db1633a559074` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:49.364901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30662e2-0536-469e-ab8d-6ca0c614ede3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20a94f91b9a4ed0a78db1633a559074)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:49.379237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30662e2-0536-469e-ab8d-6ca0c614ede3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:49.459166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb027f5167a469f9ee786bc58ebdae0', 'request_id': 'req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:49.485221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb027f5167a469f9ee786bc58ebdae0', 'request_id': 'req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:49.516317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb027f5167a469f9ee786bc58ebdae0', 'request_id': 'req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:49.543055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d30662e2-0536-469e-ab8d-6ca0c614ede3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20a94f91b9a4ed0a78db1633a559074'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:49.593844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1 admin admin] The token cache is being invalidate because project 9fb027f5167a469f9ee786bc58ebdae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:49.595024 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:49.596915 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-998ff15d-bf69-4cf0-8b2b-3f82e74e61e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:49.607610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d30662e2-0536-469e-ab8d-6ca0c614ede3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20a94f91b9a4ed0a78db1633a559074'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:49.613485 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 917/1821] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:48 2022] DELETE /identity/v3/projects/9fb027f5167a469f9ee786bc58ebdae0 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:49.615924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fb08f-cceb-41aa-8dfc-8e7f5bbc37b0 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:49.616218 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fb08f-cceb-41aa-8dfc-8e7f5bbc37b0 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:49.616499 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fb08f-cceb-41aa-8dfc-8e7f5bbc37b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:49.642058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d30662e2-0536-469e-ab8d-6ca0c614ede3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20a94f91b9a4ed0a78db1633a559074'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:49.643428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d30662e2-0536-469e-ab8d-6ca0c614ede3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20a94f91b9a4ed0a78db1633a559074'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:49.644558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d30662e2-0536-469e-ab8d-6ca0c614ede3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20a94f91b9a4ed0a78db1633a559074'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:49.701923 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-da9fb08f-cceb-41aa-8dfc-8e7f5bbc37b0 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:49.708396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-da9fb08f-cceb-41aa-8dfc-8e7f5bbc37b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:49.711020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 905/1822] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:49 2022] DELETE /identity/v3/users/b20a94f91b9a4ed0a78db1633a559074 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:15:49.718756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072295f-abe9-4986-9f28-40e4c0b1f518 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:49.719047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072295f-abe9-4986-9f28-40e4c0b1f518 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:49.721216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072295f-abe9-4986-9f28-40e4c0b1f518 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:49.725035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 906/1823] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:15:49 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:15:49.738768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d724fa-7f27-4ee3-a897-82864194287c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:49.739227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d724fa-7f27-4ee3-a897-82864194287c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:49.739534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d724fa-7f27-4ee3-a897-82864194287c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:49.795740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a3d724fa-7f27-4ee3-a897-82864194287c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:49.804717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a3d724fa-7f27-4ee3-a897-82864194287c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:49.929174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 918/1824] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:49.930756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fb390-e17d-4123-a22e-bbed11a9104e None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:49.931343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fb390-e17d-4123-a22e-bbed11a9104e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:49.931615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fb390-e17d-4123-a22e-bbed11a9104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:49.932661 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:49.990653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-0f0fb390-e17d-4123-a22e-bbed11a9104e None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:50.010256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0f0fb390-e17d-4123-a22e-bbed11a9104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:50.069318 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 907/1825] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:50.071911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542f44-4fec-4fbb-85b6-69ee6f66a4fc None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:50.073135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542f44-4fec-4fbb-85b6-69ee6f66a4fc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:50.073524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542f44-4fec-4fbb-85b6-69ee6f66a4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:50.122717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-57542f44-4fec-4fbb-85b6-69ee6f66a4fc None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:50.124384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-57542f44-4fec-4fbb-85b6-69ee6f66a4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:50.145981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 908/1826] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:50.146894 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57542f44-4fec-4fbb-85b6-69ee6f66a4fc None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:50.155809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-57542f44-4fec-4fbb-85b6-69ee6f66a4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:50.243341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 919/1827] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:15:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:50.244559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fb390-e17d-4123-a22e-bbed11a9104e None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:50.265959 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fb390-e17d-4123-a22e-bbed11a9104e None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:50.273846 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dedab-775e-4c18-8b01-36d418d14994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:50.278876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dedab-775e-4c18-8b01-36d418d14994 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:50.279254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dedab-775e-4c18-8b01-36d418d14994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:50.279432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dedab-775e-4c18-8b01-36d418d14994 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:50.280313 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dedab-775e-4c18-8b01-36d418d14994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:50.280640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dedab-775e-4c18-8b01-36d418d14994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:50.282294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dedab-775e-4c18-8b01-36d418d14994 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:50.296524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57542f44-4fec-4fbb-85b6-69ee6f66a4fc None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:50.307494 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 920/1828] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:50.308297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67e7eb-5f93-4cf0-a9ab-9cb2186832ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:50.308974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67e7eb-5f93-4cf0-a9ab-9cb2186832ef service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:50.309262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67e7eb-5f93-4cf0-a9ab-9cb2186832ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:50.309567 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67e7eb-5f93-4cf0-a9ab-9cb2186832ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:50.312524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dedab-775e-4c18-8b01-36d418d14994 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:50.343370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dedab-775e-4c18-8b01-36d418d14994 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:50.348477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67e7eb-5f93-4cf0-a9ab-9cb2186832ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:50.349958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67e7eb-5f93-4cf0-a9ab-9cb2186832ef service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:50.368237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245007c2-8fa8-4bbb-8cbd-8ca1d6dc8bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:50.368933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245007c2-8fa8-4bbb-8cbd-8ca1d6dc8bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:50.369224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245007c2-8fa8-4bbb-8cbd-8ca1d6dc8bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:50.369510 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245007c2-8fa8-4bbb-8cbd-8ca1d6dc8bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:50.370216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245007c2-8fa8-4bbb-8cbd-8ca1d6dc8bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:50.373818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245007c2-8fa8-4bbb-8cbd-8ca1d6dc8bbc admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:50.381130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 909/1829] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:50.420749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:50.448398 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 921/1830] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:50 2022] POST /identity/v3/projects => generated 409 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:15:50.452164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67e7eb-5f93-4cf0-a9ab-9cb2186832ef service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:50.468207 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67e7eb-5f93-4cf0-a9ab-9cb2186832ef service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:50.522440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245007c2-8fa8-4bbb-8cbd-8ca1d6dc8bbc admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:50.524273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-245007c2-8fa8-4bbb-8cbd-8ca1d6dc8bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:50.664235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b53e6-f319-4bff-a589-4fb2728e5f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:50.666354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b53e6-f319-4bff-a589-4fb2728e5f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:50.666649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b53e6-f319-4bff-a589-4fb2728e5f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:50.667132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b53e6-f319-4bff-a589-4fb2728e5f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:50.668513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b53e6-f319-4bff-a589-4fb2728e5f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:50.673127 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b53e6-f319-4bff-a589-4fb2728e5f65 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:50.678065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245007c2-8fa8-4bbb-8cbd-8ca1d6dc8bbc admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:50.692817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a87df-5acb-4c22-aff7-c1f058110aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:50.693748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a87df-5acb-4c22-aff7-c1f058110aa3 service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:50.693883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a87df-5acb-4c22-aff7-c1f058110aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:50.694109 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a87df-5acb-4c22-aff7-c1f058110aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:50.714861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a87df-5acb-4c22-aff7-c1f058110aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:50.716481 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a87df-5acb-4c22-aff7-c1f058110aa3 service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:50.722789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 910/1831] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:50 2022] POST /identity/v3/users => generated 305 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:50.724116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b53e6-f319-4bff-a589-4fb2728e5f65 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:50.741274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 922/1832] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:50.749760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b53e6-f319-4bff-a589-4fb2728e5f65 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:50.768097 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41350d86-54d3-44d1-b224-732b20597eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:50.768733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41350d86-54d3-44d1-b224-732b20597eff admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:50.770222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41350d86-54d3-44d1-b224-732b20597eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:50.770541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41350d86-54d3-44d1-b224-732b20597eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:50.773505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41350d86-54d3-44d1-b224-732b20597eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:50.776877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41350d86-54d3-44d1-b224-732b20597eff admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:50.801904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 911/1833] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:15:50.805809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a87df-5acb-4c22-aff7-c1f058110aa3 service nova] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:50.831965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a87df-5acb-4c22-aff7-c1f058110aa3 service nova] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:50.849748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1106e-af8f-491c-b394-eb30dbc7c7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:50.850435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1106e-af8f-491c-b394-eb30dbc7c7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:50.850771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1106e-af8f-491c-b394-eb30dbc7c7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:50.851072 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1106e-af8f-491c-b394-eb30dbc7c7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:50.851770 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1106e-af8f-491c-b394-eb30dbc7c7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:50.853390 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1106e-af8f-491c-b394-eb30dbc7c7a6 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:50.878105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 923/1834] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:50.883253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41350d86-54d3-44d1-b224-732b20597eff admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:50.902479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41350d86-54d3-44d1-b224-732b20597eff admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:50.919013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdb319-5103-40fb-b5f4-902354927d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:50.920525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdb319-5103-40fb-b5f4-902354927d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:50.920819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdb319-5103-40fb-b5f4-902354927d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:50.921104 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdb319-5103-40fb-b5f4-902354927d41 admin admin] PATH_INFO: `/v3/projects/606da4ac2b344ad486368c3da110bfc1/users/9180ccb103cd4704a2deb5c97fb767e2/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:51.041141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdb319-5103-40fb-b5f4-902354927d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606da4ac2b344ad486368c3da110bfc1, user_id=9180ccb103cd4704a2deb5c97fb767e2, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:51.046111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdb319-5103-40fb-b5f4-902354927d41 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:51.080795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 912/1835] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:50 2022] PUT /identity/v3/projects/606da4ac2b344ad486368c3da110bfc1/users/9180ccb103cd4704a2deb5c97fb767e2/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:51.091873 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65679c3a-5d6a-4a4a-bfd3-60336eebdfd3 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:51.093373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65679c3a-5d6a-4a4a-bfd3-60336eebdfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:51.093980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65679c3a-5d6a-4a4a-bfd3-60336eebdfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:51.177598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-65679c3a-5d6a-4a4a-bfd3-60336eebdfd3 None None] MFA Rules not processed for user `9180ccb103cd4704a2deb5c97fb767e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:51.182263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-65679c3a-5d6a-4a4a-bfd3-60336eebdfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:51.305902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdb319-5103-40fb-b5f4-902354927d41 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:51.309124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3fcdb319-5103-40fb-b5f4-902354927d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:51.352478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:51.396562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 924/1836] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:51.400446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65679c3a-5d6a-4a4a-bfd3-60336eebdfd3 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:51.508025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdb319-5103-40fb-b5f4-902354927d41 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:51.522044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:51.523182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:51.523654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:51.527170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] PATH_INFO: `/v3/projects/c7cb8eeea674403b81c939cf0c746785` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:51.528454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7cb8eeea674403b81c939cf0c746785)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:51.537672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:51.623688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:51.638247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65679c3a-5d6a-4a4a-bfd3-60336eebdfd3 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:51.674444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55de6b-0311-4073-9f3b-fad5a33e47bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:51.675259 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55de6b-0311-4073-9f3b-fad5a33e47bb admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:51.675533 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55de6b-0311-4073-9f3b-fad5a33e47bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:51.675836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55de6b-0311-4073-9f3b-fad5a33e47bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:51.676547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55de6b-0311-4073-9f3b-fad5a33e47bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:51.679688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55de6b-0311-4073-9f3b-fad5a33e47bb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:51.758557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 925/1837] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:51 2022] POST /identity/v3/projects => generated 407 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:15:51.779670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55de6b-0311-4073-9f3b-fad5a33e47bb admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:51.783809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8f55de6b-0311-4073-9f3b-fad5a33e47bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:51.801783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7cb8eeea674403b81c939cf0c746785', 'request_id': 'req-5887a837-068d-4509-9df0-9ebbd1e43aa1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:51.827311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7cb8eeea674403b81c939cf0c746785', 'request_id': 'req-5887a837-068d-4509-9df0-9ebbd1e43aa1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:51.848064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7cb8eeea674403b81c939cf0c746785', 'request_id': 'req-5887a837-068d-4509-9df0-9ebbd1e43aa1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:51.896688 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] The token cache is being invalidate because project c7cb8eeea674403b81c939cf0c746785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:51.897066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:51.898135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:51.910201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 913/1838] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:51 2022] DELETE /identity/v3/projects/c7cb8eeea674403b81c939cf0c746785 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:51.917241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:51.919625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:51.985680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55de6b-0311-4073-9f3b-fad5a33e47bb admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:51.994219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83acbf-b628-474b-a88f-619379d2eae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:51.995973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83acbf-b628-474b-a88f-619379d2eae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:51.996259 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83acbf-b628-474b-a88f-619379d2eae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:51.996536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83acbf-b628-474b-a88f-619379d2eae0 admin admin] PATH_INFO: `/v3/projects/5e3876e8272847b0a0672088d7eac729` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:51.999294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83acbf-b628-474b-a88f-619379d2eae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e3876e8272847b0a0672088d7eac729)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:52.002908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83acbf-b628-474b-a88f-619379d2eae0 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:52.109639 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a837-068d-4509-9df0-9ebbd1e43aa1 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:52.122282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4b83acbf-b628-474b-a88f-619379d2eae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e3876e8272847b0a0672088d7eac729', 'request_id': 'req-4b83acbf-b628-474b-a88f-619379d2eae0'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:52.144689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4b83acbf-b628-474b-a88f-619379d2eae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e3876e8272847b0a0672088d7eac729', 'request_id': 'req-4b83acbf-b628-474b-a88f-619379d2eae0'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:52.164820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4b83acbf-b628-474b-a88f-619379d2eae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e3876e8272847b0a0672088d7eac729', 'request_id': 'req-4b83acbf-b628-474b-a88f-619379d2eae0'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:52.219331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4b83acbf-b628-474b-a88f-619379d2eae0 admin admin] The token cache is being invalidate because project 5e3876e8272847b0a0672088d7eac729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:52.219331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4b83acbf-b628-474b-a88f-619379d2eae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:52.219331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4b83acbf-b628-474b-a88f-619379d2eae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:52.219331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 926/1839] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:51 2022] DELETE /identity/v3/projects/5e3876e8272847b0a0672088d7eac729 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:52.240937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdca81-50fd-46f5-81c4-c2ddb59d6cc9 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:52.248851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdca81-50fd-46f5-81c4-c2ddb59d6cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:52.251366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdca81-50fd-46f5-81c4-c2ddb59d6cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:52.301964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:52.310777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-cefdca81-50fd-46f5-81c4-c2ddb59d6cc9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:52.312186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-cefdca81-50fd-46f5-81c4-c2ddb59d6cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:52.331150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac403a-4c99-477f-979d-a66a26348058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:52.331840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac403a-4c99-477f-979d-a66a26348058 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:52.332964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac403a-4c99-477f-979d-a66a26348058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:52.333255 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac403a-4c99-477f-979d-a66a26348058 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:52.334075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac403a-4c99-477f-979d-a66a26348058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:52.338072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac403a-4c99-477f-979d-a66a26348058 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:52.402889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 914/1840] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:51 2022] POST /identity/v3/users => generated 310 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:52.404828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac403a-4c99-477f-979d-a66a26348058 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:52.409868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8fac403a-4c99-477f-979d-a66a26348058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:52.433534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac403a-4c99-477f-979d-a66a26348058 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:52.444344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:52.447799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:52.448483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:52.449824 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] PATH_INFO: `/v3/users/b18c2477769d48f391ed8f682c8a264d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:52.451822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18c2477769d48f391ed8f682c8a264d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:52.457207 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:52.520279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 927/1841] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:52.522574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdca81-50fd-46f5-81c4-c2ddb59d6cc9 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:52.533175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-cefdca81-50fd-46f5-81c4-c2ddb59d6cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:52.558442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdca81-50fd-46f5-81c4-c2ddb59d6cc9 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:52.588049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6c5ba-37e9-4737-aa25-a9c79c51ed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:52.598705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6c5ba-37e9-4737-aa25-a9c79c51ed8e admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:52.599183 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6c5ba-37e9-4737-aa25-a9c79c51ed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:52.599564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6c5ba-37e9-4737-aa25-a9c79c51ed8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:52.600442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6c5ba-37e9-4737-aa25-a9c79c51ed8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:52.602253 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6c5ba-37e9-4737-aa25-a9c79c51ed8e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:52.610358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18c2477769d48f391ed8f682c8a264d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:52.626763 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18c2477769d48f391ed8f682c8a264d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:52.627466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 928/1842] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:52.627466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20058d3-41f6-4a5c-9efa-864d3176b937 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:52.627466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20058d3-41f6-4a5c-9efa-864d3176b937 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:52.627466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20058d3-41f6-4a5c-9efa-864d3176b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:52.639419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:52.645693 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18c2477769d48f391ed8f682c8a264d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:52.647682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18c2477769d48f391ed8f682c8a264d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:52.649094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18c2477769d48f391ed8f682c8a264d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:52.657500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d20058d3-41f6-4a5c-9efa-864d3176b937 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:52.661473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d20058d3-41f6-4a5c-9efa-864d3176b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:52.672277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 929/1843] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:52.677942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20058d3-41f6-4a5c-9efa-864d3176b937 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:52.682656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d20058d3-41f6-4a5c-9efa-864d3176b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:52.703625 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20058d3-41f6-4a5c-9efa-864d3176b937 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:52.711502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 915/1844] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:15:52 2022] DELETE /identity/v3/users/b18c2477769d48f391ed8f682c8a264d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:52.713255 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:52.844555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59235759-facd-4d41-aafd-89d8dc5d86d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:52.847474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59235759-facd-4d41-aafd-89d8dc5d86d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:52.847951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59235759-facd-4d41-aafd-89d8dc5d86d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:52.848951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59235759-facd-4d41-aafd-89d8dc5d86d9 admin admin] PATH_INFO: `/v3/projects/228d67c9bf4147a98ef9929b1095f126/users/d504b9bd567a4954b18f12c96b228c7f/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:52.916861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4f790-8f47-44de-9996-e327f5c3061f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:52.930362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe106bb-463c-4ffe-bccd-01e8b9f6a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:52.933625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe106bb-463c-4ffe-bccd-01e8b9f6a505 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:52.934189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe106bb-463c-4ffe-bccd-01e8b9f6a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:52.934711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe106bb-463c-4ffe-bccd-01e8b9f6a505 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:52.935858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe106bb-463c-4ffe-bccd-01e8b9f6a505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:52.936516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe106bb-463c-4ffe-bccd-01e8b9f6a505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:52.938531 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe106bb-463c-4ffe-bccd-01e8b9f6a505 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:52.943605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59235759-facd-4d41-aafd-89d8dc5d86d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228d67c9bf4147a98ef9929b1095f126, user_id=d504b9bd567a4954b18f12c96b228c7f, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:52.946882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59235759-facd-4d41-aafd-89d8dc5d86d9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:52.970596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 930/1845] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:52 2022] PUT /identity/v3/projects/228d67c9bf4147a98ef9929b1095f126/users/d504b9bd567a4954b18f12c96b228c7f/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:52.978393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59235759-facd-4d41-aafd-89d8dc5d86d9 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:52.980004 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 916/1846] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:52.984489 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe106bb-463c-4ffe-bccd-01e8b9f6a505 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:53.021231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe106bb-463c-4ffe-bccd-01e8b9f6a505 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:53.150501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:53.153332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59235759-facd-4d41-aafd-89d8dc5d86d9 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:53.183793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809d26c-d3c6-480c-a003-1ebe910dea05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:53.185489 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809d26c-d3c6-480c-a003-1ebe910dea05 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:53.186906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809d26c-d3c6-480c-a003-1ebe910dea05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:53.187494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809d26c-d3c6-480c-a003-1ebe910dea05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:53.187735 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75f674-d6ea-4afc-b985-2bdce7f319d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:53.188442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75f674-d6ea-4afc-b985-2bdce7f319d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:53.188734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75f674-d6ea-4afc-b985-2bdce7f319d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:53.189019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75f674-d6ea-4afc-b985-2bdce7f319d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:53.190285 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75f674-d6ea-4afc-b985-2bdce7f319d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:53.192437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809d26c-d3c6-480c-a003-1ebe910dea05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:53.194662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75f674-d6ea-4afc-b985-2bdce7f319d0 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:53.195421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809d26c-d3c6-480c-a003-1ebe910dea05 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:53.227115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 931/1847] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:53.232351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75f674-d6ea-4afc-b985-2bdce7f319d0 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:53.261115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 917/1848] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:52 2022] POST /identity/v3/projects => generated 377 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:53.262119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809d26c-d3c6-480c-a003-1ebe910dea05 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:53.268475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75f674-d6ea-4afc-b985-2bdce7f319d0 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:53.462034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809d26c-d3c6-480c-a003-1ebe910dea05 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:53.478698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620074a-2627-4265-88b5-055acdd94a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:53.480041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620074a-2627-4265-88b5-055acdd94a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:53.480971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620074a-2627-4265-88b5-055acdd94a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:53.481668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620074a-2627-4265-88b5-055acdd94a56 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:53.483379 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620074a-2627-4265-88b5-055acdd94a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:53.488370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620074a-2627-4265-88b5-055acdd94a56 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:53.540934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 918/1849] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:53 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:53.543640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620074a-2627-4265-88b5-055acdd94a56 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:53.571500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620074a-2627-4265-88b5-055acdd94a56 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:53.596967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f65e8e-0f8a-48f0-8fd9-3f3f1438c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:53.601127 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f65e8e-0f8a-48f0-8fd9-3f3f1438c9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:53.601562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f65e8e-0f8a-48f0-8fd9-3f3f1438c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:53.603304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f65e8e-0f8a-48f0-8fd9-3f3f1438c9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:53.604210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f65e8e-0f8a-48f0-8fd9-3f3f1438c9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:53.611126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f65e8e-0f8a-48f0-8fd9-3f3f1438c9fb admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:53.639952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 919/1850] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:53.645423 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f65e8e-0f8a-48f0-8fd9-3f3f1438c9fb admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:53.668558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f65e8e-0f8a-48f0-8fd9-3f3f1438c9fb admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:53.689653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404d33-7715-439e-aa2c-6978fb1a7a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:53.690044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404d33-7715-439e-aa2c-6978fb1a7a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:53.690451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404d33-7715-439e-aa2c-6978fb1a7a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:53.690827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404d33-7715-439e-aa2c-6978fb1a7a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:53.691803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404d33-7715-439e-aa2c-6978fb1a7a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:53.693630 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404d33-7715-439e-aa2c-6978fb1a7a8d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:53.718932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 920/1851] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:15:53.720205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404d33-7715-439e-aa2c-6978fb1a7a8d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:53.748482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404d33-7715-439e-aa2c-6978fb1a7a8d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:53.760247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9814a1-46db-4c4d-b1e0-cf422108b0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:53.761725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9814a1-46db-4c4d-b1e0-cf422108b0de admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:53.761725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9814a1-46db-4c4d-b1e0-cf422108b0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:53.761984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9814a1-46db-4c4d-b1e0-cf422108b0de admin admin] PATH_INFO: `/v3/projects/159b9fc3cf7c4739a5e5f59805c161ca/users/8673e73f6e7841d1af714ee29494914e/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:53.818675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9814a1-46db-4c4d-b1e0-cf422108b0de admin admin] RBAC: Authorizing `identity:create_grant(project_id=159b9fc3cf7c4739a5e5f59805c161ca, user_id=8673e73f6e7841d1af714ee29494914e, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:53.826696 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9814a1-46db-4c4d-b1e0-cf422108b0de admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:53.862993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 921/1852] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:53 2022] PUT /identity/v3/projects/159b9fc3cf7c4739a5e5f59805c161ca/users/8673e73f6e7841d1af714ee29494914e/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:15:53.873715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c366d-78b7-4d34-9d3c-3f20269a9f64 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:53.874009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c366d-78b7-4d34-9d3c-3f20269a9f64 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:53.874293 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c366d-78b7-4d34-9d3c-3f20269a9f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:53.876165 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbad15-c6a2-443e-97fc-ea0a4de2592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:53.878238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbad15-c6a2-443e-97fc-ea0a4de2592c admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:53.878382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbad15-c6a2-443e-97fc-ea0a4de2592c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:53.878701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbad15-c6a2-443e-97fc-ea0a4de2592c admin admin] PATH_INFO: `/v3/projects/228d67c9bf4147a98ef9929b1095f126/users/d504b9bd567a4954b18f12c96b228c7f/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:53.889132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbad15-c6a2-443e-97fc-ea0a4de2592c admin admin] RBAC: Authorizing `identity:create_grant(project_id=228d67c9bf4147a98ef9929b1095f126, user_id=d504b9bd567a4954b18f12c96b228c7f, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:53.892029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbad15-c6a2-443e-97fc-ea0a4de2592c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:53.941647 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 932/1853] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:53 2022] PUT /identity/v3/projects/228d67c9bf4147a98ef9929b1095f126/users/d504b9bd567a4954b18f12c96b228c7f/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:15:53.943696 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9de7ac-add2-469a-8b56-bdbc01fec7ff None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:53.944188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9de7ac-add2-469a-8b56-bdbc01fec7ff None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:53.944624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3a2c366d-78b7-4d34-9d3c-3f20269a9f64 None None] MFA Rules not processed for user `8673e73f6e7841d1af714ee29494914e`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:53.944784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9de7ac-add2-469a-8b56-bdbc01fec7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:53.947627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3a2c366d-78b7-4d34-9d3c-3f20269a9f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:53.965834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:53.993579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-7c9de7ac-add2-469a-8b56-bdbc01fec7ff None None] MFA Rules not processed for user `d504b9bd567a4954b18f12c96b228c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:53.997139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-7c9de7ac-add2-469a-8b56-bdbc01fec7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:54.152437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 922/1854] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:54.170545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c366d-78b7-4d34-9d3c-3f20269a9f64 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:54.173342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3a2c366d-78b7-4d34-9d3c-3f20269a9f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:54.179184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 933/1855] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:53 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:54.200019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:54.216474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9de7ac-add2-469a-8b56-bdbc01fec7ff None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:54.219447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-7c9de7ac-add2-469a-8b56-bdbc01fec7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:54.382442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c366d-78b7-4d34-9d3c-3f20269a9f64 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:54.391769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cf218-cc01-4712-9d4a-989d1bb7f584 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31a233e2fc784b01a3a8a24599f3c1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:54.393653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cf218-cc01-4712-9d4a-989d1bb7f584 service glance] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:54.394183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cf218-cc01-4712-9d4a-989d1bb7f584 service glance] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:54.395670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cf218-cc01-4712-9d4a-989d1bb7f584 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:54.426068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9de7ac-add2-469a-8b56-bdbc01fec7ff None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:54.434072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cf218-cc01-4712-9d4a-989d1bb7f584 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:54.435511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cf218-cc01-4712-9d4a-989d1bb7f584 service glance] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:54.457702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3c978-48d8-4d05-a32d-c5fc49733e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:54.458129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3c978-48d8-4d05-a32d-c5fc49733e94 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:54.458734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3c978-48d8-4d05-a32d-c5fc49733e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:54.459209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3c978-48d8-4d05-a32d-c5fc49733e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:54.463749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 923/1856] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:15:54.491297 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3c978-48d8-4d05-a32d-c5fc49733e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:54.492849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3c978-48d8-4d05-a32d-c5fc49733e94 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:54.554975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 934/1857] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:54 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:55.122296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cf218-cc01-4712-9d4a-989d1bb7f584 service glance] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:55.134318 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cf218-cc01-4712-9d4a-989d1bb7f584 service glance] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:55.146480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8072811-80b4-4bef-80ee-77354fa10661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:55.147692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8072811-80b4-4bef-80ee-77354fa10661 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:55.149790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8072811-80b4-4bef-80ee-77354fa10661 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:55.150891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8072811-80b4-4bef-80ee-77354fa10661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:55.154338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c8072811-80b4-4bef-80ee-77354fa10661 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:55.325643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8072811-80b4-4bef-80ee-77354fa10661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:55.327356 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8072811-80b4-4bef-80ee-77354fa10661 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:55.352007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 924/1858] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:15:55.411304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3c978-48d8-4d05-a32d-c5fc49733e94 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:55.413059 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4cc3c978-48d8-4d05-a32d-c5fc49733e94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:55.708211 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3c978-48d8-4d05-a32d-c5fc49733e94 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:55.724878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:55.725772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:55.726054 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:55.726673 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed admin admin] PATH_INFO: `/v3/projects/1927d42c0d284230add255810ccf56a5` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:55.729018 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1927d42c0d284230add255810ccf56a5)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:55.731515 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:55.849245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:55.866587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1927d42c0d284230add255810ccf56a5', 'request_id': 'req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:55.894860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1927d42c0d284230add255810ccf56a5', 'request_id': 'req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:55.910890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1927d42c0d284230add255810ccf56a5', 'request_id': 'req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:55.943580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed admin admin] The token cache is being invalidate because project 1927d42c0d284230add255810ccf56a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:15:55.943898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:55.946998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-be94a2ac-2006-40eb-9ff9-857a0d5a67ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:15:55.951875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 935/1859] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:15:55 2022] DELETE /identity/v3/projects/1927d42c0d284230add255810ccf56a5 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:55.958142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae79f3-7cd7-49e8-b613-ee27d5a0ddeb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:55.958736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae79f3-7cd7-49e8-b613-ee27d5a0ddeb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:55.958885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae79f3-7cd7-49e8-b613-ee27d5a0ddeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:56.007418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b3ae79f3-7cd7-49e8-b613-ee27d5a0ddeb None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:56.009916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b3ae79f3-7cd7-49e8-b613-ee27d5a0ddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:56.171560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 925/1860] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:15:56.180974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0c098-975f-4928-b6d7-89939495216c None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:56.181862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0c098-975f-4928-b6d7-89939495216c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:56.182733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0c098-975f-4928-b6d7-89939495216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:56.225819 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-34a0c098-975f-4928-b6d7-89939495216c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:56.230727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-34a0c098-975f-4928-b6d7-89939495216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:56.257615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 936/1861] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:56.258480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae79f3-7cd7-49e8-b613-ee27d5a0ddeb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:56.272365 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae79f3-7cd7-49e8-b613-ee27d5a0ddeb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:56.290192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c64bd-3804-49b9-9988-81fa4299cbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:56.290986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c64bd-3804-49b9-9988-81fa4299cbcc admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:56.291330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c64bd-3804-49b9-9988-81fa4299cbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:56.291579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c64bd-3804-49b9-9988-81fa4299cbcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:56.292500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c64bd-3804-49b9-9988-81fa4299cbcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:15:56.292815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c64bd-3804-49b9-9988-81fa4299cbcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:56.295221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c64bd-3804-49b9-9988-81fa4299cbcc admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:56.353075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0c098-975f-4928-b6d7-89939495216c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:56.363526 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 926/1862] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:15:56.366101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0c098-975f-4928-b6d7-89939495216c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:56.382232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b994f9-1d62-43b4-ad0e-9ffeb8b529be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:56.382948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b994f9-1d62-43b4-ad0e-9ffeb8b529be admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:56.383229 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b994f9-1d62-43b4-ad0e-9ffeb8b529be admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:56.383683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b994f9-1d62-43b4-ad0e-9ffeb8b529be admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:56.384538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b994f9-1d62-43b4-ad0e-9ffeb8b529be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:56.386606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b994f9-1d62-43b4-ad0e-9ffeb8b529be admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:56.466052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 937/1863] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:56 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:56.466784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c64bd-3804-49b9-9988-81fa4299cbcc admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:56.483671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c64bd-3804-49b9-9988-81fa4299cbcc admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:56.552769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:56.600313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d67918-de35-4714-8ad6-982cfd8ba7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:56.601077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d67918-de35-4714-8ad6-982cfd8ba7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:56.601362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d67918-de35-4714-8ad6-982cfd8ba7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:56.601642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d67918-de35-4714-8ad6-982cfd8ba7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:56.602343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d67918-de35-4714-8ad6-982cfd8ba7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:56.604382 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d67918-de35-4714-8ad6-982cfd8ba7f8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:56.627974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 927/1864] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:56 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:15:56.632285 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b994f9-1d62-43b4-ad0e-9ffeb8b529be admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:56.655076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b994f9-1d62-43b4-ad0e-9ffeb8b529be admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:56.668888 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b823341-d146-4578-8f98-66712470d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:56.669746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b823341-d146-4578-8f98-66712470d800 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:56.671886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b823341-d146-4578-8f98-66712470d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:56.672435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b823341-d146-4578-8f98-66712470d800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:56.676744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b823341-d146-4578-8f98-66712470d800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:56.678662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b823341-d146-4578-8f98-66712470d800 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:56.697107 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 938/1865] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:56.703234 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d67918-de35-4714-8ad6-982cfd8ba7f8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:56.730200 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d67918-de35-4714-8ad6-982cfd8ba7f8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:56.743666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d70d04-0cad-409e-8084-d35080f2a6dd None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:56.744373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d70d04-0cad-409e-8084-d35080f2a6dd None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:56.744951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d70d04-0cad-409e-8084-d35080f2a6dd None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:56.746898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 939/1866] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:15:56.759267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e1055-d1ae-448d-b162-9e2b2e89f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:56.760073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1055-d1ae-448d-b162-9e2b2e89f2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:56.760388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1055-d1ae-448d-b162-9e2b2e89f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:56.760704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1055-d1ae-448d-b162-9e2b2e89f2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:56.761968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e1055-d1ae-448d-b162-9e2b2e89f2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:56.764568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e1055-d1ae-448d-b162-9e2b2e89f2ac admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:56.783331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 928/1867] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:56.784589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d70d04-0cad-409e-8084-d35080f2a6dd None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:56.812822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b415e-4cdf-4ec6-9596-a0f27e96812b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:56.813120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b415e-4cdf-4ec6-9596-a0f27e96812b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:56.813401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b415e-4cdf-4ec6-9596-a0f27e96812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:56.822236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d70d04-0cad-409e-8084-d35080f2a6dd None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:56.868709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23d6f7-25de-48de-adfe-53c409312b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:56.869484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d6f7-25de-48de-adfe-53c409312b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:56.869760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d6f7-25de-48de-adfe-53c409312b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:56.870244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d6f7-25de-48de-adfe-53c409312b85 admin admin] PATH_INFO: `/v3/projects/7973b6831b6343a285a9bcce12003c59/users/29267604fce349dd8251edc9d12d04c4/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:56.891096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-226b415e-4cdf-4ec6-9596-a0f27e96812b None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:56.893297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-226b415e-4cdf-4ec6-9596-a0f27e96812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:56.924049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23d6f7-25de-48de-adfe-53c409312b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7973b6831b6343a285a9bcce12003c59, user_id=29267604fce349dd8251edc9d12d04c4, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:56.931105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23d6f7-25de-48de-adfe-53c409312b85 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:56.989254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 940/1868] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:56 2022] PUT /identity/v3/projects/7973b6831b6343a285a9bcce12003c59/users/29267604fce349dd8251edc9d12d04c4/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:57.003732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946fdb-6281-4491-8656-c509e734f5bd None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:57.006069 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946fdb-6281-4491-8656-c509e734f5bd None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:57.007079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946fdb-6281-4491-8656-c509e734f5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:57.163077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-7f946fdb-6281-4491-8656-c509e734f5bd None None] MFA Rules not processed for user `29267604fce349dd8251edc9d12d04c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:57.164833 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-7f946fdb-6281-4491-8656-c509e734f5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:57.257826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 941/1869] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:57.263078 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946fdb-6281-4491-8656-c509e734f5bd None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:57.341574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 929/1870] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:15:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 532 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:57.426322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:57.456555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946fdb-6281-4491-8656-c509e734f5bd None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:57.471485 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1153d-3fef-4e18-bacc-4881ee0d5a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:57.473102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1153d-3fef-4e18-bacc-4881ee0d5a87 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:57.473387 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1153d-3fef-4e18-bacc-4881ee0d5a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:57.473661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1153d-3fef-4e18-bacc-4881ee0d5a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:57.474367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1153d-3fef-4e18-bacc-4881ee0d5a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:57.480430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1153d-3fef-4e18-bacc-4881ee0d5a87 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:57.519941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 942/1871] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:15:57 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:57.523881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b415e-4cdf-4ec6-9596-a0f27e96812b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:57.542600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b415e-4cdf-4ec6-9596-a0f27e96812b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:57.643274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1153d-3fef-4e18-bacc-4881ee0d5a87 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:57.646643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-46a1153d-3fef-4e18-bacc-4881ee0d5a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:57.665449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3fad5-75de-46f1-93b6-1b3e44bbcff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:57.669772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3fad5-75de-46f1-93b6-1b3e44bbcff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:57.669947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3fad5-75de-46f1-93b6-1b3e44bbcff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:57.675797 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3fad5-75de-46f1-93b6-1b3e44bbcff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:57.682575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3fad5-75de-46f1-93b6-1b3e44bbcff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:57.684649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3fad5-75de-46f1-93b6-1b3e44bbcff8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:57.740007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 930/1872] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:15:57 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:15:57.744084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3fad5-75de-46f1-93b6-1b3e44bbcff8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:57.760815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3fad5-75de-46f1-93b6-1b3e44bbcff8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:57.769844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3524f1d-4a58-4f96-bdd2-9a0d7e4fcb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:57.771658 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3524f1d-4a58-4f96-bdd2-9a0d7e4fcb6b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:57.772249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3524f1d-4a58-4f96-bdd2-9a0d7e4fcb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:57.772937 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3524f1d-4a58-4f96-bdd2-9a0d7e4fcb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:57.774682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3524f1d-4a58-4f96-bdd2-9a0d7e4fcb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:57.776985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3524f1d-4a58-4f96-bdd2-9a0d7e4fcb6b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:57.812437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 931/1873] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:15:57.812437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3524f1d-4a58-4f96-bdd2-9a0d7e4fcb6b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:57.856480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1153d-3fef-4e18-bacc-4881ee0d5a87 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:57.864453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f702cb-75c2-4633-9e8a-ae4291c3120b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:57.864922 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3524f1d-4a58-4f96-bdd2-9a0d7e4fcb6b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:57.865416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f702cb-75c2-4633-9e8a-ae4291c3120b service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:57.865752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f702cb-75c2-4633-9e8a-ae4291c3120b service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:57.866186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f702cb-75c2-4633-9e8a-ae4291c3120b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:57.879063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d363d5d-242c-47ce-ab6b-65265bab94ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:57.879328 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f702cb-75c2-4633-9e8a-ae4291c3120b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:57.879976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d363d5d-242c-47ce-ab6b-65265bab94ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:57.880264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d363d5d-242c-47ce-ab6b-65265bab94ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:57.880543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d363d5d-242c-47ce-ab6b-65265bab94ae admin admin] PATH_INFO: `/v3/projects/fa78c35c6604409dbcd697157761f691/users/486c71d71e8745a88afba8e2b8aeee87/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:57.881296 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f702cb-75c2-4633-9e8a-ae4291c3120b service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:57.895688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 943/1874] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:15:57.914748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d363d5d-242c-47ce-ab6b-65265bab94ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa78c35c6604409dbcd697157761f691, user_id=486c71d71e8745a88afba8e2b8aeee87, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:57.916120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d363d5d-242c-47ce-ab6b-65265bab94ae admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:57.936945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:57.946509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 932/1875] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:57 2022] PUT /identity/v3/projects/fa78c35c6604409dbcd697157761f691/users/486c71d71e8745a88afba8e2b8aeee87/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:15:57.947628 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f702cb-75c2-4633-9e8a-ae4291c3120b service nova] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:57.961798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f702cb-75c2-4633-9e8a-ae4291c3120b service nova] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:58.064080 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb354-0cc6-4476-8655-dcdfe0547368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:58.065376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb354-0cc6-4476-8655-dcdfe0547368 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:58.065726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb354-0cc6-4476-8655-dcdfe0547368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:58.068741 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb354-0cc6-4476-8655-dcdfe0547368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:58.069196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bb354-0cc6-4476-8655-dcdfe0547368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:58.071463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bb354-0cc6-4476-8655-dcdfe0547368 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:58.102841 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 944/1876] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:15:58.104211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d363d5d-242c-47ce-ab6b-65265bab94ae admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:58.122928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d363d5d-242c-47ce-ab6b-65265bab94ae admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:58.130714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cb25f-cd4f-491b-98a8-203cfc4046e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:58.132499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cb25f-cd4f-491b-98a8-203cfc4046e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:58.133249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cb25f-cd4f-491b-98a8-203cfc4046e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:58.134074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cb25f-cd4f-491b-98a8-203cfc4046e9 admin admin] PATH_INFO: `/v3/projects/fa78c35c6604409dbcd697157761f691/users/486c71d71e8745a88afba8e2b8aeee87/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:58.136885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cb25f-cd4f-491b-98a8-203cfc4046e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa78c35c6604409dbcd697157761f691, user_id=486c71d71e8745a88afba8e2b8aeee87, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:58.139935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cb25f-cd4f-491b-98a8-203cfc4046e9 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:58.155598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 933/1877] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:15:58 2022] PUT /identity/v3/projects/fa78c35c6604409dbcd697157761f691/users/486c71d71e8745a88afba8e2b8aeee87/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:15:58.167240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac04708-2fa6-4c49-b725-a2c1d60cfd3a None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:58.167527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac04708-2fa6-4c49-b725-a2c1d60cfd3a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:58.167804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac04708-2fa6-4c49-b725-a2c1d60cfd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:58.217924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-eac04708-2fa6-4c49-b725-a2c1d60cfd3a None None] MFA Rules not processed for user `486c71d71e8745a88afba8e2b8aeee87`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:15:58.219291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-eac04708-2fa6-4c49-b725-a2c1d60cfd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:58.297614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:15:58.334909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 945/1878] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:15:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:15:58.350470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cb25f-cd4f-491b-98a8-203cfc4046e9 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:15:58.352540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2f3cb25f-cd4f-491b-98a8-203cfc4046e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:15:58.426080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cb25f-cd4f-491b-98a8-203cfc4046e9 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:15:58.430712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1caa2-327b-40c3-91d3-961f33379755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:15:58.431363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1caa2-327b-40c3-91d3-961f33379755 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:15:58.431826 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1caa2-327b-40c3-91d3-961f33379755 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:15:58.431950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1caa2-327b-40c3-91d3-961f33379755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:15:58.562739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1caa2-327b-40c3-91d3-961f33379755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:15:58.564769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1caa2-327b-40c3-91d3-961f33379755 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:15:58.598483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 934/1879] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:15:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:01.871580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac04708-2fa6-4c49-b725-a2c1d60cfd3a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:01.873022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-eac04708-2fa6-4c49-b725-a2c1d60cfd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:01.958645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac04708-2fa6-4c49-b725-a2c1d60cfd3a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:01.966826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:01.967562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:01.967938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:01.968288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] PATH_INFO: `/v3/users/9f209ddb2cbb453a944790560a15a38b` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:01.970964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f209ddb2cbb453a944790560a15a38b)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:01.973689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:02.037159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f209ddb2cbb453a944790560a15a38b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:02.050906 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f209ddb2cbb453a944790560a15a38b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:02.051653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f209ddb2cbb453a944790560a15a38b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:02.052966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f209ddb2cbb453a944790560a15a38b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:02.080559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f209ddb2cbb453a944790560a15a38b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:02.112008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 946/1880] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:01 2022] DELETE /identity/v3/users/9f209ddb2cbb453a944790560a15a38b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:02.114252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07605893-d660-44c0-a4b2-a37211730024 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:02.115073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07605893-d660-44c0-a4b2-a37211730024 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:02.115360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07605893-d660-44c0-a4b2-a37211730024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:02.136601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-07605893-d660-44c0-a4b2-a37211730024 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:02.137547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-07605893-d660-44c0-a4b2-a37211730024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:02.222782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 935/1881] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:02.232630 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:02.234037 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:02.316677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349b473-1b1e-4aa6-9423-f2d5d6405c8f admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:02.321804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20142158-080c-4cb4-826c-812f92dd03b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:02.322647 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142158-080c-4cb4-826c-812f92dd03b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:02.323017 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142158-080c-4cb4-826c-812f92dd03b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:02.323432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142158-080c-4cb4-826c-812f92dd03b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:02.335568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20142158-080c-4cb4-826c-812f92dd03b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:02.337010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20142158-080c-4cb4-826c-812f92dd03b7 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:02.348444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 947/1882] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:02.698366 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07605893-d660-44c0-a4b2-a37211730024 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:02.700942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-07605893-d660-44c0-a4b2-a37211730024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:02.732041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07605893-d660-44c0-a4b2-a37211730024 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:02.739718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:02.741535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:02.742032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:02.742519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] PATH_INFO: `/v3/projects/f4589c6c27d54a23a97f1f39d333f81d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:02.744055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4589c6c27d54a23a97f1f39d333f81d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:02.747562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:02.821541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:02.835274 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4589c6c27d54a23a97f1f39d333f81d', 'request_id': 'req-70f902d1-5550-41f4-940f-c687917ee6af'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:02.846192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4589c6c27d54a23a97f1f39d333f81d', 'request_id': 'req-70f902d1-5550-41f4-940f-c687917ee6af'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:02.852675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4589c6c27d54a23a97f1f39d333f81d', 'request_id': 'req-70f902d1-5550-41f4-940f-c687917ee6af'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:02.867075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] The token cache is being invalidate because project f4589c6c27d54a23a97f1f39d333f81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:02.867448 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:02.868190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:02.870475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 936/1883] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:02 2022] DELETE /identity/v3/projects/f4589c6c27d54a23a97f1f39d333f81d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:02.874511 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20142158-080c-4cb4-826c-812f92dd03b7 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:02.885477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20142158-080c-4cb4-826c-812f92dd03b7 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:02.889520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:02.955422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3f27e-1583-4df2-a30e-d69a65fbb727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:02.956429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3f27e-1583-4df2-a30e-d69a65fbb727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:02.956720 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3f27e-1583-4df2-a30e-d69a65fbb727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:02.956998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3f27e-1583-4df2-a30e-d69a65fbb727 admin admin] PATH_INFO: `/v3/users/06daa2396ac94109957a85599bd66f43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:02.958295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3f27e-1583-4df2-a30e-d69a65fbb727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06daa2396ac94109957a85599bd66f43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:02.960276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3f27e-1583-4df2-a30e-d69a65fbb727 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:03.014215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dba3f27e-1583-4df2-a30e-d69a65fbb727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06daa2396ac94109957a85599bd66f43'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:03.024482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dba3f27e-1583-4df2-a30e-d69a65fbb727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06daa2396ac94109957a85599bd66f43'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:03.025216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dba3f27e-1583-4df2-a30e-d69a65fbb727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06daa2396ac94109957a85599bd66f43'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:03.025953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dba3f27e-1583-4df2-a30e-d69a65fbb727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06daa2396ac94109957a85599bd66f43'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:03.043513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dba3f27e-1583-4df2-a30e-d69a65fbb727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06daa2396ac94109957a85599bd66f43'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:03.058292 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 948/1884] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:02 2022] DELETE /identity/v3/users/06daa2396ac94109957a85599bd66f43 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:03.329326 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:03.334936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:03.348306 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f902d1-5550-41f4-940f-c687917ee6af admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:03.422392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:03.422392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:03.422392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:03.422392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00 admin admin] PATH_INFO: `/v3/projects/f56691c0fa2142ac9782358f3e3c0292` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:03.424945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56691c0fa2142ac9782358f3e3c0292)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:03.425607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:03.478304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56691c0fa2142ac9782358f3e3c0292', 'request_id': 'req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:03.484529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56691c0fa2142ac9782358f3e3c0292', 'request_id': 'req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:03.490461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56691c0fa2142ac9782358f3e3c0292', 'request_id': 'req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:03.505458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00 admin admin] The token cache is being invalidate because project f56691c0fa2142ac9782358f3e3c0292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:03.505963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:03.508106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fd9cbb52-2438-4cb2-a8f0-9fdddbaabf00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:03.510701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 937/1885] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:03 2022] DELETE /identity/v3/projects/f56691c0fa2142ac9782358f3e3c0292 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:03.515280 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c50e5f-962b-4b74-ba4f-5bc2d3d4115d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:03.515641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c50e5f-962b-4b74-ba4f-5bc2d3d4115d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:03.516119 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c50e5f-962b-4b74-ba4f-5bc2d3d4115d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:03.535070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f4c50e5f-962b-4b74-ba4f-5bc2d3d4115d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:03.536281 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f4c50e5f-962b-4b74-ba4f-5bc2d3d4115d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:03.599624 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 949/1886] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:03.607245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292d72-d637-46c5-853c-4000d9b34bac None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:03.607530 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292d72-d637-46c5-853c-4000d9b34bac None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:03.607800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292d72-d637-46c5-853c-4000d9b34bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:03.628100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7c292d72-d637-46c5-853c-4000d9b34bac None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:03.629305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7c292d72-d637-46c5-853c-4000d9b34bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:03.637156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 938/1887] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:03.641568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c50e5f-962b-4b74-ba4f-5bc2d3d4115d None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:03.651898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c50e5f-962b-4b74-ba4f-5bc2d3d4115d None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:03.656466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19599b6c-b20b-4386-869a-2d80cf6b1273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:03.657124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19599b6c-b20b-4386-869a-2d80cf6b1273 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:03.657403 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19599b6c-b20b-4386-869a-2d80cf6b1273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:03.658547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19599b6c-b20b-4386-869a-2d80cf6b1273 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:03.659332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19599b6c-b20b-4386-869a-2d80cf6b1273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:03.659637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19599b6c-b20b-4386-869a-2d80cf6b1273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:03.661259 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19599b6c-b20b-4386-869a-2d80cf6b1273 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:03.673333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 950/1888] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:03.678338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c292d72-d637-46c5-853c-4000d9b34bac None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:03.689136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c292d72-d637-46c5-853c-4000d9b34bac None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:03.694084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e459362-382a-4e6c-bb58-35702032c328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:03.694774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e459362-382a-4e6c-bb58-35702032c328 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:03.695054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e459362-382a-4e6c-bb58-35702032c328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:03.695324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e459362-382a-4e6c-bb58-35702032c328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:03.696023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e459362-382a-4e6c-bb58-35702032c328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:03.697909 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e459362-382a-4e6c-bb58-35702032c328 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:03.745501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 939/1889] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:03 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:03.750583 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19599b6c-b20b-4386-869a-2d80cf6b1273 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:03.761569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19599b6c-b20b-4386-869a-2d80cf6b1273 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:03.772668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:03.843526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bfc3d-3498-44e5-b6e6-752fa485d7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:03.844213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bfc3d-3498-44e5-b6e6-752fa485d7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:03.844521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bfc3d-3498-44e5-b6e6-752fa485d7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:03.844799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bfc3d-3498-44e5-b6e6-752fa485d7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:03.846065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bfc3d-3498-44e5-b6e6-752fa485d7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:03.848077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bfc3d-3498-44e5-b6e6-752fa485d7e6 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:03.874469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 951/1890] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:03 2022] POST /identity/v3/users => generated 282 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:03.875599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e459362-382a-4e6c-bb58-35702032c328 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:03.886206 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e459362-382a-4e6c-bb58-35702032c328 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:03.890982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2f157-4791-4d2f-ba20-a15e03ec5692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:03.891796 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2f157-4791-4d2f-ba20-a15e03ec5692 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:03.892592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2f157-4791-4d2f-ba20-a15e03ec5692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:03.892883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2f157-4791-4d2f-ba20-a15e03ec5692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:03.893622 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2f157-4791-4d2f-ba20-a15e03ec5692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:03.896804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2f157-4791-4d2f-ba20-a15e03ec5692 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:03.906934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 940/1891] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:03.911882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bfc3d-3498-44e5-b6e6-752fa485d7e6 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:03.922257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bfc3d-3498-44e5-b6e6-752fa485d7e6 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:03.928184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a51e6-1c6a-4d42-8245-69a259be8fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:03.931525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a51e6-1c6a-4d42-8245-69a259be8fde admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:03.931787 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a51e6-1c6a-4d42-8245-69a259be8fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:03.932016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a51e6-1c6a-4d42-8245-69a259be8fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:03.932772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a51e6-1c6a-4d42-8245-69a259be8fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:03.934406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a51e6-1c6a-4d42-8245-69a259be8fde admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:03.946257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 952/1892] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:03.950475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2f157-4791-4d2f-ba20-a15e03ec5692 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:03.961691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2f157-4791-4d2f-ba20-a15e03ec5692 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:03.969784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b1b9c-4bcc-4de7-9d1a-b5e094241876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:03.971566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b1b9c-4bcc-4de7-9d1a-b5e094241876 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:03.971839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b1b9c-4bcc-4de7-9d1a-b5e094241876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:03.972107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b1b9c-4bcc-4de7-9d1a-b5e094241876 admin admin] PATH_INFO: `/v3/projects/8344d72338cd41cda442c968856e5b15/users/13b06c9763be4d7989a41a907684d72e/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:03.987567 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:03.995799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b1b9c-4bcc-4de7-9d1a-b5e094241876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8344d72338cd41cda442c968856e5b15, user_id=13b06c9763be4d7989a41a907684d72e, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:03.999374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b1b9c-4bcc-4de7-9d1a-b5e094241876 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:04.021290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 941/1893] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:03 2022] PUT /identity/v3/projects/8344d72338cd41cda442c968856e5b15/users/13b06c9763be4d7989a41a907684d72e/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:04.031975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e8224-bf18-42c2-9a05-fe2524f60465 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:04.032491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e8224-bf18-42c2-9a05-fe2524f60465 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:04.033413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e8224-bf18-42c2-9a05-fe2524f60465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:04.073201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-674e8224-bf18-42c2-9a05-fe2524f60465 None None] MFA Rules not processed for user `13b06c9763be4d7989a41a907684d72e`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:04.075218 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-674e8224-bf18-42c2-9a05-fe2524f60465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:04.162447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 953/1894] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:04.166920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b1b9c-4bcc-4de7-9d1a-b5e094241876 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:04.234596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b1b9c-4bcc-4de7-9d1a-b5e094241876 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:04.239781 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a6550-123a-4376-8668-c35371d20486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:04.240432 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a6550-123a-4376-8668-c35371d20486 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:04.240711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a6550-123a-4376-8668-c35371d20486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:04.240988 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a6550-123a-4376-8668-c35371d20486 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:04.241679 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a6550-123a-4376-8668-c35371d20486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:04.243605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a6550-123a-4376-8668-c35371d20486 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:04.269136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 942/1895] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:04 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:04.273166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e8224-bf18-42c2-9a05-fe2524f60465 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:04.284786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e8224-bf18-42c2-9a05-fe2524f60465 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:04.347480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15813a-ab46-4567-ae66-65b4ae1c36a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:04.348345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15813a-ab46-4567-ae66-65b4ae1c36a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:04.348633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15813a-ab46-4567-ae66-65b4ae1c36a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:04.348910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15813a-ab46-4567-ae66-65b4ae1c36a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:04.349609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15813a-ab46-4567-ae66-65b4ae1c36a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:04.351676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15813a-ab46-4567-ae66-65b4ae1c36a4 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:04.372254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 954/1896] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:04 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:04.377498 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a6550-123a-4376-8668-c35371d20486 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:04.388759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a6550-123a-4376-8668-c35371d20486 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:04.393461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986af436-6ea1-4521-a978-bc32a232279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:04.394124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986af436-6ea1-4521-a978-bc32a232279d admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:04.394407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986af436-6ea1-4521-a978-bc32a232279d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:04.394754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986af436-6ea1-4521-a978-bc32a232279d admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:04.395482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986af436-6ea1-4521-a978-bc32a232279d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:04.397082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986af436-6ea1-4521-a978-bc32a232279d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:04.409668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 943/1897] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:04.414030 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15813a-ab46-4567-ae66-65b4ae1c36a4 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:04.428691 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15813a-ab46-4567-ae66-65b4ae1c36a4 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:04.433366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5440673-4c0e-4b14-a08c-a23ef544df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:04.434258 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5440673-4c0e-4b14-a08c-a23ef544df6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:04.434539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5440673-4c0e-4b14-a08c-a23ef544df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:04.434854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5440673-4c0e-4b14-a08c-a23ef544df6c admin admin] PATH_INFO: `/v3/projects/2ab10fd03267482588bba6b3ad35916f/users/8c8f2fd45b4b4abb9ff08b3d4fea477d/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:04.443868 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:04.451152 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5440673-4c0e-4b14-a08c-a23ef544df6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab10fd03267482588bba6b3ad35916f, user_id=8c8f2fd45b4b4abb9ff08b3d4fea477d, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:04.453810 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5440673-4c0e-4b14-a08c-a23ef544df6c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:04.469859 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 955/1898] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:04 2022] PUT /identity/v3/projects/2ab10fd03267482588bba6b3ad35916f/users/8c8f2fd45b4b4abb9ff08b3d4fea477d/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:04.475850 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986af436-6ea1-4521-a978-bc32a232279d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:04.488424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986af436-6ea1-4521-a978-bc32a232279d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:04.553547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e668d0d-3705-40e1-944e-f67adacbdb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:04.554218 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e668d0d-3705-40e1-944e-f67adacbdb5b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:04.555348 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e668d0d-3705-40e1-944e-f67adacbdb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:04.555647 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e668d0d-3705-40e1-944e-f67adacbdb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:04.556399 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e668d0d-3705-40e1-944e-f67adacbdb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:04.558738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e668d0d-3705-40e1-944e-f67adacbdb5b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:04.569979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 944/1899] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:04.574333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5440673-4c0e-4b14-a08c-a23ef544df6c admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:04.585647 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5440673-4c0e-4b14-a08c-a23ef544df6c admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:04.590687 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ece510-c7a4-4df0-ad56-338be9aa3189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:04.591819 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ece510-c7a4-4df0-ad56-338be9aa3189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:04.592208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ece510-c7a4-4df0-ad56-338be9aa3189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:04.592541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ece510-c7a4-4df0-ad56-338be9aa3189 admin admin] PATH_INFO: `/v3/projects/2ab10fd03267482588bba6b3ad35916f/users/8c8f2fd45b4b4abb9ff08b3d4fea477d/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:04.594722 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ece510-c7a4-4df0-ad56-338be9aa3189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab10fd03267482588bba6b3ad35916f, user_id=8c8f2fd45b4b4abb9ff08b3d4fea477d, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:04.598960 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ece510-c7a4-4df0-ad56-338be9aa3189 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:04.610294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 956/1900] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:04 2022] PUT /identity/v3/projects/2ab10fd03267482588bba6b3ad35916f/users/8c8f2fd45b4b4abb9ff08b3d4fea477d/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:04.621953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966f665-e8f2-4441-8b33-0b42ecde5c2a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:04.622250 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966f665-e8f2-4441-8b33-0b42ecde5c2a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:04.622519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966f665-e8f2-4441-8b33-0b42ecde5c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:04.650302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0966f665-e8f2-4441-8b33-0b42ecde5c2a None None] MFA Rules not processed for user `8c8f2fd45b4b4abb9ff08b3d4fea477d`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:04.651552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0966f665-e8f2-4441-8b33-0b42ecde5c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:04.700459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:04.724535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 945/1901] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:04.736621 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ece510-c7a4-4df0-ad56-338be9aa3189 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:04.738159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-05ece510-c7a4-4df0-ad56-338be9aa3189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:04.798487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ece510-c7a4-4df0-ad56-338be9aa3189 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:04.802351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1642a7-bca9-4a55-a562-5a75340b1f19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:04.803029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1642a7-bca9-4a55-a562-5a75340b1f19 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:04.803311 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1642a7-bca9-4a55-a562-5a75340b1f19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:04.803587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1642a7-bca9-4a55-a562-5a75340b1f19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:04.812496 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1642a7-bca9-4a55-a562-5a75340b1f19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:04.813973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1642a7-bca9-4a55-a562-5a75340b1f19 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:04.824563 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 957/1902] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:04 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:04.898010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966f665-e8f2-4441-8b33-0b42ecde5c2a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:04.899469 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0966f665-e8f2-4441-8b33-0b42ecde5c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:04.911832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966f665-e8f2-4441-8b33-0b42ecde5c2a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:04.915457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cefab-a380-4fcf-9a46-e2a6ed721188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:04.916099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cefab-a380-4fcf-9a46-e2a6ed721188 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:04.916381 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cefab-a380-4fcf-9a46-e2a6ed721188 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:04.916659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cefab-a380-4fcf-9a46-e2a6ed721188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:04.974668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cefab-a380-4fcf-9a46-e2a6ed721188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:04.976687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cefab-a380-4fcf-9a46-e2a6ed721188 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:04.985071 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 946/1903] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:04 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:05.461961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1642a7-bca9-4a55-a562-5a75340b1f19 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:05.470520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1642a7-bca9-4a55-a562-5a75340b1f19 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:05.474275 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be40008-3c65-4546-bcfd-65e8da44063b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:05.474951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be40008-3c65-4546-bcfd-65e8da44063b service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:05.475216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be40008-3c65-4546-bcfd-65e8da44063b service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:05.475506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be40008-3c65-4546-bcfd-65e8da44063b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:05.477341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9be40008-3c65-4546-bcfd-65e8da44063b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:05.555435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be40008-3c65-4546-bcfd-65e8da44063b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:05.556946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be40008-3c65-4546-bcfd-65e8da44063b service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:05.569138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 958/1904] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:16:05.839339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ec91e-0b9c-4283-9b24-121e202c1f70 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:05.839957 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ec91e-0b9c-4283-9b24-121e202c1f70 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:05.840141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ec91e-0b9c-4283-9b24-121e202c1f70 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:05.842705 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 947/1905] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:16:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:16:05.854895 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768999e-bec9-4b88-a5ee-eae98e71c5b5 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:05.855088 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768999e-bec9-4b88-a5ee-eae98e71c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:05.855904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768999e-bec9-4b88-a5ee-eae98e71c5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:05.884631 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-4768999e-bec9-4b88-a5ee-eae98e71c5b5 None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:05.885987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4768999e-bec9-4b88-a5ee-eae98e71c5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:05.994796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 959/1906] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:16:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:06.006568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ec91e-0b9c-4283-9b24-121e202c1f70 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:06.008340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-479ec91e-0b9c-4283-9b24-121e202c1f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:06.029214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ec91e-0b9c-4283-9b24-121e202c1f70 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:06.037926 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08b9d8-bb2e-4c7e-b5d3-1113b598ea20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:06.038882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08b9d8-bb2e-4c7e-b5d3-1113b598ea20 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:06.039177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08b9d8-bb2e-4c7e-b5d3-1113b598ea20 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:06.039398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08b9d8-bb2e-4c7e-b5d3-1113b598ea20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:06.051860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08b9d8-bb2e-4c7e-b5d3-1113b598ea20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:06.054151 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08b9d8-bb2e-4c7e-b5d3-1113b598ea20 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:06.068470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 948/1907] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:06.149942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768999e-bec9-4b88-a5ee-eae98e71c5b5 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:06.152756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4768999e-bec9-4b88-a5ee-eae98e71c5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:06.159599 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:06.239711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768999e-bec9-4b88-a5ee-eae98e71c5b5 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:06.243976 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:06.244693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:06.244976 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:06.245249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] PATH_INFO: `/v3/users/9180ccb103cd4704a2deb5c97fb767e2` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:06.246450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9180ccb103cd4704a2deb5c97fb767e2)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:06.248658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:06.341315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9180ccb103cd4704a2deb5c97fb767e2'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:06.354669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9180ccb103cd4704a2deb5c97fb767e2'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:06.355301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9180ccb103cd4704a2deb5c97fb767e2'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:06.356017 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9180ccb103cd4704a2deb5c97fb767e2'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:06.370768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9180ccb103cd4704a2deb5c97fb767e2'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:06.406689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 960/1908] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:06 2022] DELETE /identity/v3/users/9180ccb103cd4704a2deb5c97fb767e2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:06.413672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ebca1-84a8-40c8-9798-d52b5493b75a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:06.416677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ebca1-84a8-40c8-9798-d52b5493b75a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:06.417080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ebca1-84a8-40c8-9798-d52b5493b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:06.450699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-165ebca1-84a8-40c8-9798-d52b5493b75a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:06.452064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-165ebca1-84a8-40c8-9798-d52b5493b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:06.539733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 949/1909] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:06.550480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:06.552096 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:06.661594 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1026b-fcf1-433a-bd8a-013c1ab25369 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:06.665924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809beb4d-3701-4b30-a983-09fffaf9a324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:06.666588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809beb4d-3701-4b30-a983-09fffaf9a324 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:06.666903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809beb4d-3701-4b30-a983-09fffaf9a324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:06.667741 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809beb4d-3701-4b30-a983-09fffaf9a324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:06.683230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809beb4d-3701-4b30-a983-09fffaf9a324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:06.692139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809beb4d-3701-4b30-a983-09fffaf9a324 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:06.710248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 961/1910] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:07.023826 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ebca1-84a8-40c8-9798-d52b5493b75a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:07.025495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-165ebca1-84a8-40c8-9798-d52b5493b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:07.044224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ebca1-84a8-40c8-9798-d52b5493b75a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:07.053106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:07.054412 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:07.054801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:07.054988 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] PATH_INFO: `/v3/projects/606da4ac2b344ad486368c3da110bfc1` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:07.056204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] RBAC: Authorizing `identity:delete_project(project_id=606da4ac2b344ad486368c3da110bfc1)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:07.058154 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:07.103961 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606da4ac2b344ad486368c3da110bfc1', 'request_id': 'req-cde056b9-c5c3-4171-b622-7b7cdafd212e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.111212 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606da4ac2b344ad486368c3da110bfc1', 'request_id': 'req-cde056b9-c5c3-4171-b622-7b7cdafd212e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.116862 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606da4ac2b344ad486368c3da110bfc1', 'request_id': 'req-cde056b9-c5c3-4171-b622-7b7cdafd212e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.120358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:07.132251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] The token cache is being invalidate because project 606da4ac2b344ad486368c3da110bfc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:07.132541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.133216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.134811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 950/1911] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:07 2022] DELETE /identity/v3/projects/606da4ac2b344ad486368c3da110bfc1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:07.138767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809beb4d-3701-4b30-a983-09fffaf9a324 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:07.148283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809beb4d-3701-4b30-a983-09fffaf9a324 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:07.167919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:07.207714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bd3e1-9670-4c0f-9f6f-2ce8aab972f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:07.208590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bd3e1-9670-4c0f-9f6f-2ce8aab972f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:07.208873 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bd3e1-9670-4c0f-9f6f-2ce8aab972f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:07.209147 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bd3e1-9670-4c0f-9f6f-2ce8aab972f2 admin admin] PATH_INFO: `/v3/users/d504b9bd567a4954b18f12c96b228c7f` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:07.210358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bd3e1-9670-4c0f-9f6f-2ce8aab972f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d504b9bd567a4954b18f12c96b228c7f)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:07.212353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bd3e1-9670-4c0f-9f6f-2ce8aab972f2 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:07.260037 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e85bd3e1-9670-4c0f-9f6f-2ce8aab972f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd504b9bd567a4954b18f12c96b228c7f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.266815 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e85bd3e1-9670-4c0f-9f6f-2ce8aab972f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd504b9bd567a4954b18f12c96b228c7f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.268215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e85bd3e1-9670-4c0f-9f6f-2ce8aab972f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd504b9bd567a4954b18f12c96b228c7f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.268821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e85bd3e1-9670-4c0f-9f6f-2ce8aab972f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd504b9bd567a4954b18f12c96b228c7f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.280290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e85bd3e1-9670-4c0f-9f6f-2ce8aab972f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd504b9bd567a4954b18f12c96b228c7f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.293898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 962/1912] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:07 2022] DELETE /identity/v3/users/d504b9bd567a4954b18f12c96b228c7f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:07.569193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:07.571028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:07.590185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde056b9-c5c3-4171-b622-7b7cdafd212e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:07.660518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81628cc4-092f-4e8b-a618-db9af77e7bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:07.661409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81628cc4-092f-4e8b-a618-db9af77e7bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:07.661696 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81628cc4-092f-4e8b-a618-db9af77e7bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:07.661985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81628cc4-092f-4e8b-a618-db9af77e7bb4 admin admin] PATH_INFO: `/v3/projects/228d67c9bf4147a98ef9929b1095f126` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:07.663311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81628cc4-092f-4e8b-a618-db9af77e7bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=228d67c9bf4147a98ef9929b1095f126)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:07.665239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81628cc4-092f-4e8b-a618-db9af77e7bb4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:07.714078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-81628cc4-092f-4e8b-a618-db9af77e7bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228d67c9bf4147a98ef9929b1095f126', 'request_id': 'req-81628cc4-092f-4e8b-a618-db9af77e7bb4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.723729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-81628cc4-092f-4e8b-a618-db9af77e7bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228d67c9bf4147a98ef9929b1095f126', 'request_id': 'req-81628cc4-092f-4e8b-a618-db9af77e7bb4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.731781 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-81628cc4-092f-4e8b-a618-db9af77e7bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228d67c9bf4147a98ef9929b1095f126', 'request_id': 'req-81628cc4-092f-4e8b-a618-db9af77e7bb4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.746191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-81628cc4-092f-4e8b-a618-db9af77e7bb4 admin admin] The token cache is being invalidate because project 228d67c9bf4147a98ef9929b1095f126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:07.746461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-81628cc4-092f-4e8b-a618-db9af77e7bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.747058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-81628cc4-092f-4e8b-a618-db9af77e7bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:07.749152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 951/1913] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:07 2022] DELETE /identity/v3/projects/228d67c9bf4147a98ef9929b1095f126 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:07.754111 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d4afd-7376-4020-8fe3-50e208c2145b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:07.754560 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d4afd-7376-4020-8fe3-50e208c2145b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:07.754786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d4afd-7376-4020-8fe3-50e208c2145b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:07.774059 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-019d4afd-7376-4020-8fe3-50e208c2145b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:07.775522 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-019d4afd-7376-4020-8fe3-50e208c2145b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:07.852455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 963/1914] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:07.860106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8a354-1be9-44c4-94cf-2caaaa131ea5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:07.860396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8a354-1be9-44c4-94cf-2caaaa131ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:07.861244 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8a354-1be9-44c4-94cf-2caaaa131ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:07.885958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-33d8a354-1be9-44c4-94cf-2caaaa131ea5 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:07.887213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-33d8a354-1be9-44c4-94cf-2caaaa131ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:07.897668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 952/1915] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:07.902439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d4afd-7376-4020-8fe3-50e208c2145b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:07.917586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d4afd-7376-4020-8fe3-50e208c2145b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:07.931751 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c983767-2817-49e6-983c-362d592300db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:07.932433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c983767-2817-49e6-983c-362d592300db admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:07.932724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c983767-2817-49e6-983c-362d592300db admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:07.933009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c983767-2817-49e6-983c-362d592300db admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:07.933802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c983767-2817-49e6-983c-362d592300db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:07.934229 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c983767-2817-49e6-983c-362d592300db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:07.935860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c983767-2817-49e6-983c-362d592300db admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:07.940582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8a354-1be9-44c4-94cf-2caaaa131ea5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:07.942300 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-33d8a354-1be9-44c4-94cf-2caaaa131ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:07.949524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 964/1916] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:16:07.953681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c983767-2817-49e6-983c-362d592300db admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:07.958245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8a354-1be9-44c4-94cf-2caaaa131ea5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:07.963767 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c46793-b345-45e2-850b-41215e788aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:07.964673 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c46793-b345-45e2-850b-41215e788aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:07.964906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c46793-b345-45e2-850b-41215e788aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:07.965006 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c983767-2817-49e6-983c-362d592300db admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:07.965179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c46793-b345-45e2-850b-41215e788aeb admin admin] PATH_INFO: `/v3/users/13b06c9763be4d7989a41a907684d72e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:07.966377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c46793-b345-45e2-850b-41215e788aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b06c9763be4d7989a41a907684d72e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:07.968327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c46793-b345-45e2-850b-41215e788aeb admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:07.971732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a93b1-2138-4275-bc3f-ca353aafa2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:07.972375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a93b1-2138-4275-bc3f-ca353aafa2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:07.972664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a93b1-2138-4275-bc3f-ca353aafa2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:07.972942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a93b1-2138-4275-bc3f-ca353aafa2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:07.973630 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a93b1-2138-4275-bc3f-ca353aafa2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:07.976933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a93b1-2138-4275-bc3f-ca353aafa2b6 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:08.021843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 965/1917] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:07 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:08.023141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a93b1-2138-4275-bc3f-ca353aafa2b6 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:08.025020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b8c46793-b345-45e2-850b-41215e788aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b06c9763be4d7989a41a907684d72e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.032025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b8c46793-b345-45e2-850b-41215e788aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b06c9763be4d7989a41a907684d72e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.032855 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:08.039449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b8c46793-b345-45e2-850b-41215e788aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b06c9763be4d7989a41a907684d72e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.040143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b8c46793-b345-45e2-850b-41215e788aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b06c9763be4d7989a41a907684d72e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.040772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b8c46793-b345-45e2-850b-41215e788aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b06c9763be4d7989a41a907684d72e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.048866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:08.061987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 953/1918] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:07 2022] DELETE /identity/v3/users/13b06c9763be4d7989a41a907684d72e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:08.067363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f491a-551a-4a35-a800-96e5b8187e36 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.067628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f491a-551a-4a35-a800-96e5b8187e36 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.067912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f491a-551a-4a35-a800-96e5b8187e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.086439 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5a8f491a-551a-4a35-a800-96e5b8187e36 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:08.087708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5a8f491a-551a-4a35-a800-96e5b8187e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:08.100324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a93b1-2138-4275-bc3f-ca353aafa2b6 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:08.161870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 954/1919] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:08.163175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e1881-f16e-469c-bee3-2420032e311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:08.163851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e1881-f16e-469c-bee3-2420032e311a admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.164130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e1881-f16e-469c-bee3-2420032e311a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.164405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e1881-f16e-469c-bee3-2420032e311a admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.165094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e1881-f16e-469c-bee3-2420032e311a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:08.167073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e1881-f16e-469c-bee3-2420032e311a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:08.171799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f491a-551a-4a35-a800-96e5b8187e36 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:08.173171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5a8f491a-551a-4a35-a800-96e5b8187e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:08.188060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 966/1920] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:08 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:08.192571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e1881-f16e-469c-bee3-2420032e311a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:08.194274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-fe8e1881-f16e-469c-bee3-2420032e311a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:08.206240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e1881-f16e-469c-bee3-2420032e311a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:08.213856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf1ddf-f708-4a1b-9381-122549fda6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:08.214536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf1ddf-f708-4a1b-9381-122549fda6dd admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.214851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf1ddf-f708-4a1b-9381-122549fda6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.215235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf1ddf-f708-4a1b-9381-122549fda6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.216547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf1ddf-f708-4a1b-9381-122549fda6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:08.217608 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf1ddf-f708-4a1b-9381-122549fda6dd admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:08.229892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 967/1921] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:08.242261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf1ddf-f708-4a1b-9381-122549fda6dd admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:08.249098 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f491a-551a-4a35-a800-96e5b8187e36 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:08.253796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf1ddf-f708-4a1b-9381-122549fda6dd admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:08.254240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabb768-57f0-4374-ba4c-80d01a70edc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:08.254926 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabb768-57f0-4374-ba4c-80d01a70edc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.255213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabb768-57f0-4374-ba4c-80d01a70edc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.255501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabb768-57f0-4374-ba4c-80d01a70edc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.261862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5ec38-f0d0-4102-bbf9-548880912d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:08.262566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5ec38-f0d0-4102-bbf9-548880912d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.262897 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5ec38-f0d0-4102-bbf9-548880912d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.263175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5ec38-f0d0-4102-bbf9-548880912d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.263929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5ec38-f0d0-4102-bbf9-548880912d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:08.265613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5ec38-f0d0-4102-bbf9-548880912d25 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:08.268723 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabb768-57f0-4374-ba4c-80d01a70edc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:08.270160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabb768-57f0-4374-ba4c-80d01a70edc9 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:08.277300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 968/1922] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:08.279882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 955/1923] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:16:08.281543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5ec38-f0d0-4102-bbf9-548880912d25 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:08.294393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5ec38-f0d0-4102-bbf9-548880912d25 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:08.300315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38721e71-af23-48e3-b48c-8da2813cbd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:08.301261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38721e71-af23-48e3-b48c-8da2813cbd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.301508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38721e71-af23-48e3-b48c-8da2813cbd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.301765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38721e71-af23-48e3-b48c-8da2813cbd06 admin admin] PATH_INFO: `/v3/projects/b556eecf916240c8a1fbe050c377bb78/users/6841a99c542e42068777479246511b77/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.317424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38721e71-af23-48e3-b48c-8da2813cbd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b556eecf916240c8a1fbe050c377bb78, user_id=6841a99c542e42068777479246511b77, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:08.320347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38721e71-af23-48e3-b48c-8da2813cbd06 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:08.335623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 969/1924] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:08 2022] PUT /identity/v3/projects/b556eecf916240c8a1fbe050c377bb78/users/6841a99c542e42068777479246511b77/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:08.347947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19560ef-f92e-433a-8b0d-6ab768208987 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.348425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19560ef-f92e-433a-8b0d-6ab768208987 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.348898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19560ef-f92e-433a-8b0d-6ab768208987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.385171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e19560ef-f92e-433a-8b0d-6ab768208987 None None] MFA Rules not processed for user `6841a99c542e42068777479246511b77`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:08.386521 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e19560ef-f92e-433a-8b0d-6ab768208987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:08.460068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 956/1925] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:08.465684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38721e71-af23-48e3-b48c-8da2813cbd06 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:08.538202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38721e71-af23-48e3-b48c-8da2813cbd06 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:08.543261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda4e4f-0031-479d-a5f3-8fcf69ffbfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:08.543924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda4e4f-0031-479d-a5f3-8fcf69ffbfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.544210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda4e4f-0031-479d-a5f3-8fcf69ffbfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.544488 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda4e4f-0031-479d-a5f3-8fcf69ffbfe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.545180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda4e4f-0031-479d-a5f3-8fcf69ffbfe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:08.547137 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda4e4f-0031-479d-a5f3-8fcf69ffbfe0 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:08.551044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:08.582436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 970/1926] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:08 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:08.583596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19560ef-f92e-433a-8b0d-6ab768208987 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:08.585066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda4e4f-0031-479d-a5f3-8fcf69ffbfe0 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:08.585216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e19560ef-f92e-433a-8b0d-6ab768208987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:08.600699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19560ef-f92e-433a-8b0d-6ab768208987 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:08.629576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:08.667384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda4e4f-0031-479d-a5f3-8fcf69ffbfe0 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:08.671552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:08.672244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423a800-db2e-45b4-b96b-fc3cbcc9eb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:08.672588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.672887 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.673002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423a800-db2e-45b4-b96b-fc3cbcc9eb3c admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.673847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] PATH_INFO: `/v3/projects/8344d72338cd41cda442c968856e5b15` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.674016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423a800-db2e-45b4-b96b-fc3cbcc9eb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.674300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423a800-db2e-45b4-b96b-fc3cbcc9eb3c admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.675280 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423a800-db2e-45b4-b96b-fc3cbcc9eb3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:08.675398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8344d72338cd41cda442c968856e5b15)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:08.677261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:08.677577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423a800-db2e-45b4-b96b-fc3cbcc9eb3c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:08.700669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 971/1927] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:08 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:08.702312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423a800-db2e-45b4-b96b-fc3cbcc9eb3c admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:08.714428 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423a800-db2e-45b4-b96b-fc3cbcc9eb3c admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:08.719155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6feb0-324b-41b3-892c-48a5daa903ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:08.719851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6feb0-324b-41b3-892c-48a5daa903ba admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.720780 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6feb0-324b-41b3-892c-48a5daa903ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.721240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6feb0-324b-41b3-892c-48a5daa903ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.721976 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6feb0-324b-41b3-892c-48a5daa903ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:08.723616 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6feb0-324b-41b3-892c-48a5daa903ba admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:08.730786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8344d72338cd41cda442c968856e5b15', 'request_id': 'req-5db24c80-9d7e-470b-8f4f-fb74d212bed4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.734401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 972/1928] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:08.738413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8344d72338cd41cda442c968856e5b15', 'request_id': 'req-5db24c80-9d7e-470b-8f4f-fb74d212bed4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.739386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6feb0-324b-41b3-892c-48a5daa903ba admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:08.745026 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8344d72338cd41cda442c968856e5b15', 'request_id': 'req-5db24c80-9d7e-470b-8f4f-fb74d212bed4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.755903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6feb0-324b-41b3-892c-48a5daa903ba admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:08.760363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] The token cache is being invalidate because project 8344d72338cd41cda442c968856e5b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:08.760665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.761357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.763776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 957/1929] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:08 2022] DELETE /identity/v3/projects/8344d72338cd41cda442c968856e5b15 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:08.767584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:08.769152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:08.826459 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462cc80-cf3c-4fb0-96bf-05d8d66f2beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:08.827489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462cc80-cf3c-4fb0-96bf-05d8d66f2beb admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.827774 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462cc80-cf3c-4fb0-96bf-05d8d66f2beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.828050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462cc80-cf3c-4fb0-96bf-05d8d66f2beb admin admin] PATH_INFO: `/v3/projects/51b76200346a407bbe400cbcc1619a2e/users/34660700a31848ee91d7dfb78d0c7b18/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.844436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462cc80-cf3c-4fb0-96bf-05d8d66f2beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b76200346a407bbe400cbcc1619a2e, user_id=34660700a31848ee91d7dfb78d0c7b18, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:08.847818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462cc80-cf3c-4fb0-96bf-05d8d66f2beb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:08.854902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db24c80-9d7e-470b-8f4f-fb74d212bed4 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:08.863121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:08.864096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.864459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.864742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] PATH_INFO: `/v3/users/8c8f2fd45b4b4abb9ff08b3d4fea477d` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.866917 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8f2fd45b4b4abb9ff08b3d4fea477d)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:08.874469 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:08.874652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 973/1930] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:08 2022] PUT /identity/v3/projects/51b76200346a407bbe400cbcc1619a2e/users/34660700a31848ee91d7dfb78d0c7b18/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:08.876049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462cc80-cf3c-4fb0-96bf-05d8d66f2beb admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:08.878555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c462cc80-cf3c-4fb0-96bf-05d8d66f2beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:08.930303 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8f2fd45b4b4abb9ff08b3d4fea477d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.938952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8f2fd45b4b4abb9ff08b3d4fea477d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.941519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:08.952710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8f2fd45b4b4abb9ff08b3d4fea477d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.954236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:08.954546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8f2fd45b4b4abb9ff08b3d4fea477d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.955508 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8f2fd45b4b4abb9ff08b3d4fea477d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:08.975702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462cc80-cf3c-4fb0-96bf-05d8d66f2beb admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:08.984805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefaa4b-583a-433c-b761-18cd92c5dbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:08.985588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 958/1931] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:08 2022] DELETE /identity/v3/users/8c8f2fd45b4b4abb9ff08b3d4fea477d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:08.986569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefaa4b-583a-433c-b761-18cd92c5dbda admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:08.986811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefaa4b-583a-433c-b761-18cd92c5dbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:08.987093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefaa4b-583a-433c-b761-18cd92c5dbda admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:08.987826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefaa4b-583a-433c-b761-18cd92c5dbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:08.989432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefaa4b-583a-433c-b761-18cd92c5dbda admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:09.002646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 974/1932] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:09.005224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:09.006870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:09.085501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b593b65-d9ec-4db7-b97e-8af9b5475584 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:09.091667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5cb64-7100-4e6a-a395-537adfde4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:09.093022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5cb64-7100-4e6a-a395-537adfde4c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:09.093320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5cb64-7100-4e6a-a395-537adfde4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:09.093583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5cb64-7100-4e6a-a395-537adfde4c90 admin admin] PATH_INFO: `/v3/projects/51b76200346a407bbe400cbcc1619a2e/users/34660700a31848ee91d7dfb78d0c7b18/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:09.096559 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5cb64-7100-4e6a-a395-537adfde4c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b76200346a407bbe400cbcc1619a2e, user_id=34660700a31848ee91d7dfb78d0c7b18, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:09.099603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5cb64-7100-4e6a-a395-537adfde4c90 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:09.116995 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 959/1933] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:09 2022] PUT /identity/v3/projects/51b76200346a407bbe400cbcc1619a2e/users/34660700a31848ee91d7dfb78d0c7b18/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:09.130530 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea69e98-ce19-4975-b51a-af39cd300e24 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:09.132803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea69e98-ce19-4975-b51a-af39cd300e24 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:09.133292 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea69e98-ce19-4975-b51a-af39cd300e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:09.182000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-aea69e98-ce19-4975-b51a-af39cd300e24 None None] MFA Rules not processed for user `34660700a31848ee91d7dfb78d0c7b18`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:09.183272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-aea69e98-ce19-4975-b51a-af39cd300e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:09.276680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 975/1934] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:09.287839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5cb64-7100-4e6a-a395-537adfde4c90 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:09.289763 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-23a5cb64-7100-4e6a-a395-537adfde4c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:09.356829 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5cb64-7100-4e6a-a395-537adfde4c90 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:09.360400 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28f24d-7b15-4144-a2bb-8f031a55bf5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:09.361594 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28f24d-7b15-4144-a2bb-8f031a55bf5a service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:09.361870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28f24d-7b15-4144-a2bb-8f031a55bf5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:09.362145 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28f24d-7b15-4144-a2bb-8f031a55bf5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:09.372443 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28f24d-7b15-4144-a2bb-8f031a55bf5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:09.374422 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28f24d-7b15-4144-a2bb-8f031a55bf5a service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:09.388472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 960/1935] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:16:09.669643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea69e98-ce19-4975-b51a-af39cd300e24 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:09.671391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-aea69e98-ce19-4975-b51a-af39cd300e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:09.770609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea69e98-ce19-4975-b51a-af39cd300e24 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:09.776230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51520e-eb63-4082-9568-7aaa3dadcefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:09.777040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51520e-eb63-4082-9568-7aaa3dadcefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:09.777396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51520e-eb63-4082-9568-7aaa3dadcefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:09.778455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51520e-eb63-4082-9568-7aaa3dadcefb admin admin] PATH_INFO: `/v3/projects/2ab10fd03267482588bba6b3ad35916f` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:09.779940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51520e-eb63-4082-9568-7aaa3dadcefb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab10fd03267482588bba6b3ad35916f)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:09.783932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51520e-eb63-4082-9568-7aaa3dadcefb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:09.840011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-da51520e-eb63-4082-9568-7aaa3dadcefb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab10fd03267482588bba6b3ad35916f', 'request_id': 'req-da51520e-eb63-4082-9568-7aaa3dadcefb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:09.854394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-da51520e-eb63-4082-9568-7aaa3dadcefb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab10fd03267482588bba6b3ad35916f', 'request_id': 'req-da51520e-eb63-4082-9568-7aaa3dadcefb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:09.863270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-da51520e-eb63-4082-9568-7aaa3dadcefb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab10fd03267482588bba6b3ad35916f', 'request_id': 'req-da51520e-eb63-4082-9568-7aaa3dadcefb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:09.872392 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:09.890229 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-da51520e-eb63-4082-9568-7aaa3dadcefb admin admin] The token cache is being invalidate because project 2ab10fd03267482588bba6b3ad35916f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:09.891380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-da51520e-eb63-4082-9568-7aaa3dadcefb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:09.893308 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-da51520e-eb63-4082-9568-7aaa3dadcefb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:09.898171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 976/1936] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:09 2022] DELETE /identity/v3/projects/2ab10fd03267482588bba6b3ad35916f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:09.899854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7751-64ec-45d9-b229-96bc8c56a592 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:09.900146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7751-64ec-45d9-b229-96bc8c56a592 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:09.900428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7751-64ec-45d9-b229-96bc8c56a592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:09.932682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7cab7751-64ec-45d9-b229-96bc8c56a592 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:09.934590 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7cab7751-64ec-45d9-b229-96bc8c56a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:10.035482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 961/1937] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:10.043650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec083dab-76de-4fa1-ac02-443adbbe5ba5 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:10.044154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec083dab-76de-4fa1-ac02-443adbbe5ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:10.044609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec083dab-76de-4fa1-ac02-443adbbe5ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:10.081629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ec083dab-76de-4fa1-ac02-443adbbe5ba5 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:10.083012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ec083dab-76de-4fa1-ac02-443adbbe5ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:10.108659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 977/1938] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:10.110319 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7751-64ec-45d9-b229-96bc8c56a592 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:10.129425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7751-64ec-45d9-b229-96bc8c56a592 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:10.144801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d6cd5-abe1-4ab1-8446-6216b930c469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:10.145838 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d6cd5-abe1-4ab1-8446-6216b930c469 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:10.147869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d6cd5-abe1-4ab1-8446-6216b930c469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:10.149042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d6cd5-abe1-4ab1-8446-6216b930c469 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:10.150762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d6cd5-abe1-4ab1-8446-6216b930c469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:10.151614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d6cd5-abe1-4ab1-8446-6216b930c469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:10.154771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d6cd5-abe1-4ab1-8446-6216b930c469 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:10.173445 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:10.186860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 962/1939] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:10.188238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec083dab-76de-4fa1-ac02-443adbbe5ba5 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:10.206593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec083dab-76de-4fa1-ac02-443adbbe5ba5 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:10.221488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d6cd5-abe1-4ab1-8446-6216b930c469 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:10.223510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f16d6cd5-abe1-4ab1-8446-6216b930c469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:10.224133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1a3cf-a354-4644-8ad6-27e057806dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:10.225214 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1a3cf-a354-4644-8ad6-27e057806dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:10.225761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1a3cf-a354-4644-8ad6-27e057806dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:10.226319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1a3cf-a354-4644-8ad6-27e057806dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:10.228173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1a3cf-a354-4644-8ad6-27e057806dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:10.230420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1a3cf-a354-4644-8ad6-27e057806dfb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:10.237435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d6cd5-abe1-4ab1-8446-6216b930c469 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:10.259438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7e8d1-d30a-4b7c-a4e7-8b848acff127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:10.260154 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e8d1-d30a-4b7c-a4e7-8b848acff127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:10.260666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e8d1-d30a-4b7c-a4e7-8b848acff127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:10.261230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e8d1-d30a-4b7c-a4e7-8b848acff127 admin admin] PATH_INFO: `/v3/users/6841a99c542e42068777479246511b77` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:10.263127 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7e8d1-d30a-4b7c-a4e7-8b848acff127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6841a99c542e42068777479246511b77)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:10.265300 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7e8d1-d30a-4b7c-a4e7-8b848acff127 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:10.302424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 978/1940] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:10 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:10.307540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1a3cf-a354-4644-8ad6-27e057806dfb admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:10.343163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-83a7e8d1-d30a-4b7c-a4e7-8b848acff127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6841a99c542e42068777479246511b77'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:10.356662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-83a7e8d1-d30a-4b7c-a4e7-8b848acff127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6841a99c542e42068777479246511b77'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:10.379006 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-83a7e8d1-d30a-4b7c-a4e7-8b848acff127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6841a99c542e42068777479246511b77'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:10.382595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-83a7e8d1-d30a-4b7c-a4e7-8b848acff127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6841a99c542e42068777479246511b77'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:10.383304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-83a7e8d1-d30a-4b7c-a4e7-8b848acff127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6841a99c542e42068777479246511b77'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:10.416678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1a3cf-a354-4644-8ad6-27e057806dfb admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:10.423119 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d11f3-ef79-4ab7-9f63-c4e6de110e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:10.425609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d11f3-ef79-4ab7-9f63-c4e6de110e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:10.425609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d11f3-ef79-4ab7-9f63-c4e6de110e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:10.426018 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d11f3-ef79-4ab7-9f63-c4e6de110e53 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:10.426912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d11f3-ef79-4ab7-9f63-c4e6de110e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:10.428975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d11f3-ef79-4ab7-9f63-c4e6de110e53 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:10.441846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 963/1941] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:10 2022] DELETE /identity/v3/users/6841a99c542e42068777479246511b77 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:10.444465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61966648-6669-4add-8ada-fd79e61d5e67 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:10.444798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61966648-6669-4add-8ada-fd79e61d5e67 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:10.445200 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61966648-6669-4add-8ada-fd79e61d5e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:10.458431 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 979/1942] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:10 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:10.462374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d11f3-ef79-4ab7-9f63-c4e6de110e53 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:10.482060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-684d11f3-ef79-4ab7-9f63-c4e6de110e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:10.482343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-61966648-6669-4add-8ada-fd79e61d5e67 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:10.491253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-61966648-6669-4add-8ada-fd79e61d5e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:10.512998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d11f3-ef79-4ab7-9f63-c4e6de110e53 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:10.593160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 964/1943] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:10.614742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61966648-6669-4add-8ada-fd79e61d5e67 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:10.616921 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-61966648-6669-4add-8ada-fd79e61d5e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:10.635844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271698a-853b-498a-adb4-62ff41a81328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:10.636937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271698a-853b-498a-adb4-62ff41a81328 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:10.637290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271698a-853b-498a-adb4-62ff41a81328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:10.637646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271698a-853b-498a-adb4-62ff41a81328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:10.643379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271698a-853b-498a-adb4-62ff41a81328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:10.645296 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271698a-853b-498a-adb4-62ff41a81328 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:10.661572 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 980/1944] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:10.665680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271698a-853b-498a-adb4-62ff41a81328 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:10.680288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271698a-853b-498a-adb4-62ff41a81328 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:10.686272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e447fd2-d694-4725-a8a6-a95910ff18a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:10.687381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447fd2-d694-4725-a8a6-a95910ff18a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:10.687746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447fd2-d694-4725-a8a6-a95910ff18a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:10.688220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447fd2-d694-4725-a8a6-a95910ff18a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:10.690102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e447fd2-d694-4725-a8a6-a95910ff18a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:10.692053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e447fd2-d694-4725-a8a6-a95910ff18a3 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:10.706965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 981/1945] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:10.708957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e447fd2-d694-4725-a8a6-a95910ff18a3 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:10.720351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e447fd2-d694-4725-a8a6-a95910ff18a3 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:10.722156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61966648-6669-4add-8ada-fd79e61d5e67 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:10.725939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc803426-31b8-4ab5-9fca-3e8d45e49189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:10.727453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc803426-31b8-4ab5-9fca-3e8d45e49189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:10.727728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc803426-31b8-4ab5-9fca-3e8d45e49189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:10.728007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc803426-31b8-4ab5-9fca-3e8d45e49189 admin admin] PATH_INFO: `/v3/projects/5fe32bf55e5443bc85a25e9651635196/users/d725054d56c34cbfbdd63f45f117ba34/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:10.737640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72549a-b3d0-404b-aa01-9588f7fa555e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:10.738207 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72549a-b3d0-404b-aa01-9588f7fa555e service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:10.738495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72549a-b3d0-404b-aa01-9588f7fa555e service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:10.738801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72549a-b3d0-404b-aa01-9588f7fa555e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:10.746936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc803426-31b8-4ab5-9fca-3e8d45e49189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe32bf55e5443bc85a25e9651635196, user_id=d725054d56c34cbfbdd63f45f117ba34, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:10.750167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc803426-31b8-4ab5-9fca-3e8d45e49189 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:10.756001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72549a-b3d0-404b-aa01-9588f7fa555e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:10.757732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72549a-b3d0-404b-aa01-9588f7fa555e service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:10.771186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 982/1946] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:10 2022] PUT /identity/v3/projects/5fe32bf55e5443bc85a25e9651635196/users/d725054d56c34cbfbdd63f45f117ba34/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:10.775701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 965/1947] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:10.783541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a49c24-2261-4739-a129-f056d5e8f583 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:10.784322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a49c24-2261-4739-a129-f056d5e8f583 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:10.784802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a49c24-2261-4739-a129-f056d5e8f583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:10.821653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-65a49c24-2261-4739-a129-f056d5e8f583 None None] MFA Rules not processed for user `d725054d56c34cbfbdd63f45f117ba34`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:10.823831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-65a49c24-2261-4739-a129-f056d5e8f583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:10.835615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:10.942939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 983/1948] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:10.947536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72549a-b3d0-404b-aa01-9588f7fa555e service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:10.957904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72549a-b3d0-404b-aa01-9588f7fa555e service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:10.972480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:11.031005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783eaf1-eb3d-4c7b-bf89-7299a3f28665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:11.031872 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783eaf1-eb3d-4c7b-bf89-7299a3f28665 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:11.032240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783eaf1-eb3d-4c7b-bf89-7299a3f28665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:11.033053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783eaf1-eb3d-4c7b-bf89-7299a3f28665 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:11.033770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783eaf1-eb3d-4c7b-bf89-7299a3f28665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:11.035767 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783eaf1-eb3d-4c7b-bf89-7299a3f28665 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:11.062402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 966/1949] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:10 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:11.066543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a49c24-2261-4739-a129-f056d5e8f583 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:11.077363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a49c24-2261-4739-a129-f056d5e8f583 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:11.136967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a06116-1ea3-4a89-adab-c2b2fb2b2fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:11.137644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a06116-1ea3-4a89-adab-c2b2fb2b2fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:11.137924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a06116-1ea3-4a89-adab-c2b2fb2b2fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:11.138198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a06116-1ea3-4a89-adab-c2b2fb2b2fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:11.138935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a06116-1ea3-4a89-adab-c2b2fb2b2fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:11.140937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a06116-1ea3-4a89-adab-c2b2fb2b2fe3 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:11.164755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 984/1950] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:11 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:11.166027 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783eaf1-eb3d-4c7b-bf89-7299a3f28665 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:11.177022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783eaf1-eb3d-4c7b-bf89-7299a3f28665 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:11.182276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619875-414e-4dff-a31c-a2c24ef1b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:11.182979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619875-414e-4dff-a31c-a2c24ef1b106 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:11.183425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619875-414e-4dff-a31c-a2c24ef1b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:11.183709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619875-414e-4dff-a31c-a2c24ef1b106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:11.184445 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30619875-414e-4dff-a31c-a2c24ef1b106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:11.186186 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30619875-414e-4dff-a31c-a2c24ef1b106 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:11.199180 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 967/1951] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:11.203466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a06116-1ea3-4a89-adab-c2b2fb2b2fe3 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:11.213928 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a06116-1ea3-4a89-adab-c2b2fb2b2fe3 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:11.218852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74baa5f1-64ae-4cb7-8740-88841e198137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:11.219806 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baa5f1-64ae-4cb7-8740-88841e198137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:11.220584 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baa5f1-64ae-4cb7-8740-88841e198137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:11.220965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baa5f1-64ae-4cb7-8740-88841e198137 admin admin] PATH_INFO: `/v3/projects/14c097e24d4343ce8e87aab59c94a242/users/76def1d48ab844d5a1ed1b0d63a77e55/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:11.239128 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74baa5f1-64ae-4cb7-8740-88841e198137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c097e24d4343ce8e87aab59c94a242, user_id=76def1d48ab844d5a1ed1b0d63a77e55, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:11.241820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74baa5f1-64ae-4cb7-8740-88841e198137 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:11.261705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 985/1952] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:11 2022] PUT /identity/v3/projects/14c097e24d4343ce8e87aab59c94a242/users/76def1d48ab844d5a1ed1b0d63a77e55/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:11.263186 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619875-414e-4dff-a31c-a2c24ef1b106 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:11.273891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619875-414e-4dff-a31c-a2c24ef1b106 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:11.331279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2d123-0696-48c9-bce8-8bc7a3705410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:11.331944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d123-0696-48c9-bce8-8bc7a3705410 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:11.332219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d123-0696-48c9-bce8-8bc7a3705410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:11.332490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d123-0696-48c9-bce8-8bc7a3705410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:11.333235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2d123-0696-48c9-bce8-8bc7a3705410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:11.334899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2d123-0696-48c9-bce8-8bc7a3705410 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:11.345259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 968/1953] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:11.349443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74baa5f1-64ae-4cb7-8740-88841e198137 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:11.360103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74baa5f1-64ae-4cb7-8740-88841e198137 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:11.365948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4c4f-f98e-41d4-97ed-af0cb0a9ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:11.366929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4c4f-f98e-41d4-97ed-af0cb0a9ec0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:11.367276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4c4f-f98e-41d4-97ed-af0cb0a9ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:11.367612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4c4f-f98e-41d4-97ed-af0cb0a9ec0f admin admin] PATH_INFO: `/v3/projects/14c097e24d4343ce8e87aab59c94a242/users/76def1d48ab844d5a1ed1b0d63a77e55/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:11.369646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a4c4f-f98e-41d4-97ed-af0cb0a9ec0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c097e24d4343ce8e87aab59c94a242, user_id=76def1d48ab844d5a1ed1b0d63a77e55, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:11.372372 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a4c4f-f98e-41d4-97ed-af0cb0a9ec0f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:11.384105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 986/1954] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:11 2022] PUT /identity/v3/projects/14c097e24d4343ce8e87aab59c94a242/users/76def1d48ab844d5a1ed1b0d63a77e55/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:11.396384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3a7fe-af3a-4251-9f65-d286ccf6343e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:11.397352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3a7fe-af3a-4251-9f65-d286ccf6343e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:11.397773 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3a7fe-af3a-4251-9f65-d286ccf6343e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:11.426495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a4d3a7fe-af3a-4251-9f65-d286ccf6343e None None] MFA Rules not processed for user `76def1d48ab844d5a1ed1b0d63a77e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:11.427742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a4d3a7fe-af3a-4251-9f65-d286ccf6343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:11.507660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 969/1955] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:11.524225 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4c4f-f98e-41d4-97ed-af0cb0a9ec0f admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:11.526166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0a9a4c4f-f98e-41d4-97ed-af0cb0a9ec0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:11.605581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4c4f-f98e-41d4-97ed-af0cb0a9ec0f admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:11.610222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e384ae-e406-428f-b074-fd26ce61a691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:11.611011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e384ae-e406-428f-b074-fd26ce61a691 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:11.611365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e384ae-e406-428f-b074-fd26ce61a691 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:11.611719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e384ae-e406-428f-b074-fd26ce61a691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:11.622868 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e384ae-e406-428f-b074-fd26ce61a691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:11.624286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e384ae-e406-428f-b074-fd26ce61a691 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:11.637121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 987/1956] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:11.830203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3a7fe-af3a-4251-9f65-d286ccf6343e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:11.834171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a4d3a7fe-af3a-4251-9f65-d286ccf6343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:11.865384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:12.024176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3a7fe-af3a-4251-9f65-d286ccf6343e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:12.030091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:12.031143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:12.031465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:12.031929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] PATH_INFO: `/v3/projects/b556eecf916240c8a1fbe050c377bb78` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:12.033904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b556eecf916240c8a1fbe050c377bb78)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:12.036908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:12.142964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b556eecf916240c8a1fbe050c377bb78', 'request_id': 'req-3878c440-6a12-415c-a69b-1f9421170a8f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.158306 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b556eecf916240c8a1fbe050c377bb78', 'request_id': 'req-3878c440-6a12-415c-a69b-1f9421170a8f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.189062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b556eecf916240c8a1fbe050c377bb78', 'request_id': 'req-3878c440-6a12-415c-a69b-1f9421170a8f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.221468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] The token cache is being invalidate because project b556eecf916240c8a1fbe050c377bb78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:12.221468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.222979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.239094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 970/1957] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:11 2022] DELETE /identity/v3/projects/b556eecf916240c8a1fbe050c377bb78 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:12.239908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e384ae-e406-428f-b074-fd26ce61a691 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:12.254690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:12.284348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e384ae-e406-428f-b074-fd26ce61a691 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:12.323695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:12.325605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:12.414238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:12.415226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:12.415587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:12.415921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] PATH_INFO: `/v3/users/34660700a31848ee91d7dfb78d0c7b18` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:12.417463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=34660700a31848ee91d7dfb78d0c7b18)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:12.419780 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:12.443741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878c440-6a12-415c-a69b-1f9421170a8f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:12.449487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eb420-0459-4b04-afa3-1fdb39d783c8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76def1d48ab844d5a1ed1b0d63a77e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14c097e24d4343ce8e87aab59c94a242', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:12.450211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eb420-0459-4b04-afa3-1fdb39d783c8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:12.450502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eb420-0459-4b04-afa3-1fdb39d783c8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:12.450867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eb420-0459-4b04-afa3-1fdb39d783c8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:12.451664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eb420-0459-4b04-afa3-1fdb39d783c8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:12.452171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eb420-0459-4b04-afa3-1fdb39d783c8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:12.453929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eb420-0459-4b04-afa3-1fdb39d783c8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:12.469663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 971/1958] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:16:12.474465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eb420-0459-4b04-afa3-1fdb39d783c8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:12.487302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eb420-0459-4b04-afa3-1fdb39d783c8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:12.499578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64d782-9771-40ad-91f6-af611fd348f8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76def1d48ab844d5a1ed1b0d63a77e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14c097e24d4343ce8e87aab59c94a242', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:12.500681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64d782-9771-40ad-91f6-af611fd348f8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:12.502307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64d782-9771-40ad-91f6-af611fd348f8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:12.502307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64d782-9771-40ad-91f6-af611fd348f8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:12.502494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64d782-9771-40ad-91f6-af611fd348f8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:12.507271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64d782-9771-40ad-91f6-af611fd348f8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:12.510224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34660700a31848ee91d7dfb78d0c7b18'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.526410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34660700a31848ee91d7dfb78d0c7b18'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.527195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34660700a31848ee91d7dfb78d0c7b18'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.527822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34660700a31848ee91d7dfb78d0c7b18'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.544297 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34660700a31848ee91d7dfb78d0c7b18'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.547085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 972/1959] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:12 2022] POST /identity/v3/projects => generated 354 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:12.551366 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64d782-9771-40ad-91f6-af611fd348f8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:12.553267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-bb64d782-9771-40ad-91f6-af611fd348f8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:12.559662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 988/1960] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:12 2022] DELETE /identity/v3/users/34660700a31848ee91d7dfb78d0c7b18 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:12.567411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:12.629913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64d782-9771-40ad-91f6-af611fd348f8 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:12.692303 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc563af-f13a-4bfa-bfc6-4f5d0a06eea6 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76def1d48ab844d5a1ed1b0d63a77e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14c097e24d4343ce8e87aab59c94a242', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:12.692970 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc563af-f13a-4bfa-bfc6-4f5d0a06eea6 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:12.693258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc563af-f13a-4bfa-bfc6-4f5d0a06eea6 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:12.693537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc563af-f13a-4bfa-bfc6-4f5d0a06eea6 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:12.694288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc563af-f13a-4bfa-bfc6-4f5d0a06eea6 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:12.694576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc563af-f13a-4bfa-bfc6-4f5d0a06eea6 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:12.696228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc563af-f13a-4bfa-bfc6-4f5d0a06eea6 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:12.710414 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 973/1961] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:12.748115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:12.759943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c5814-9d53-4d1d-b8b7-540c312559ca admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:12.764816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76def1d48ab844d5a1ed1b0d63a77e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14c097e24d4343ce8e87aab59c94a242', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:12.765705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:12.765996 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:12.766279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] PATH_INFO: `/v3/projects/a2d8568afae7462ca4ddb05abe7c00dc` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:12.768450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2d8568afae7462ca4ddb05abe7c00dc)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:12.770123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:12.835201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d8568afae7462ca4ddb05abe7c00dc', 'request_id': 'req-bd618f94-707e-4653-88df-890261b257dc'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.848971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d8568afae7462ca4ddb05abe7c00dc', 'request_id': 'req-bd618f94-707e-4653-88df-890261b257dc'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.862633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d8568afae7462ca4ddb05abe7c00dc', 'request_id': 'req-bd618f94-707e-4653-88df-890261b257dc'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.867078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc563af-f13a-4bfa-bfc6-4f5d0a06eea6 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:12.868858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2fc563af-f13a-4bfa-bfc6-4f5d0a06eea6 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:12.881852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] The token cache is being invalidate because project a2d8568afae7462ca4ddb05abe7c00dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:12.882144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.882853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:12.888289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 989/1962] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:12 2022] DELETE /identity/v3/projects/a2d8568afae7462ca4ddb05abe7c00dc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:12.967395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc563af-f13a-4bfa-bfc6-4f5d0a06eea6 tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:13.051807 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:13.052703 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.053527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.054014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f admin admin] PATH_INFO: `/v3/projects/51b76200346a407bbe400cbcc1619a2e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.055061 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b76200346a407bbe400cbcc1619a2e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:13.057041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:13.058767 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:13.107661 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b76200346a407bbe400cbcc1619a2e', 'request_id': 'req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:13.114957 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b76200346a407bbe400cbcc1619a2e', 'request_id': 'req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:13.123495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b76200346a407bbe400cbcc1619a2e', 'request_id': 'req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:13.124949 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:13.127119 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:13.136553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f admin admin] The token cache is being invalidate because project 51b76200346a407bbe400cbcc1619a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:13.136839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:13.137464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a6d3e5df-51dd-4c1c-a802-0c4fe186506f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:13.139053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 974/1963] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:12 2022] DELETE /identity/v3/projects/51b76200346a407bbe400cbcc1619a2e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:13.140802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd618f94-707e-4653-88df-890261b257dc tempest-VolumeQuotaClassesTest-1515110722 tempest-VolumeQuotaClassesTest-1515110722-project-admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:13.144270 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6c168-44a9-48dc-8363-555812996cb4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.144552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6c168-44a9-48dc-8363-555812996cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.144825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6c168-44a9-48dc-8363-555812996cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.145264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:13.164227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6dc6c168-44a9-48dc-8363-555812996cb4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:13.165425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6dc6c168-44a9-48dc-8363-555812996cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:13.203109 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c3ef9-8fb1-4fdf-b3b5-f08d9be2c851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:13.203945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c3ef9-8fb1-4fdf-b3b5-f08d9be2c851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.204226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c3ef9-8fb1-4fdf-b3b5-f08d9be2c851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.204667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c3ef9-8fb1-4fdf-b3b5-f08d9be2c851 admin admin] PATH_INFO: `/v3/users/d725054d56c34cbfbdd63f45f117ba34` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.205966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c3ef9-8fb1-4fdf-b3b5-f08d9be2c851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d725054d56c34cbfbdd63f45f117ba34)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:13.207920 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c3ef9-8fb1-4fdf-b3b5-f08d9be2c851 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:13.231295 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 975/1964] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:13.240352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428e544-b871-4e36-8568-d11e68afc1e4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.240685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428e544-b871-4e36-8568-d11e68afc1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.240949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428e544-b871-4e36-8568-d11e68afc1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.259935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4428e544-b871-4e36-8568-d11e68afc1e4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:13.261210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4428e544-b871-4e36-8568-d11e68afc1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:13.261939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1d1c3ef9-8fb1-4fdf-b3b5-f08d9be2c851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd725054d56c34cbfbdd63f45f117ba34'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:13.270072 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1d1c3ef9-8fb1-4fdf-b3b5-f08d9be2c851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd725054d56c34cbfbdd63f45f117ba34'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:13.270886 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 976/1965] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:13.271172 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1d1c3ef9-8fb1-4fdf-b3b5-f08d9be2c851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd725054d56c34cbfbdd63f45f117ba34'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:13.271968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1d1c3ef9-8fb1-4fdf-b3b5-f08d9be2c851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd725054d56c34cbfbdd63f45f117ba34'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:13.279711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428e544-b871-4e36-8568-d11e68afc1e4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:13.291543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1d1c3ef9-8fb1-4fdf-b3b5-f08d9be2c851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd725054d56c34cbfbdd63f45f117ba34'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:13.292954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428e544-b871-4e36-8568-d11e68afc1e4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:13.301438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa277f-a7d4-420c-a8a6-50af6bcd9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:13.302200 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa277f-a7d4-420c-a8a6-50af6bcd9e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.302486 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa277f-a7d4-420c-a8a6-50af6bcd9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.302797 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa277f-a7d4-420c-a8a6-50af6bcd9e81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.303592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa277f-a7d4-420c-a8a6-50af6bcd9e81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:13.303860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa277f-a7d4-420c-a8a6-50af6bcd9e81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:13.305619 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa277f-a7d4-420c-a8a6-50af6bcd9e81 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:13.311014 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 990/1966] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:13 2022] DELETE /identity/v3/users/d725054d56c34cbfbdd63f45f117ba34 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:13.316450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149d6fd-7581-4631-b047-9f81588f98d1 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.316745 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149d6fd-7581-4631-b047-9f81588f98d1 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.318351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149d6fd-7581-4631-b047-9f81588f98d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.324595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 977/1967] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:13.329193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa277f-a7d4-420c-a8a6-50af6bcd9e81 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:13.333701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-13fa277f-a7d4-420c-a8a6-50af6bcd9e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:13.358339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa277f-a7d4-420c-a8a6-50af6bcd9e81 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:13.363342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-2149d6fd-7581-4631-b047-9f81588f98d1 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:13.365164 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2149d6fd-7581-4631-b047-9f81588f98d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:13.438497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 991/1968] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:13.448821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149d6fd-7581-4631-b047-9f81588f98d1 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:13.450119 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2149d6fd-7581-4631-b047-9f81588f98d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:13.450929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4152e-f1b9-4606-aa83-58c74dc917eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:13.451747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4152e-f1b9-4606-aa83-58c74dc917eb admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.452102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4152e-f1b9-4606-aa83-58c74dc917eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.452449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4152e-f1b9-4606-aa83-58c74dc917eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.453213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4152e-f1b9-4606-aa83-58c74dc917eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:13.455947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4152e-f1b9-4606-aa83-58c74dc917eb admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:13.472261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:13.488047 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:13.493401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 978/1969] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:13 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:13.497398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4152e-f1b9-4606-aa83-58c74dc917eb admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:13.521130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149d6fd-7581-4631-b047-9f81588f98d1 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:13.561574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4152e-f1b9-4606-aa83-58c74dc917eb admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:13.567662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cfad-2c01-45aa-818f-6529c1025bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:13.568332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cfad-2c01-45aa-818f-6529c1025bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.568613 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cfad-2c01-45aa-818f-6529c1025bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.568887 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cfad-2c01-45aa-818f-6529c1025bcf admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.569990 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91cfad-2c01-45aa-818f-6529c1025bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:13.571965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91cfad-2c01-45aa-818f-6529c1025bcf admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:13.572664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8f760-cd78-4810-bb5e-03ee7f36defc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:13.573332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8f760-cd78-4810-bb5e-03ee7f36defc service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.573619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8f760-cd78-4810-bb5e-03ee7f36defc service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.574049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8f760-cd78-4810-bb5e-03ee7f36defc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.587602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8f760-cd78-4810-bb5e-03ee7f36defc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:13.589334 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8f760-cd78-4810-bb5e-03ee7f36defc service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:13.592868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 979/1970] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:13 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:13.596931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cfad-2c01-45aa-818f-6529c1025bcf admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:13.601437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 992/1971] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:16:13.606814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cfad-2c01-45aa-818f-6529c1025bcf admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:13.612189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1356ab-f31a-4d82-820a-64da6a83bb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:13.612844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1356ab-f31a-4d82-820a-64da6a83bb46 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.613130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1356ab-f31a-4d82-820a-64da6a83bb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.613408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1356ab-f31a-4d82-820a-64da6a83bb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.614133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1356ab-f31a-4d82-820a-64da6a83bb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:13.615761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1356ab-f31a-4d82-820a-64da6a83bb46 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:13.627479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 980/1972] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:13.631659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8f760-cd78-4810-bb5e-03ee7f36defc service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:13.641318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8f760-cd78-4810-bb5e-03ee7f36defc service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:13.646719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d25c32-67e4-4b72-acb8-3394e6811aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:13.647379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d25c32-67e4-4b72-acb8-3394e6811aea admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.647671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d25c32-67e4-4b72-acb8-3394e6811aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.647951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d25c32-67e4-4b72-acb8-3394e6811aea admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.648686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d25c32-67e4-4b72-acb8-3394e6811aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:13.650279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d25c32-67e4-4b72-acb8-3394e6811aea admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:13.660983 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 993/1973] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:13.665189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1356ab-f31a-4d82-820a-64da6a83bb46 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:13.677236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1356ab-f31a-4d82-820a-64da6a83bb46 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:13.682135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37b6bd-4ff9-4f4f-8cbf-9a13f18c30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:13.683134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37b6bd-4ff9-4f4f-8cbf-9a13f18c30e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.683421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37b6bd-4ff9-4f4f-8cbf-9a13f18c30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.683701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37b6bd-4ff9-4f4f-8cbf-9a13f18c30e4 admin admin] PATH_INFO: `/v3/projects/e06a68ef136b495cbaea4ba6ae9f3fb9/users/69a050a4652a47d38c994441134a944c/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.699542 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37b6bd-4ff9-4f4f-8cbf-9a13f18c30e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06a68ef136b495cbaea4ba6ae9f3fb9, user_id=69a050a4652a47d38c994441134a944c, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:13.702281 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37b6bd-4ff9-4f4f-8cbf-9a13f18c30e4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:13.715216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 981/1974] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:13 2022] PUT /identity/v3/projects/e06a68ef136b495cbaea4ba6ae9f3fb9/users/69a050a4652a47d38c994441134a944c/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:13.727002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1568db2-1be2-4e75-932c-108bc9cc9a51 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.727274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1568db2-1be2-4e75-932c-108bc9cc9a51 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.727551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1568db2-1be2-4e75-932c-108bc9cc9a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.759320 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e1568db2-1be2-4e75-932c-108bc9cc9a51 None None] MFA Rules not processed for user `69a050a4652a47d38c994441134a944c`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:13.760678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e1568db2-1be2-4e75-932c-108bc9cc9a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:13.827620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 994/1975] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:13.832702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37b6bd-4ff9-4f4f-8cbf-9a13f18c30e4 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:13.880737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1568db2-1be2-4e75-932c-108bc9cc9a51 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:13.882547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e1568db2-1be2-4e75-932c-108bc9cc9a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:13.919855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37b6bd-4ff9-4f4f-8cbf-9a13f18c30e4 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:13.925700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444dc2d-3bf7-4811-ac34-d556732334aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:13.926747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444dc2d-3bf7-4811-ac34-d556732334aa admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:13.927210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444dc2d-3bf7-4811-ac34-d556732334aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:13.927662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444dc2d-3bf7-4811-ac34-d556732334aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:13.928558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444dc2d-3bf7-4811-ac34-d556732334aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:13.930813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444dc2d-3bf7-4811-ac34-d556732334aa admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:13.963487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 982/1976] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:13 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:13.965045 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444dc2d-3bf7-4811-ac34-d556732334aa admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:13.966982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1568db2-1be2-4e75-932c-108bc9cc9a51 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:13.976694 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:14.014760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:14.037908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:14.038815 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:14.039239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:14.039778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] PATH_INFO: `/v3/projects/5fe32bf55e5443bc85a25e9651635196` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:14.041436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe32bf55e5443bc85a25e9651635196)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:14.043381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:14.066494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444dc2d-3bf7-4811-ac34-d556732334aa admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:14.075263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb65df-4f58-4de1-b557-aad034128d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:14.075954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb65df-4f58-4de1-b557-aad034128d0c admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:14.076241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb65df-4f58-4de1-b557-aad034128d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:14.076961 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb65df-4f58-4de1-b557-aad034128d0c admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:14.078473 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb65df-4f58-4de1-b557-aad034128d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:14.082007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb65df-4f58-4de1-b557-aad034128d0c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:14.118053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 983/1977] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:13 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:14.119184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb65df-4f58-4de1-b557-aad034128d0c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:14.123188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe32bf55e5443bc85a25e9651635196', 'request_id': 'req-bebe3b5f-01af-472f-85ff-01b935417296'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:14.132037 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb65df-4f58-4de1-b557-aad034128d0c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:14.138377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe32bf55e5443bc85a25e9651635196', 'request_id': 'req-bebe3b5f-01af-472f-85ff-01b935417296'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:14.150337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe32bf55e5443bc85a25e9651635196', 'request_id': 'req-bebe3b5f-01af-472f-85ff-01b935417296'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:14.167916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] The token cache is being invalidate because project 5fe32bf55e5443bc85a25e9651635196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:14.168234 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:14.168962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:14.171248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 995/1978] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:13 2022] DELETE /identity/v3/projects/5fe32bf55e5443bc85a25e9651635196 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:14.176126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:14.178503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:14.243006 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec61277-02a6-4f08-b6af-58c709503822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:14.243688 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec61277-02a6-4f08-b6af-58c709503822 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:14.243978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec61277-02a6-4f08-b6af-58c709503822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:14.244274 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec61277-02a6-4f08-b6af-58c709503822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:14.245276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec61277-02a6-4f08-b6af-58c709503822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:14.246936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec61277-02a6-4f08-b6af-58c709503822 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:14.259868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 984/1979] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:14.263178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec61277-02a6-4f08-b6af-58c709503822 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:14.264923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7ec61277-02a6-4f08-b6af-58c709503822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:14.272750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe3b5f-01af-472f-85ff-01b935417296 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:14.280051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:14.280513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec61277-02a6-4f08-b6af-58c709503822 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:14.280934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:14.281211 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:14.281482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] PATH_INFO: `/v3/users/76def1d48ab844d5a1ed1b0d63a77e55` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:14.282800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76def1d48ab844d5a1ed1b0d63a77e55)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:14.285215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:14.287501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0794b75-7933-401c-9a94-494d1c4945e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:14.288949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0794b75-7933-401c-9a94-494d1c4945e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:14.289240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0794b75-7933-401c-9a94-494d1c4945e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:14.289546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0794b75-7933-401c-9a94-494d1c4945e7 admin admin] PATH_INFO: `/v3/projects/6603e994c3dd421285ac47163e011ad2/users/78f6c3d231904b199ee4566401ac5329/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:14.309921 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0794b75-7933-401c-9a94-494d1c4945e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6603e994c3dd421285ac47163e011ad2, user_id=78f6c3d231904b199ee4566401ac5329, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:14.312680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0794b75-7933-401c-9a94-494d1c4945e7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:14.339582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 985/1980] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:14 2022] PUT /identity/v3/projects/6603e994c3dd421285ac47163e011ad2/users/78f6c3d231904b199ee4566401ac5329/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:14.341519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0794b75-7933-401c-9a94-494d1c4945e7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:14.357178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:14.361244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76def1d48ab844d5a1ed1b0d63a77e55'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:14.374863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76def1d48ab844d5a1ed1b0d63a77e55'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:14.375812 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76def1d48ab844d5a1ed1b0d63a77e55'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:14.376680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76def1d48ab844d5a1ed1b0d63a77e55'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:14.390382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76def1d48ab844d5a1ed1b0d63a77e55'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:14.406590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 996/1981] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:14 2022] DELETE /identity/v3/users/76def1d48ab844d5a1ed1b0d63a77e55 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:14.437754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0794b75-7933-401c-9a94-494d1c4945e7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:14.498809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:14.537765 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f86bc0-bea6-4a66-a608-f2ae170d28ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:14.538867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f86bc0-bea6-4a66-a608-f2ae170d28ce admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:14.539344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f86bc0-bea6-4a66-a608-f2ae170d28ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:14.539625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f86bc0-bea6-4a66-a608-f2ae170d28ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:14.540361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f86bc0-bea6-4a66-a608-f2ae170d28ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:14.541963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f86bc0-bea6-4a66-a608-f2ae170d28ce admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:14.554231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 986/1982] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:14.558517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:14.560111 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:14.583533 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0333d-0cbe-48ed-9ff3-09d281e04cb3 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:14.589816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3493c3-ba93-4a78-9419-e6e63812bbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:14.591237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3493c3-ba93-4a78-9419-e6e63812bbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:14.591586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3493c3-ba93-4a78-9419-e6e63812bbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:14.591935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3493c3-ba93-4a78-9419-e6e63812bbdd admin admin] PATH_INFO: `/v3/projects/6603e994c3dd421285ac47163e011ad2/users/78f6c3d231904b199ee4566401ac5329/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:14.594254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3493c3-ba93-4a78-9419-e6e63812bbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6603e994c3dd421285ac47163e011ad2, user_id=78f6c3d231904b199ee4566401ac5329, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:14.597958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3493c3-ba93-4a78-9419-e6e63812bbdd admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:14.611092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 997/1983] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:14 2022] PUT /identity/v3/projects/6603e994c3dd421285ac47163e011ad2/users/78f6c3d231904b199ee4566401ac5329/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:14.620644 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e342f-7a20-454d-afae-ff43bcb30f9e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:14.620930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e342f-7a20-454d-afae-ff43bcb30f9e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:14.621215 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e342f-7a20-454d-afae-ff43bcb30f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:14.659372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-8e7e342f-7a20-454d-afae-ff43bcb30f9e None None] MFA Rules not processed for user `78f6c3d231904b199ee4566401ac5329`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:14.661310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8e7e342f-7a20-454d-afae-ff43bcb30f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:14.761464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 987/1984] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:14.774119 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3493c3-ba93-4a78-9419-e6e63812bbdd admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:14.775982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9c3493c3-ba93-4a78-9419-e6e63812bbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:14.835025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3493c3-ba93-4a78-9419-e6e63812bbdd admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:14.838694 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0774d0-15d2-488e-95ee-976002d99a69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:14.839341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0774d0-15d2-488e-95ee-976002d99a69 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:14.839626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0774d0-15d2-488e-95ee-976002d99a69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:14.839906 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0774d0-15d2-488e-95ee-976002d99a69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:14.842080 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6d0774d0-15d2-488e-95ee-976002d99a69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:14.859043 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e342f-7a20-454d-afae-ff43bcb30f9e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:14.860568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8e7e342f-7a20-454d-afae-ff43bcb30f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:14.923738 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0774d0-15d2-488e-95ee-976002d99a69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:14.925574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0774d0-15d2-488e-95ee-976002d99a69 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:14.935601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 998/1985] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:14.947835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e342f-7a20-454d-afae-ff43bcb30f9e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:14.952642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296291e0-06bf-4a3b-8d8b-bbea0325976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:14.953490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296291e0-06bf-4a3b-8d8b-bbea0325976d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:14.953905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296291e0-06bf-4a3b-8d8b-bbea0325976d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:14.954179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296291e0-06bf-4a3b-8d8b-bbea0325976d admin admin] PATH_INFO: `/v3/projects/14c097e24d4343ce8e87aab59c94a242` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:14.955717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296291e0-06bf-4a3b-8d8b-bbea0325976d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c097e24d4343ce8e87aab59c94a242)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:14.957603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296291e0-06bf-4a3b-8d8b-bbea0325976d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:15.007403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-296291e0-06bf-4a3b-8d8b-bbea0325976d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c097e24d4343ce8e87aab59c94a242', 'request_id': 'req-296291e0-06bf-4a3b-8d8b-bbea0325976d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:15.013677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-296291e0-06bf-4a3b-8d8b-bbea0325976d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c097e24d4343ce8e87aab59c94a242', 'request_id': 'req-296291e0-06bf-4a3b-8d8b-bbea0325976d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:15.020181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-296291e0-06bf-4a3b-8d8b-bbea0325976d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c097e24d4343ce8e87aab59c94a242', 'request_id': 'req-296291e0-06bf-4a3b-8d8b-bbea0325976d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:15.023811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:15.035211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-296291e0-06bf-4a3b-8d8b-bbea0325976d admin admin] The token cache is being invalidate because project 14c097e24d4343ce8e87aab59c94a242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:15.035549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-296291e0-06bf-4a3b-8d8b-bbea0325976d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:15.036521 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-296291e0-06bf-4a3b-8d8b-bbea0325976d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:15.038680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 988/1986] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:14 2022] DELETE /identity/v3/projects/14c097e24d4343ce8e87aab59c94a242 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:15.043481 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fbfea-0865-4c7f-98e4-bda5cf4e0519 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.043770 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fbfea-0865-4c7f-98e4-bda5cf4e0519 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.044049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fbfea-0865-4c7f-98e4-bda5cf4e0519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.063671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ed0fbfea-0865-4c7f-98e4-bda5cf4e0519 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:15.065159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ed0fbfea-0865-4c7f-98e4-bda5cf4e0519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:15.135661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 999/1987] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:15.144586 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea1ecb-647c-4f83-8676-fb82d4d9e276 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.144866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea1ecb-647c-4f83-8676-fb82d4d9e276 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.145156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea1ecb-647c-4f83-8676-fb82d4d9e276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.168699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ccea1ecb-647c-4f83-8676-fb82d4d9e276 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:15.170284 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ccea1ecb-647c-4f83-8676-fb82d4d9e276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:15.181897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 989/1988] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:15.186311 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fbfea-0865-4c7f-98e4-bda5cf4e0519 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:15.192151 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:15.199433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fbfea-0865-4c7f-98e4-bda5cf4e0519 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:15.206124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20d65a-a624-489b-9054-3a5b02a60b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:15.206878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20d65a-a624-489b-9054-3a5b02a60b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.207161 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20d65a-a624-489b-9054-3a5b02a60b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.207487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20d65a-a624-489b-9054-3a5b02a60b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.208212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20d65a-a624-489b-9054-3a5b02a60b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:15.208563 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20d65a-a624-489b-9054-3a5b02a60b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:15.210220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20d65a-a624-489b-9054-3a5b02a60b5f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:15.226402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1000/1989] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:15.227808 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea1ecb-647c-4f83-8676-fb82d4d9e276 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:15.239616 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea1ecb-647c-4f83-8676-fb82d4d9e276 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:15.244778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263a845-aa57-4223-9430-3dde36c97cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:15.245917 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263a845-aa57-4223-9430-3dde36c97cda admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.246361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263a845-aa57-4223-9430-3dde36c97cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.246819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263a845-aa57-4223-9430-3dde36c97cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.247762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263a845-aa57-4223-9430-3dde36c97cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:15.250599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263a845-aa57-4223-9430-3dde36c97cda admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:15.294656 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 990/1990] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:15 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:15.299356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20d65a-a624-489b-9054-3a5b02a60b5f admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:15.312166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20d65a-a624-489b-9054-3a5b02a60b5f admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:15.423624 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aded5c-0e87-43a6-ad84-cd63ebb0a0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:15.424580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aded5c-0e87-43a6-ad84-cd63ebb0a0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.424994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aded5c-0e87-43a6-ad84-cd63ebb0a0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.425228 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aded5c-0e87-43a6-ad84-cd63ebb0a0c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.425954 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aded5c-0e87-43a6-ad84-cd63ebb0a0c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:15.428082 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aded5c-0e87-43a6-ad84-cd63ebb0a0c4 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:15.453424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1001/1991] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:15 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:15.454554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263a845-aa57-4223-9430-3dde36c97cda admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:15.466003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263a845-aa57-4223-9430-3dde36c97cda admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:15.472330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2180be-39b3-4371-9d8a-577c65244643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:15.473009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2180be-39b3-4371-9d8a-577c65244643 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.473346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2180be-39b3-4371-9d8a-577c65244643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.473843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2180be-39b3-4371-9d8a-577c65244643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.474585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2180be-39b3-4371-9d8a-577c65244643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:15.476740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2180be-39b3-4371-9d8a-577c65244643 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:15.491440 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 991/1992] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:15.493331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aded5c-0e87-43a6-ad84-cd63ebb0a0c4 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:15.504163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aded5c-0e87-43a6-ad84-cd63ebb0a0c4 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:15.509252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb997de4-1feb-46b3-bafd-2d26fa32a581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:15.509923 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb997de4-1feb-46b3-bafd-2d26fa32a581 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.510209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb997de4-1feb-46b3-bafd-2d26fa32a581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.510490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb997de4-1feb-46b3-bafd-2d26fa32a581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.511245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb997de4-1feb-46b3-bafd-2d26fa32a581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:15.512919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb997de4-1feb-46b3-bafd-2d26fa32a581 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:15.540733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1002/1993] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:15.542014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2180be-39b3-4371-9d8a-577c65244643 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:15.552867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2180be-39b3-4371-9d8a-577c65244643 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:15.558057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2061fbb-da16-4c47-83f3-672c9fec9ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:15.559003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2061fbb-da16-4c47-83f3-672c9fec9ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.559267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2061fbb-da16-4c47-83f3-672c9fec9ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.559567 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2061fbb-da16-4c47-83f3-672c9fec9ae2 admin admin] PATH_INFO: `/v3/projects/f59b5a96f57646cd8091df19f905bd4f/users/72bcc352a8c14f008a1a94b5bd2a3316/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.578511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2061fbb-da16-4c47-83f3-672c9fec9ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59b5a96f57646cd8091df19f905bd4f, user_id=72bcc352a8c14f008a1a94b5bd2a3316, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:15.581764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2061fbb-da16-4c47-83f3-672c9fec9ae2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:15.596228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 992/1994] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:15 2022] PUT /identity/v3/projects/f59b5a96f57646cd8091df19f905bd4f/users/72bcc352a8c14f008a1a94b5bd2a3316/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:15.608065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe40bc-c48e-4087-9e1f-0d789e0381c5 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.608355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe40bc-c48e-4087-9e1f-0d789e0381c5 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.608632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe40bc-c48e-4087-9e1f-0d789e0381c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.635903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-58fe40bc-c48e-4087-9e1f-0d789e0381c5 None None] MFA Rules not processed for user `72bcc352a8c14f008a1a94b5bd2a3316`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:15.637098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-58fe40bc-c48e-4087-9e1f-0d789e0381c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:15.700628 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1003/1995] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:15.705205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2061fbb-da16-4c47-83f3-672c9fec9ae2 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:15.769821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2061fbb-da16-4c47-83f3-672c9fec9ae2 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:15.775577 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a3a17-46fd-408b-9f91-aec306c724c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:15.776279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a3a17-46fd-408b-9f91-aec306c724c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.776533 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a3a17-46fd-408b-9f91-aec306c724c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.776810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a3a17-46fd-408b-9f91-aec306c724c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.777519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a3a17-46fd-408b-9f91-aec306c724c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:15.779694 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a3a17-46fd-408b-9f91-aec306c724c2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:15.810003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 993/1996] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:15 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:15.814414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe40bc-c48e-4087-9e1f-0d789e0381c5 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:15.828393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe40bc-c48e-4087-9e1f-0d789e0381c5 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:15.893269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:15.901769 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ad4c7-0daf-4618-beb2-1bb541b4411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:15.902357 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad4c7-0daf-4618-beb2-1bb541b4411a admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.902575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad4c7-0daf-4618-beb2-1bb541b4411a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.902980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad4c7-0daf-4618-beb2-1bb541b4411a admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.903728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ad4c7-0daf-4618-beb2-1bb541b4411a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:15.906842 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ad4c7-0daf-4618-beb2-1bb541b4411a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:15.933663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1004/1997] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:15 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:15.935058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a3a17-46fd-408b-9f91-aec306c724c2 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:15.946207 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a3a17-46fd-408b-9f91-aec306c724c2 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:15.950910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68ba8d-1f3a-49a0-bc13-24d8ff9f5e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:15.951566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68ba8d-1f3a-49a0-bc13-24d8ff9f5e82 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.951848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68ba8d-1f3a-49a0-bc13-24d8ff9f5e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.952125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68ba8d-1f3a-49a0-bc13-24d8ff9f5e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.952979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68ba8d-1f3a-49a0-bc13-24d8ff9f5e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:15.954590 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68ba8d-1f3a-49a0-bc13-24d8ff9f5e82 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:15.965977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 994/1998] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:15.970253 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ad4c7-0daf-4618-beb2-1bb541b4411a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:15.980079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ad4c7-0daf-4618-beb2-1bb541b4411a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:15.984641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de271a-23f8-48e6-b426-797d658fe4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:15.985287 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de271a-23f8-48e6-b426-797d658fe4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:15.986132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de271a-23f8-48e6-b426-797d658fe4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:15.986392 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de271a-23f8-48e6-b426-797d658fe4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:15.987146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de271a-23f8-48e6-b426-797d658fe4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:15.988726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de271a-23f8-48e6-b426-797d658fe4f9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:15.998675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1005/1999] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:16.003242 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68ba8d-1f3a-49a0-bc13-24d8ff9f5e82 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:16.013195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68ba8d-1f3a-49a0-bc13-24d8ff9f5e82 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:16.017958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e7413-2392-4895-877c-6af12ed854e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:16.018915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7413-2392-4895-877c-6af12ed854e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:16.019148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7413-2392-4895-877c-6af12ed854e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:16.019423 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7413-2392-4895-877c-6af12ed854e3 admin admin] PATH_INFO: `/v3/projects/02009f3ae87040ac8a71021521028951/users/a9e61f431bce4a2d863d386ced64dd3e/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:16.035262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e7413-2392-4895-877c-6af12ed854e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02009f3ae87040ac8a71021521028951, user_id=a9e61f431bce4a2d863d386ced64dd3e, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:16.037910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e7413-2392-4895-877c-6af12ed854e3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:16.052138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 995/2000] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:16 2022] PUT /identity/v3/projects/02009f3ae87040ac8a71021521028951/users/a9e61f431bce4a2d863d386ced64dd3e/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:16.062206 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676da96-0500-488e-aceb-bc452003e7a6 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:16.062492 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676da96-0500-488e-aceb-bc452003e7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:16.062795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676da96-0500-488e-aceb-bc452003e7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:16.089619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-7676da96-0500-488e-aceb-bc452003e7a6 None None] MFA Rules not processed for user `a9e61f431bce4a2d863d386ced64dd3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:16.091011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-7676da96-0500-488e-aceb-bc452003e7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:16.162021 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1006/2001] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:16.166495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e7413-2392-4895-877c-6af12ed854e3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:16.232858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:16.271318 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e7413-2392-4895-877c-6af12ed854e3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:16.276847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624fdb-ac9d-45d6-8e1c-34095d799ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:16.277609 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624fdb-ac9d-45d6-8e1c-34095d799ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:16.277992 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624fdb-ac9d-45d6-8e1c-34095d799ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:16.278389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624fdb-ac9d-45d6-8e1c-34095d799ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:16.279240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae624fdb-ac9d-45d6-8e1c-34095d799ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:16.281390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae624fdb-ac9d-45d6-8e1c-34095d799ba6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:16.315714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 996/2002] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:16 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:16.317029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676da96-0500-488e-aceb-bc452003e7a6 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:16.329157 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676da96-0500-488e-aceb-bc452003e7a6 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:16.404327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0107342-a3ca-4562-8472-926560cb94fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:16.405212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0107342-a3ca-4562-8472-926560cb94fa admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:16.405678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0107342-a3ca-4562-8472-926560cb94fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:16.406047 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0107342-a3ca-4562-8472-926560cb94fa admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:16.408657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0107342-a3ca-4562-8472-926560cb94fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:16.412412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0107342-a3ca-4562-8472-926560cb94fa admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:16.444135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1007/2003] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:16 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:16.447785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624fdb-ac9d-45d6-8e1c-34095d799ba6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:16.466331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624fdb-ac9d-45d6-8e1c-34095d799ba6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:16.475725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8e9b4-58c7-4b9a-a918-590f15bbb3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:16.476413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8e9b4-58c7-4b9a-a918-590f15bbb3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:16.477009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8e9b4-58c7-4b9a-a918-590f15bbb3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:16.477294 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8e9b4-58c7-4b9a-a918-590f15bbb3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:16.479177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8e9b4-58c7-4b9a-a918-590f15bbb3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:16.493593 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8e9b4-58c7-4b9a-a918-590f15bbb3b5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:16.553757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 997/2004] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:16.557589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0107342-a3ca-4562-8472-926560cb94fa admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:16.606110 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0107342-a3ca-4562-8472-926560cb94fa admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:16.618304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92eac5-9570-4aa4-942e-2bbdfedc5d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:16.619584 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92eac5-9570-4aa4-942e-2bbdfedc5d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:16.620370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92eac5-9570-4aa4-942e-2bbdfedc5d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:16.620798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92eac5-9570-4aa4-942e-2bbdfedc5d39 admin admin] PATH_INFO: `/v3/projects/3c90644cc0fa458cb1add622a1db7bfc/users/21d0c4f48ba14c72b9feaf70b263b883/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:16.645843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92eac5-9570-4aa4-942e-2bbdfedc5d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c90644cc0fa458cb1add622a1db7bfc, user_id=21d0c4f48ba14c72b9feaf70b263b883, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:16.651726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92eac5-9570-4aa4-942e-2bbdfedc5d39 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:16.682357 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1008/2005] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:16 2022] PUT /identity/v3/projects/3c90644cc0fa458cb1add622a1db7bfc/users/21d0c4f48ba14c72b9feaf70b263b883/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:16.686377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8e9b4-58c7-4b9a-a918-590f15bbb3b5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:16.708283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8e9b4-58c7-4b9a-a918-590f15bbb3b5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:16.863594 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b290e9-895f-47c1-9ec3-36ffb13fc8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:16.864321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b290e9-895f-47c1-9ec3-36ffb13fc8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:16.864610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b290e9-895f-47c1-9ec3-36ffb13fc8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:16.864936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b290e9-895f-47c1-9ec3-36ffb13fc8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:16.866545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b290e9-895f-47c1-9ec3-36ffb13fc8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:16.868409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b290e9-895f-47c1-9ec3-36ffb13fc8e5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:16.886566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 998/2006] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:16.890391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92eac5-9570-4aa4-942e-2bbdfedc5d39 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:16.904725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92eac5-9570-4aa4-942e-2bbdfedc5d39 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:16.911176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09c327-fb06-436d-8ab5-267fbe961cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:16.912058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09c327-fb06-436d-8ab5-267fbe961cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:16.912311 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09c327-fb06-436d-8ab5-267fbe961cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:16.913236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09c327-fb06-436d-8ab5-267fbe961cf1 admin admin] PATH_INFO: `/v3/projects/3c90644cc0fa458cb1add622a1db7bfc/users/21d0c4f48ba14c72b9feaf70b263b883/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:16.915092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09c327-fb06-436d-8ab5-267fbe961cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c90644cc0fa458cb1add622a1db7bfc, user_id=21d0c4f48ba14c72b9feaf70b263b883, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:16.919102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09c327-fb06-436d-8ab5-267fbe961cf1 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:16.940004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1009/2007] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:16 2022] PUT /identity/v3/projects/3c90644cc0fa458cb1add622a1db7bfc/users/21d0c4f48ba14c72b9feaf70b263b883/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:16.966444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c77700-5bef-4949-a106-3278fa511d15 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:16.966823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c77700-5bef-4949-a106-3278fa511d15 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:16.967113 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c77700-5bef-4949-a106-3278fa511d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:17.034292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-00c77700-5bef-4949-a106-3278fa511d15 None None] MFA Rules not processed for user `21d0c4f48ba14c72b9feaf70b263b883`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:17.036691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-00c77700-5bef-4949-a106-3278fa511d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:17.146710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 999/2008] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:17.157775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09c327-fb06-436d-8ab5-267fbe961cf1 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:17.159597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4c09c327-fb06-436d-8ab5-267fbe961cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:17.181236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:17.221310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09c327-fb06-436d-8ab5-267fbe961cf1 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:17.225032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0def9-46ab-41cf-94cc-a20c149844f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:17.225681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0def9-46ab-41cf-94cc-a20c149844f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:17.225973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0def9-46ab-41cf-94cc-a20c149844f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:17.226251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0def9-46ab-41cf-94cc-a20c149844f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:17.236145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0def9-46ab-41cf-94cc-a20c149844f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:17.237592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0def9-46ab-41cf-94cc-a20c149844f1 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:17.247098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1010/2009] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:17.747931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c77700-5bef-4949-a106-3278fa511d15 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:17.758221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c77700-5bef-4949-a106-3278fa511d15 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:17.761766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac3e65-5016-4954-9ff5-bf9bc399fbfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:17.762396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac3e65-5016-4954-9ff5-bf9bc399fbfe service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:17.762706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac3e65-5016-4954-9ff5-bf9bc399fbfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:17.762978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac3e65-5016-4954-9ff5-bf9bc399fbfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:17.798415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:17.836224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac3e65-5016-4954-9ff5-bf9bc399fbfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:17.838109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac3e65-5016-4954-9ff5-bf9bc399fbfe service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:17.851397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1000/2010] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:19.608966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0def9-46ab-41cf-94cc-a20c149844f1 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:19.610552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6bf0def9-46ab-41cf-94cc-a20c149844f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:19.694074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0def9-46ab-41cf-94cc-a20c149844f1 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:19.702160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:19.703295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:19.703579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:19.703857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] PATH_INFO: `/v3/users/8673e73f6e7841d1af714ee29494914e` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:19.705681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8673e73f6e7841d1af714ee29494914e)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:19.707651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:19.772414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8673e73f6e7841d1af714ee29494914e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:19.780745 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8673e73f6e7841d1af714ee29494914e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:19.781546 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8673e73f6e7841d1af714ee29494914e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:19.782493 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8673e73f6e7841d1af714ee29494914e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:19.803831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8673e73f6e7841d1af714ee29494914e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:19.844319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1011/2011] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:19 2022] DELETE /identity/v3/users/8673e73f6e7841d1af714ee29494914e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:19.850008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ec18-7fa1-4cb9-b269-75348b67f3bf None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:19.850459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ec18-7fa1-4cb9-b269-75348b67f3bf None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:19.850667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ec18-7fa1-4cb9-b269-75348b67f3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:19.871534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-96b0ec18-7fa1-4cb9-b269-75348b67f3bf None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:19.872814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-96b0ec18-7fa1-4cb9-b269-75348b67f3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:19.980754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1001/2012] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:19.990710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:19.992148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:20.052171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:20.073669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40e001-5100-476d-b932-7dfff95e6761 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:20.078098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd2320-2c80-4479-a5d3-525957a2e2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:20.078817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd2320-2c80-4479-a5d3-525957a2e2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:20.079062 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd2320-2c80-4479-a5d3-525957a2e2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:20.079384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd2320-2c80-4479-a5d3-525957a2e2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:20.089284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd2320-2c80-4479-a5d3-525957a2e2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:20.090779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd2320-2c80-4479-a5d3-525957a2e2a9 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:20.101108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1012/2013] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:20.867542 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0ec18-7fa1-4cb9-b269-75348b67f3bf None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:20.869435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-96b0ec18-7fa1-4cb9-b269-75348b67f3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:20.889556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0ec18-7fa1-4cb9-b269-75348b67f3bf None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:20.896011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2224-b565-402d-82fd-a5ce20942e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:20.897113 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2224-b565-402d-82fd-a5ce20942e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:20.897535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2224-b565-402d-82fd-a5ce20942e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:20.898134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2224-b565-402d-82fd-a5ce20942e56 admin admin] PATH_INFO: `/v3/projects/159b9fc3cf7c4739a5e5f59805c161ca` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:20.899437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf2224-b565-402d-82fd-a5ce20942e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=159b9fc3cf7c4739a5e5f59805c161ca)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:20.901709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf2224-b565-402d-82fd-a5ce20942e56 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:20.965168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e4cf2224-b565-402d-82fd-a5ce20942e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159b9fc3cf7c4739a5e5f59805c161ca', 'request_id': 'req-e4cf2224-b565-402d-82fd-a5ce20942e56'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:20.976738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e4cf2224-b565-402d-82fd-a5ce20942e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159b9fc3cf7c4739a5e5f59805c161ca', 'request_id': 'req-e4cf2224-b565-402d-82fd-a5ce20942e56'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:20.991489 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e4cf2224-b565-402d-82fd-a5ce20942e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159b9fc3cf7c4739a5e5f59805c161ca', 'request_id': 'req-e4cf2224-b565-402d-82fd-a5ce20942e56'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:21.012570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e4cf2224-b565-402d-82fd-a5ce20942e56 admin admin] The token cache is being invalidate because project 159b9fc3cf7c4739a5e5f59805c161ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:21.012945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e4cf2224-b565-402d-82fd-a5ce20942e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:21.014378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e4cf2224-b565-402d-82fd-a5ce20942e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:21.016171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1002/2014] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:20 2022] DELETE /identity/v3/projects/159b9fc3cf7c4739a5e5f59805c161ca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:21.022984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d0641-0895-44dc-a00d-a298a5d53130 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:21.023534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d0641-0895-44dc-a00d-a298a5d53130 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:21.023534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d0641-0895-44dc-a00d-a298a5d53130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:21.054179 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-3c3d0641-0895-44dc-a00d-a298a5d53130 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:21.055897 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-3c3d0641-0895-44dc-a00d-a298a5d53130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:21.124605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1013/2015] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:21.133187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2d24-bcb3-4038-bad3-1c3afe95727a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:21.133480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2d24-bcb3-4038-bad3-1c3afe95727a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:21.133760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2d24-bcb3-4038-bad3-1c3afe95727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:21.153504 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e3fd2d24-bcb3-4038-bad3-1c3afe95727a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:21.154751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e3fd2d24-bcb3-4038-bad3-1c3afe95727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:21.163549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1003/2016] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:21.167740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d0641-0895-44dc-a00d-a298a5d53130 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:21.177833 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d0641-0895-44dc-a00d-a298a5d53130 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:21.182337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322ffe6-fab1-4bef-b0fe-6c59336b68c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:21.183022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322ffe6-fab1-4bef-b0fe-6c59336b68c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:21.183302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322ffe6-fab1-4bef-b0fe-6c59336b68c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:21.183574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322ffe6-fab1-4bef-b0fe-6c59336b68c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:21.184293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322ffe6-fab1-4bef-b0fe-6c59336b68c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:21.184601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322ffe6-fab1-4bef-b0fe-6c59336b68c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:21.186222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322ffe6-fab1-4bef-b0fe-6c59336b68c1 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:21.198697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1014/2017] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:16:21.202776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd2d24-bcb3-4038-bad3-1c3afe95727a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:21.212986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd2d24-bcb3-4038-bad3-1c3afe95727a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:21.218190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aec181-1731-4931-b0b1-79b74104a5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:21.218840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec181-1731-4931-b0b1-79b74104a5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:21.219124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec181-1731-4931-b0b1-79b74104a5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:21.219400 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aec181-1731-4931-b0b1-79b74104a5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:21.220270 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aec181-1731-4931-b0b1-79b74104a5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:21.222286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aec181-1731-4931-b0b1-79b74104a5b3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:21.251978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1004/2018] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:21 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:21.253176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322ffe6-fab1-4bef-b0fe-6c59336b68c1 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:21.263245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322ffe6-fab1-4bef-b0fe-6c59336b68c1 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:21.325130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f0db8-34b3-422b-bd13-b44201ca53ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:21.325811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f0db8-34b3-422b-bd13-b44201ca53ec admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:21.326094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f0db8-34b3-422b-bd13-b44201ca53ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:21.326369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f0db8-34b3-422b-bd13-b44201ca53ec admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:21.327134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f0db8-34b3-422b-bd13-b44201ca53ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:21.329054 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f0db8-34b3-422b-bd13-b44201ca53ec admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:21.349208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1015/2019] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:21 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:21.353222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aec181-1731-4931-b0b1-79b74104a5b3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:21.364060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aec181-1731-4931-b0b1-79b74104a5b3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:21.369144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1facd-66f5-40a4-99b1-2c1da7aa1e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:21.369801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1facd-66f5-40a4-99b1-2c1da7aa1e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:21.370082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1facd-66f5-40a4-99b1-2c1da7aa1e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:21.370354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1facd-66f5-40a4-99b1-2c1da7aa1e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:21.371110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1facd-66f5-40a4-99b1-2c1da7aa1e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:21.372692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1facd-66f5-40a4-99b1-2c1da7aa1e9f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:21.383582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1005/2020] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:21.387613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f0db8-34b3-422b-bd13-b44201ca53ec admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:21.397884 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f0db8-34b3-422b-bd13-b44201ca53ec admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:21.402800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6e8b2-f003-418f-bad5-eef339a9511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:21.403466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6e8b2-f003-418f-bad5-eef339a9511a admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:21.403751 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6e8b2-f003-418f-bad5-eef339a9511a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:21.404030 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6e8b2-f003-418f-bad5-eef339a9511a admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:21.404758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6e8b2-f003-418f-bad5-eef339a9511a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:21.406371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6e8b2-f003-418f-bad5-eef339a9511a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:21.417497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1016/2021] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:21.421792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1facd-66f5-40a4-99b1-2c1da7aa1e9f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:21.432552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1facd-66f5-40a4-99b1-2c1da7aa1e9f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:21.438094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f6950-269c-4e60-a19c-bdb564317128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:21.439710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f6950-269c-4e60-a19c-bdb564317128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:21.439921 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f6950-269c-4e60-a19c-bdb564317128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:21.440193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f6950-269c-4e60-a19c-bdb564317128 admin admin] PATH_INFO: `/v3/projects/d0ebfe281cb442e18830e44768082fdd/users/48e816a85da046fbb8a02f9a84ecd6fb/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:21.456653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f6950-269c-4e60-a19c-bdb564317128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ebfe281cb442e18830e44768082fdd, user_id=48e816a85da046fbb8a02f9a84ecd6fb, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:21.459372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f6950-269c-4e60-a19c-bdb564317128 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:21.462387 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:21.475877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1006/2022] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:21 2022] PUT /identity/v3/projects/d0ebfe281cb442e18830e44768082fdd/users/48e816a85da046fbb8a02f9a84ecd6fb/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:21.481011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcef03-46f7-4f5e-9e31-04f7f50a7ca3 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:21.481304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcef03-46f7-4f5e-9e31-04f7f50a7ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:21.481583 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcef03-46f7-4f5e-9e31-04f7f50a7ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:21.500678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e2dcef03-46f7-4f5e-9e31-04f7f50a7ca3 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:21.502573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e2dcef03-46f7-4f5e-9e31-04f7f50a7ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:21.570370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:21.591732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1017/2023] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:21.603675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f6950-269c-4e60-a19c-bdb564317128 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:21.605438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-489f6950-269c-4e60-a19c-bdb564317128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:21.675040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f6950-269c-4e60-a19c-bdb564317128 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:21.678883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30e1f0-ed88-41fd-bef4-0d83b01ca925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:21.679529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30e1f0-ed88-41fd-bef4-0d83b01ca925 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:21.679816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30e1f0-ed88-41fd-bef4-0d83b01ca925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:21.680094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30e1f0-ed88-41fd-bef4-0d83b01ca925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:21.690054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30e1f0-ed88-41fd-bef4-0d83b01ca925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:21.691521 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30e1f0-ed88-41fd-bef4-0d83b01ca925 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:21.701182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1007/2024] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:22.533042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c8b0e-1744-4ce4-80ee-6aad1f5986f7 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:22.533480 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c8b0e-1744-4ce4-80ee-6aad1f5986f7 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:22.533671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c8b0e-1744-4ce4-80ee-6aad1f5986f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:22.563754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-1f2c8b0e-1744-4ce4-80ee-6aad1f5986f7 None None] MFA Rules not processed for user `48e816a85da046fbb8a02f9a84ecd6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:22.566782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1f2c8b0e-1744-4ce4-80ee-6aad1f5986f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:22.675821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1018/2025] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:22.686022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30e1f0-ed88-41fd-bef4-0d83b01ca925 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:22.687547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0d30e1f0-ed88-41fd-bef4-0d83b01ca925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:22.793692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30e1f0-ed88-41fd-bef4-0d83b01ca925 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:22.805517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db960c6b-b33a-4cdf-91d3-ee721e3daf4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:22.806189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db960c6b-b33a-4cdf-91d3-ee721e3daf4b service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:22.806468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db960c6b-b33a-4cdf-91d3-ee721e3daf4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:22.806771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db960c6b-b33a-4cdf-91d3-ee721e3daf4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:22.826396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db960c6b-b33a-4cdf-91d3-ee721e3daf4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:22.827982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db960c6b-b33a-4cdf-91d3-ee721e3daf4b service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:22.862433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1008/2026] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:23.455863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c8b0e-1744-4ce4-80ee-6aad1f5986f7 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:23.457653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1f2c8b0e-1744-4ce4-80ee-6aad1f5986f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:23.486248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c8b0e-1744-4ce4-80ee-6aad1f5986f7 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:23.490170 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e563c1-2bc8-4de0-b74e-d435b5596da3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:23.490852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e563c1-2bc8-4de0-b74e-d435b5596da3 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:23.491136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e563c1-2bc8-4de0-b74e-d435b5596da3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:23.491407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e563c1-2bc8-4de0-b74e-d435b5596da3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:23.493172 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-22e563c1-2bc8-4de0-b74e-d435b5596da3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:23.570139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e563c1-2bc8-4de0-b74e-d435b5596da3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:23.571617 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e563c1-2bc8-4de0-b74e-d435b5596da3 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:23.583887 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1019/2027] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:24.420174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35131d6e-65b4-4883-9a23-afe2356f93f7 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:24.420695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35131d6e-65b4-4883-9a23-afe2356f93f7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:24.420776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35131d6e-65b4-4883-9a23-afe2356f93f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:24.441412 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-35131d6e-65b4-4883-9a23-afe2356f93f7 None None] MFA Rules not processed for user `48e816a85da046fbb8a02f9a84ecd6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:24.442919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-35131d6e-65b4-4883-9a23-afe2356f93f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:24.460133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1009/2028] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:24.640296 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e563c1-2bc8-4de0-b74e-d435b5596da3 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:24.651906 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e563c1-2bc8-4de0-b74e-d435b5596da3 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:24.658388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbf2a8-ea1e-4ab3-a4af-3b832fbd223a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:24.659689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbf2a8-ea1e-4ab3-a4af-3b832fbd223a service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:24.660159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbf2a8-ea1e-4ab3-a4af-3b832fbd223a service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:24.660577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbf2a8-ea1e-4ab3-a4af-3b832fbd223a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:24.663105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-31fbf2a8-ea1e-4ab3-a4af-3b832fbd223a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:24.732008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbf2a8-ea1e-4ab3-a4af-3b832fbd223a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:24.733755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbf2a8-ea1e-4ab3-a4af-3b832fbd223a service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:24.744340 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1020/2029] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:30.394693 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35131d6e-65b4-4883-9a23-afe2356f93f7 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:30.396341 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-35131d6e-65b4-4883-9a23-afe2356f93f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:30.414552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35131d6e-65b4-4883-9a23-afe2356f93f7 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:30.420710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:30.422290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:30.422668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:30.423743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] PATH_INFO: `/v3/users/72bcc352a8c14f008a1a94b5bd2a3316` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:30.427792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72bcc352a8c14f008a1a94b5bd2a3316)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:30.429779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:30.542479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72bcc352a8c14f008a1a94b5bd2a3316'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:30.558289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72bcc352a8c14f008a1a94b5bd2a3316'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:30.586595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72bcc352a8c14f008a1a94b5bd2a3316'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:30.587508 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72bcc352a8c14f008a1a94b5bd2a3316'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:30.588541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72bcc352a8c14f008a1a94b5bd2a3316'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:30.641442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1010/2030] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:30 2022] DELETE /identity/v3/users/72bcc352a8c14f008a1a94b5bd2a3316 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:30.647184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484e983-bfe4-4c92-8ee5-2ade1cc57e77 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:30.649095 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484e983-bfe4-4c92-8ee5-2ade1cc57e77 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:30.649848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484e983-bfe4-4c92-8ee5-2ade1cc57e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:30.675290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-c484e983-bfe4-4c92-8ee5-2ade1cc57e77 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:30.677113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c484e983-bfe4-4c92-8ee5-2ade1cc57e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:30.691333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:30.761083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1021/2031] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:30.899711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:30.901165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:30.919377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:31.014549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0a4b5-9a27-40f2-b5cc-2d41fcd88669 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:31.024376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c5904-7cf2-4bcc-8d6c-484d522bbef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:31.025355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c5904-7cf2-4bcc-8d6c-484d522bbef7 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:31.025902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c5904-7cf2-4bcc-8d6c-484d522bbef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:31.026325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c5904-7cf2-4bcc-8d6c-484d522bbef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:31.037884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c5904-7cf2-4bcc-8d6c-484d522bbef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:31.039643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c5904-7cf2-4bcc-8d6c-484d522bbef7 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:31.052396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1011/2032] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:31.768714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484e983-bfe4-4c92-8ee5-2ade1cc57e77 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:31.770254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c484e983-bfe4-4c92-8ee5-2ade1cc57e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:31.784838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484e983-bfe4-4c92-8ee5-2ade1cc57e77 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:31.789982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:31.791360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:31.791793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:31.792213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] PATH_INFO: `/v3/projects/f59b5a96f57646cd8091df19f905bd4f` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:31.793662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59b5a96f57646cd8091df19f905bd4f)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:31.795794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:31.864468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59b5a96f57646cd8091df19f905bd4f', 'request_id': 'req-bb7525fa-2f74-4c12-a238-93df41698764'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:31.886760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59b5a96f57646cd8091df19f905bd4f', 'request_id': 'req-bb7525fa-2f74-4c12-a238-93df41698764'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:31.899578 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59b5a96f57646cd8091df19f905bd4f', 'request_id': 'req-bb7525fa-2f74-4c12-a238-93df41698764'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:31.920097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] The token cache is being invalidate because project f59b5a96f57646cd8091df19f905bd4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:31.920558 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:31.921436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:31.925294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1022/2033] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:31 2022] DELETE /identity/v3/projects/f59b5a96f57646cd8091df19f905bd4f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:31.929229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c5904-7cf2-4bcc-8d6c-484d522bbef7 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:31.943427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c5904-7cf2-4bcc-8d6c-484d522bbef7 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:31.992150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:31.994324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:32.095336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f975a9d-493e-4c50-9777-21acee272919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:32.096770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f975a9d-493e-4c50-9777-21acee272919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:32.097343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f975a9d-493e-4c50-9777-21acee272919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:32.098076 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f975a9d-493e-4c50-9777-21acee272919 admin admin] PATH_INFO: `/v3/users/a9e61f431bce4a2d863d386ced64dd3e` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:32.099563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f975a9d-493e-4c50-9777-21acee272919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e61f431bce4a2d863d386ced64dd3e)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:32.099783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7525fa-2f74-4c12-a238-93df41698764 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:32.102978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f975a9d-493e-4c50-9777-21acee272919 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:32.107889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:32.109648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:32.110003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:32.111210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] PATH_INFO: `/v3/users/69a050a4652a47d38c994441134a944c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:32.113308 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a050a4652a47d38c994441134a944c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:32.115953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:32.213441 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1f975a9d-493e-4c50-9777-21acee272919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e61f431bce4a2d863d386ced64dd3e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:32.231703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:32.236287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1f975a9d-493e-4c50-9777-21acee272919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e61f431bce4a2d863d386ced64dd3e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:32.246592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a050a4652a47d38c994441134a944c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:32.254875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1f975a9d-493e-4c50-9777-21acee272919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e61f431bce4a2d863d386ced64dd3e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:32.256388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1f975a9d-493e-4c50-9777-21acee272919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e61f431bce4a2d863d386ced64dd3e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:32.256966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1f975a9d-493e-4c50-9777-21acee272919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e61f431bce4a2d863d386ced64dd3e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:32.263183 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a050a4652a47d38c994441134a944c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:32.265385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a050a4652a47d38c994441134a944c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:32.268348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a050a4652a47d38c994441134a944c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:32.289978 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a050a4652a47d38c994441134a944c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:32.293056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1012/2034] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:31 2022] DELETE /identity/v3/users/a9e61f431bce4a2d863d386ced64dd3e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:32.324627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1023/2035] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:31 2022] DELETE /identity/v3/users/69a050a4652a47d38c994441134a944c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:32.326588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1b2df-7b92-4a26-9f43-f27745ee18b9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:32.327059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1b2df-7b92-4a26-9f43-f27745ee18b9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:32.327517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1b2df-7b92-4a26-9f43-f27745ee18b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:32.361308 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-bca1b2df-7b92-4a26-9f43-f27745ee18b9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:32.363454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-bca1b2df-7b92-4a26-9f43-f27745ee18b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:32.425165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:32.483734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1013/2036] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:32.504716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:32.506661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:32.593880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5915c3-4a2b-41fe-bb93-e2ed34dc65b0 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:32.598642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b13335-85c9-4248-bd71-1079212f6458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:32.599315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b13335-85c9-4248-bd71-1079212f6458 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:32.599863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b13335-85c9-4248-bd71-1079212f6458 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:32.599863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b13335-85c9-4248-bd71-1079212f6458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:32.612400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b13335-85c9-4248-bd71-1079212f6458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:32.613874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b13335-85c9-4248-bd71-1079212f6458 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:32.626657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1024/2037] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:33.292087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1b2df-7b92-4a26-9f43-f27745ee18b9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:33.293797 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-bca1b2df-7b92-4a26-9f43-f27745ee18b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:33.331041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1b2df-7b92-4a26-9f43-f27745ee18b9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:33.343537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf897e3-2105-45cf-8b06-1d9d82a667e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:33.347082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf897e3-2105-45cf-8b06-1d9d82a667e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:33.347740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf897e3-2105-45cf-8b06-1d9d82a667e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:33.348235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf897e3-2105-45cf-8b06-1d9d82a667e5 admin admin] PATH_INFO: `/v3/users/29267604fce349dd8251edc9d12d04c4` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:33.349884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf897e3-2105-45cf-8b06-1d9d82a667e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29267604fce349dd8251edc9d12d04c4)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:33.354472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf897e3-2105-45cf-8b06-1d9d82a667e5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:33.377309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b13335-85c9-4248-bd71-1079212f6458 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:33.379165 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-60b13335-85c9-4248-bd71-1079212f6458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:33.408455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b13335-85c9-4248-bd71-1079212f6458 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:33.427620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:33.428821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:33.429109 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:33.429439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] PATH_INFO: `/v3/projects/02009f3ae87040ac8a71021521028951` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:33.432453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02009f3ae87040ac8a71021521028951)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:33.435230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:33.453802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-baf897e3-2105-45cf-8b06-1d9d82a667e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29267604fce349dd8251edc9d12d04c4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.468991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-baf897e3-2105-45cf-8b06-1d9d82a667e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29267604fce349dd8251edc9d12d04c4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.497556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-baf897e3-2105-45cf-8b06-1d9d82a667e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29267604fce349dd8251edc9d12d04c4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.501234 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-baf897e3-2105-45cf-8b06-1d9d82a667e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29267604fce349dd8251edc9d12d04c4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.502948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-baf897e3-2105-45cf-8b06-1d9d82a667e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29267604fce349dd8251edc9d12d04c4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.564968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1014/2038] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:33 2022] DELETE /identity/v3/users/29267604fce349dd8251edc9d12d04c4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:33.574325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6236660-f333-49d8-bc81-42b8587bfe47 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:33.575920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6236660-f333-49d8-bc81-42b8587bfe47 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:33.578482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6236660-f333-49d8-bc81-42b8587bfe47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:33.588231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02009f3ae87040ac8a71021521028951', 'request_id': 'req-9eec1b16-63ef-4e42-9da7-61af0798ceb2'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.614391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02009f3ae87040ac8a71021521028951', 'request_id': 'req-9eec1b16-63ef-4e42-9da7-61af0798ceb2'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.628309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02009f3ae87040ac8a71021521028951', 'request_id': 'req-9eec1b16-63ef-4e42-9da7-61af0798ceb2'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.631401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c6236660-f333-49d8-bc81-42b8587bfe47 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:33.632752 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c6236660-f333-49d8-bc81-42b8587bfe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:33.656729 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] The token cache is being invalidate because project 02009f3ae87040ac8a71021521028951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:33.658120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.668875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.678801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1025/2039] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:33 2022] DELETE /identity/v3/projects/02009f3ae87040ac8a71021521028951 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:33.680799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:33.692262 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:33.776380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1015/2040] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:33.777513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6236660-f333-49d8-bc81-42b8587bfe47 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:33.779080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c6236660-f333-49d8-bc81-42b8587bfe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:33.787867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:33.802180 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6236660-f333-49d8-bc81-42b8587bfe47 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:33.808004 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:33.808978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:33.809263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:33.809524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] PATH_INFO: `/v3/users/21d0c4f48ba14c72b9feaf70b263b883` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:33.810786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d0c4f48ba14c72b9feaf70b263b883)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:33.812723 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:33.820896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec1b16-63ef-4e42-9da7-61af0798ceb2 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:33.828459 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:33.831416 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:33.832213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:33.832533 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] PATH_INFO: `/v3/projects/e06a68ef136b495cbaea4ba6ae9f3fb9` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:33.834809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06a68ef136b495cbaea4ba6ae9f3fb9)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:33.836757 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:33.873191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:33.887584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d0c4f48ba14c72b9feaf70b263b883'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.904765 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d0c4f48ba14c72b9feaf70b263b883'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.925213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d0c4f48ba14c72b9feaf70b263b883'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.926296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d0c4f48ba14c72b9feaf70b263b883'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.927628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d0c4f48ba14c72b9feaf70b263b883'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.940205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06a68ef136b495cbaea4ba6ae9f3fb9', 'request_id': 'req-dff2fefc-0547-430a-8e66-b9d653d6195d'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.957210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06a68ef136b495cbaea4ba6ae9f3fb9', 'request_id': 'req-dff2fefc-0547-430a-8e66-b9d653d6195d'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:33.962015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1016/2041] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:33 2022] DELETE /identity/v3/users/21d0c4f48ba14c72b9feaf70b263b883 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:33.967607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:33.969594 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:33.976126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06a68ef136b495cbaea4ba6ae9f3fb9', 'request_id': 'req-dff2fefc-0547-430a-8e66-b9d653d6195d'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.018574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] The token cache is being invalidate because project e06a68ef136b495cbaea4ba6ae9f3fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:34.018899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.019647 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.023511 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1026/2042] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:33 2022] DELETE /identity/v3/projects/e06a68ef136b495cbaea4ba6ae9f3fb9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:34.028686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:34.029869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:34.083910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aa292-3dc9-483b-b6f8-fa2b046bfe66 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:34.088717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abb214-9fb6-4eca-ab9e-cfd7897bb1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:34.089270 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abb214-9fb6-4eca-ab9e-cfd7897bb1ac service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:34.089558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abb214-9fb6-4eca-ab9e-cfd7897bb1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:34.089958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abb214-9fb6-4eca-ab9e-cfd7897bb1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:34.091893 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f2abb214-9fb6-4eca-ab9e-cfd7897bb1ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:34.140718 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2fefc-0547-430a-8e66-b9d653d6195d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:34.168464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abb214-9fb6-4eca-ab9e-cfd7897bb1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:34.169983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abb214-9fb6-4eca-ab9e-cfd7897bb1ac service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:34.183944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1017/2043] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:34.210500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:34.211588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:34.211876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:34.212256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] PATH_INFO: `/v3/users/78f6c3d231904b199ee4566401ac5329` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:34.213386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f6c3d231904b199ee4566401ac5329)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:34.215364 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:34.240913 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:34.274395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f6c3d231904b199ee4566401ac5329'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.283161 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f6c3d231904b199ee4566401ac5329'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.284470 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f6c3d231904b199ee4566401ac5329'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.285962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f6c3d231904b199ee4566401ac5329'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.315366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f6c3d231904b199ee4566401ac5329'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.341028 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1027/2044] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:34 2022] DELETE /identity/v3/users/78f6c3d231904b199ee4566401ac5329 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:34.423961 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abb214-9fb6-4eca-ab9e-cfd7897bb1ac service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:34.425490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f2abb214-9fb6-4eca-ab9e-cfd7897bb1ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:34.443602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abb214-9fb6-4eca-ab9e-cfd7897bb1ac service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:34.544179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bd6f8-9787-4375-91cf-2c86e1ab6874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:34.544996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bd6f8-9787-4375-91cf-2c86e1ab6874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:34.545342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bd6f8-9787-4375-91cf-2c86e1ab6874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:34.545708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bd6f8-9787-4375-91cf-2c86e1ab6874 admin admin] PATH_INFO: `/v3/projects/3c90644cc0fa458cb1add622a1db7bfc` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:34.548494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bd6f8-9787-4375-91cf-2c86e1ab6874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c90644cc0fa458cb1add622a1db7bfc)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:34.550570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bd6f8-9787-4375-91cf-2c86e1ab6874 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:34.558075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:34.633967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b14bd6f8-9787-4375-91cf-2c86e1ab6874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c90644cc0fa458cb1add622a1db7bfc', 'request_id': 'req-b14bd6f8-9787-4375-91cf-2c86e1ab6874'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.647866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b14bd6f8-9787-4375-91cf-2c86e1ab6874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c90644cc0fa458cb1add622a1db7bfc', 'request_id': 'req-b14bd6f8-9787-4375-91cf-2c86e1ab6874'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.649326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:34.650951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:34.671532 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b14bd6f8-9787-4375-91cf-2c86e1ab6874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c90644cc0fa458cb1add622a1db7bfc', 'request_id': 'req-b14bd6f8-9787-4375-91cf-2c86e1ab6874'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.674100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926f00-0418-4bca-b9d7-7bea57307c93 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:34.689043 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b14bd6f8-9787-4375-91cf-2c86e1ab6874 admin admin] The token cache is being invalidate because project 3c90644cc0fa458cb1add622a1db7bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:34.689373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b14bd6f8-9787-4375-91cf-2c86e1ab6874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.690131 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b14bd6f8-9787-4375-91cf-2c86e1ab6874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.701458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1018/2045] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:34 2022] DELETE /identity/v3/projects/3c90644cc0fa458cb1add622a1db7bfc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:34.703165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026d964-6d91-4090-b3f0-601025b8d0ff None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:34.703455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026d964-6d91-4090-b3f0-601025b8d0ff None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:34.703735 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026d964-6d91-4090-b3f0-601025b8d0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:34.742787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2026d964-6d91-4090-b3f0-601025b8d0ff None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:34.744002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2026d964-6d91-4090-b3f0-601025b8d0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:34.804911 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1857da-63e7-4904-b539-ed8a715c1b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:34.805789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1857da-63e7-4904-b539-ed8a715c1b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:34.806089 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1857da-63e7-4904-b539-ed8a715c1b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:34.806460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1857da-63e7-4904-b539-ed8a715c1b07 admin admin] PATH_INFO: `/v3/projects/7973b6831b6343a285a9bcce12003c59` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:34.807697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1857da-63e7-4904-b539-ed8a715c1b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7973b6831b6343a285a9bcce12003c59)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:34.811284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1857da-63e7-4904-b539-ed8a715c1b07 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:34.827722 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1019/2046] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:34.828592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026d964-6d91-4090-b3f0-601025b8d0ff None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:34.831495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2026d964-6d91-4090-b3f0-601025b8d0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:34.845545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026d964-6d91-4090-b3f0-601025b8d0ff None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:34.850651 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:34.851684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:34.851971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:34.852691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] PATH_INFO: `/v3/projects/6603e994c3dd421285ac47163e011ad2` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:34.854177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6603e994c3dd421285ac47163e011ad2)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:34.856461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:34.876664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ae1857da-63e7-4904-b539-ed8a715c1b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7973b6831b6343a285a9bcce12003c59', 'request_id': 'req-ae1857da-63e7-4904-b539-ed8a715c1b07'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.885133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ae1857da-63e7-4904-b539-ed8a715c1b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7973b6831b6343a285a9bcce12003c59', 'request_id': 'req-ae1857da-63e7-4904-b539-ed8a715c1b07'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.894333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ae1857da-63e7-4904-b539-ed8a715c1b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7973b6831b6343a285a9bcce12003c59', 'request_id': 'req-ae1857da-63e7-4904-b539-ed8a715c1b07'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.909449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ae1857da-63e7-4904-b539-ed8a715c1b07 admin admin] The token cache is being invalidate because project 7973b6831b6343a285a9bcce12003c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:34.909743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ae1857da-63e7-4904-b539-ed8a715c1b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.910403 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ae1857da-63e7-4904-b539-ed8a715c1b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.912057 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1028/2047] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:34 2022] DELETE /identity/v3/projects/7973b6831b6343a285a9bcce12003c59 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:34.913362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdfe64-caac-41e2-9b8c-21d9f21a521b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:34.913648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdfe64-caac-41e2-9b8c-21d9f21a521b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:34.913923 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdfe64-caac-41e2-9b8c-21d9f21a521b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:34.919102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6603e994c3dd421285ac47163e011ad2', 'request_id': 'req-9b5748a7-9740-4a00-b3ef-fe8078127511'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.927143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6603e994c3dd421285ac47163e011ad2', 'request_id': 'req-9b5748a7-9740-4a00-b3ef-fe8078127511'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.932775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-35fdfe64-caac-41e2-9b8c-21d9f21a521b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:34.933988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-35fdfe64-caac-41e2-9b8c-21d9f21a521b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:34.934397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6603e994c3dd421285ac47163e011ad2', 'request_id': 'req-9b5748a7-9740-4a00-b3ef-fe8078127511'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.951132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] The token cache is being invalidate because project 6603e994c3dd421285ac47163e011ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:34.951422 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.952090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:34.958797 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1020/2048] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:34 2022] DELETE /identity/v3/projects/6603e994c3dd421285ac47163e011ad2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:34.958797 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:34.958797 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:34.962144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:34.986441 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:35.016420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1029/2049] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:35.017879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0abae-c801-4567-a881-7618d31e4dbd None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.018169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0abae-c801-4567-a881-7618d31e4dbd None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.018450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0abae-c801-4567-a881-7618d31e4dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.037544 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-caa0abae-c801-4567-a881-7618d31e4dbd None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:35.038791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-caa0abae-c801-4567-a881-7618d31e4dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:35.046915 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1030/2050] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:35.047528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0abae-c801-4567-a881-7618d31e4dbd None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.049334 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5748a7-9740-4a00-b3ef-fe8078127511 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.054345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.055063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.055352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.055636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] PATH_INFO: `/v3/users/486c71d71e8745a88afba8e2b8aeee87` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.056867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=486c71d71e8745a88afba8e2b8aeee87)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.058214 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0abae-c801-4567-a881-7618d31e4dbd None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.058855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.063333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb580a2-a202-426a-ba79-b1a8eb6be7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.064093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb580a2-a202-426a-ba79-b1a8eb6be7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.064370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb580a2-a202-426a-ba79-b1a8eb6be7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.064651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb580a2-a202-426a-ba79-b1a8eb6be7ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.065375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb580a2-a202-426a-ba79-b1a8eb6be7ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:35.065677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb580a2-a202-426a-ba79-b1a8eb6be7ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.067397 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb580a2-a202-426a-ba79-b1a8eb6be7ea admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.079434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1031/2051] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:35.080753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79380d7-11cc-40a3-9c56-6eb23c51d396 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.081047 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79380d7-11cc-40a3-9c56-6eb23c51d396 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.081323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79380d7-11cc-40a3-9c56-6eb23c51d396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.099971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-a79380d7-11cc-40a3-9c56-6eb23c51d396 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:35.101175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-a79380d7-11cc-40a3-9c56-6eb23c51d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:35.109233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1032/2052] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:35.110087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79380d7-11cc-40a3-9c56-6eb23c51d396 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.111887 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486c71d71e8745a88afba8e2b8aeee87'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:35.118919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486c71d71e8745a88afba8e2b8aeee87'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:35.122910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79380d7-11cc-40a3-9c56-6eb23c51d396 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.127875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486c71d71e8745a88afba8e2b8aeee87'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:35.128219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbb321-3de6-4150-b2eb-4e2f9592fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.128559 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486c71d71e8745a88afba8e2b8aeee87'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:35.128944 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbb321-3de6-4150-b2eb-4e2f9592fa8d admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.129252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbb321-3de6-4150-b2eb-4e2f9592fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.129547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486c71d71e8745a88afba8e2b8aeee87'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:35.129660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbb321-3de6-4150-b2eb-4e2f9592fa8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.130244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbb321-3de6-4150-b2eb-4e2f9592fa8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.132753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbb321-3de6-4150-b2eb-4e2f9592fa8d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.146980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1021/2053] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:34 2022] DELETE /identity/v3/users/486c71d71e8745a88afba8e2b8aeee87 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:35.148109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.149803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:35.165028 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1033/2054] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:35 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:35.166234 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbb321-3de6-4150-b2eb-4e2f9592fa8d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.168286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8ffbb321-3de6-4150-b2eb-4e2f9592fa8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:35.233769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07371717-9007-4f93-b10b-29959b492520 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.247803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbb321-3de6-4150-b2eb-4e2f9592fa8d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.261394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d1f09-d022-4239-9ee3-6747bdec22b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.262276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d1f09-d022-4239-9ee3-6747bdec22b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.262591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d1f09-d022-4239-9ee3-6747bdec22b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.262912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d1f09-d022-4239-9ee3-6747bdec22b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.263618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d1f09-d022-4239-9ee3-6747bdec22b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.265739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d1f09-d022-4239-9ee3-6747bdec22b5 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.280203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:35.290893 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1034/2055] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:35 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:35.292569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d1f09-d022-4239-9ee3-6747bdec22b5 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.304811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d1f09-d022-4239-9ee3-6747bdec22b5 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.311525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5890737-b3ad-46cb-a439-dea45b26ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.312295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5890737-b3ad-46cb-a439-dea45b26ae3e admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.312720 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5890737-b3ad-46cb-a439-dea45b26ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.313068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5890737-b3ad-46cb-a439-dea45b26ae3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.314429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5890737-b3ad-46cb-a439-dea45b26ae3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.316358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5890737-b3ad-46cb-a439-dea45b26ae3e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.320128 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728af1d0-7ebb-4678-ab9c-27cc6727a3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.320944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728af1d0-7ebb-4678-ab9c-27cc6727a3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.321335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728af1d0-7ebb-4678-ab9c-27cc6727a3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.321844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728af1d0-7ebb-4678-ab9c-27cc6727a3e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.323118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728af1d0-7ebb-4678-ab9c-27cc6727a3e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:35.323558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728af1d0-7ebb-4678-ab9c-27cc6727a3e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.325397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728af1d0-7ebb-4678-ab9c-27cc6727a3e8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.328309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1035/2056] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:35.332682 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5890737-b3ad-46cb-a439-dea45b26ae3e admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.340032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1022/2057] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:35.344918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728af1d0-7ebb-4678-ab9c-27cc6727a3e8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.347217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5890737-b3ad-46cb-a439-dea45b26ae3e admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.352537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ada6c8-1a87-4bba-96c9-92c5e7622823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.353855 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada6c8-1a87-4bba-96c9-92c5e7622823 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.354148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada6c8-1a87-4bba-96c9-92c5e7622823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.354430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada6c8-1a87-4bba-96c9-92c5e7622823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.354746 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728af1d0-7ebb-4678-ab9c-27cc6727a3e8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.355224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ada6c8-1a87-4bba-96c9-92c5e7622823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.356935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ada6c8-1a87-4bba-96c9-92c5e7622823 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.360519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89750a17-0228-443a-85ed-a7f124d8cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.361500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89750a17-0228-443a-85ed-a7f124d8cbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.361845 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89750a17-0228-443a-85ed-a7f124d8cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.362214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89750a17-0228-443a-85ed-a7f124d8cbe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.363029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89750a17-0228-443a-85ed-a7f124d8cbe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.365077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89750a17-0228-443a-85ed-a7f124d8cbe2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.369474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1036/2058] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:35.373287 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ada6c8-1a87-4bba-96c9-92c5e7622823 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.384616 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ada6c8-1a87-4bba-96c9-92c5e7622823 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.390121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d881ff3-b3bf-4b21-a120-d05d32362479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.391026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d881ff3-b3bf-4b21-a120-d05d32362479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.391844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d881ff3-b3bf-4b21-a120-d05d32362479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.392178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d881ff3-b3bf-4b21-a120-d05d32362479 admin admin] PATH_INFO: `/v3/projects/fe15c36e96024614ac8342a4a0b0db2f/users/3ee9f9874c8a406ea4531572fb1c8306/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.401383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1023/2059] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:35 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:35.406214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89750a17-0228-443a-85ed-a7f124d8cbe2 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.411321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d881ff3-b3bf-4b21-a120-d05d32362479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe15c36e96024614ac8342a4a0b0db2f, user_id=3ee9f9874c8a406ea4531572fb1c8306, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.414097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d881ff3-b3bf-4b21-a120-d05d32362479 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.432136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1037/2060] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:35 2022] PUT /identity/v3/projects/fe15c36e96024614ac8342a4a0b0db2f/users/3ee9f9874c8a406ea4531572fb1c8306/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:35.443838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035973-049b-4de3-9491-3f18fb9abc82 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.444121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035973-049b-4de3-9491-3f18fb9abc82 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.444407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef035973-049b-4de3-9491-3f18fb9abc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.475562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ef035973-049b-4de3-9491-3f18fb9abc82 None None] MFA Rules not processed for user `3ee9f9874c8a406ea4531572fb1c8306`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:35.476817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ef035973-049b-4de3-9491-3f18fb9abc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:35.487439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:35.493055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89750a17-0228-443a-85ed-a7f124d8cbe2 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.550858 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1038/2061] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:35.551707 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035973-049b-4de3-9491-3f18fb9abc82 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.553086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ef035973-049b-4de3-9491-3f18fb9abc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:35.559643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65663-ab99-4ebc-ae97-35f2296942ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.559948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65663-ab99-4ebc-ae97-35f2296942ba admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.560228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65663-ab99-4ebc-ae97-35f2296942ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.560871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65663-ab99-4ebc-ae97-35f2296942ba admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.561187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b65663-ab99-4ebc-ae97-35f2296942ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.563474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b65663-ab99-4ebc-ae97-35f2296942ba admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.587417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1024/2062] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:35 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:35.591267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65663-ab99-4ebc-ae97-35f2296942ba admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.600927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65663-ab99-4ebc-ae97-35f2296942ba admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.606038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f896a47-c294-4205-8113-c7ad195e575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.606715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f896a47-c294-4205-8113-c7ad195e575a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.607072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f896a47-c294-4205-8113-c7ad195e575a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.607411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f896a47-c294-4205-8113-c7ad195e575a admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.608308 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f896a47-c294-4205-8113-c7ad195e575a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.611456 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f896a47-c294-4205-8113-c7ad195e575a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.623193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef035973-049b-4de3-9491-3f18fb9abc82 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.629034 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.629970 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.630347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.630651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] PATH_INFO: `/v3/projects/fa78c35c6604409dbcd697157761f691` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.632140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa78c35c6604409dbcd697157761f691)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.634083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.644179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1025/2063] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:35 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:35.644179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f896a47-c294-4205-8113-c7ad195e575a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.678845 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:35.686736 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa78c35c6604409dbcd697157761f691', 'request_id': 'req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:35.697767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa78c35c6604409dbcd697157761f691', 'request_id': 'req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:35.705170 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa78c35c6604409dbcd697157761f691', 'request_id': 'req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:35.710724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f896a47-c294-4205-8113-c7ad195e575a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.716290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] The token cache is being invalidate because project fa78c35c6604409dbcd697157761f691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:35.716601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:35.717252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:35.718856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1039/2064] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:35 2022] DELETE /identity/v3/projects/fa78c35c6604409dbcd697157761f691 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:35.720159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.723871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:35.779458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef5ed5-4164-4f9a-a3a4-e97a1a042b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.781605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef5ed5-4164-4f9a-a3a4-e97a1a042b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.782389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef5ed5-4164-4f9a-a3a4-e97a1a042b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.782868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef5ed5-4164-4f9a-a3a4-e97a1a042b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.783826 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef5ed5-4164-4f9a-a3a4-e97a1a042b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.784489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:35.785460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef5ed5-4164-4f9a-a3a4-e97a1a042b67 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.799303 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1026/2065] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:35.800718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764edc7f-88f7-439c-82da-aec299d17fb0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.801003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764edc7f-88f7-439c-82da-aec299d17fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.801273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764edc7f-88f7-439c-82da-aec299d17fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.815241 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88262d-bd3f-42a8-bf48-4fcf57b7c62d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.820854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71179f3-f7f1-44cc-b92f-f1f4176f7e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.821693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71179f3-f7f1-44cc-b92f-f1f4176f7e15 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.822279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71179f3-f7f1-44cc-b92f-f1f4176f7e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.823093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71179f3-f7f1-44cc-b92f-f1f4176f7e15 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.823482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-764edc7f-88f7-439c-82da-aec299d17fb0 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:35.824086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71179f3-f7f1-44cc-b92f-f1f4176f7e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.824678 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-764edc7f-88f7-439c-82da-aec299d17fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:35.826328 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71179f3-f7f1-44cc-b92f-f1f4176f7e15 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.836111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1027/2066] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:35.836953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764edc7f-88f7-439c-82da-aec299d17fb0 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.838327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-764edc7f-88f7-439c-82da-aec299d17fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:35.850988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1040/2067] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:35 2022] POST /identity/v3/users => generated 306 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:35.852497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54e6c2-11aa-4a0e-9e3f-c3d2732bb56c None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.852848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54e6c2-11aa-4a0e-9e3f-c3d2732bb56c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.853186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54e6c2-11aa-4a0e-9e3f-c3d2732bb56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.855243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764edc7f-88f7-439c-82da-aec299d17fb0 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.860846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b74fe2-831a-4e1d-8d9b-241c23ab09b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.861694 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b74fe2-831a-4e1d-8d9b-241c23ab09b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.861980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b74fe2-831a-4e1d-8d9b-241c23ab09b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.862258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b74fe2-831a-4e1d-8d9b-241c23ab09b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.863023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b74fe2-831a-4e1d-8d9b-241c23ab09b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.864630 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b74fe2-831a-4e1d-8d9b-241c23ab09b8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.876924 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1028/2068] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:35.877811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b74fe2-831a-4e1d-8d9b-241c23ab09b8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.878568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ae54e6c2-11aa-4a0e-9e3f-c3d2732bb56c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:35.879825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ae54e6c2-11aa-4a0e-9e3f-c3d2732bb56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:35.888143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1041/2069] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:35.888751 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54e6c2-11aa-4a0e-9e3f-c3d2732bb56c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.898286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b74fe2-831a-4e1d-8d9b-241c23ab09b8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.899938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54e6c2-11aa-4a0e-9e3f-c3d2732bb56c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.904979 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486ad6f-5a22-45fa-83b3-f5251d669e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.905171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5161f19-c067-4607-802c-8fceddfa0361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.905673 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161f19-c067-4607-802c-8fceddfa0361 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.906147 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161f19-c067-4607-802c-8fceddfa0361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.906436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161f19-c067-4607-802c-8fceddfa0361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.906763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486ad6f-5a22-45fa-83b3-f5251d669e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.907608 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486ad6f-5a22-45fa-83b3-f5251d669e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.907868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5161f19-c067-4607-802c-8fceddfa0361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.908111 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486ad6f-5a22-45fa-83b3-f5251d669e7c admin admin] PATH_INFO: `/v3/projects/fe3ea9192cb74c9580717e8f85793bd4/users/209bb6d71b7e4fbbbf8b1169dd24af0e/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.909700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5161f19-c067-4607-802c-8fceddfa0361 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.928605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1029/2070] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:35.928605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5161f19-c067-4607-802c-8fceddfa0361 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.929411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486ad6f-5a22-45fa-83b3-f5251d669e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3ea9192cb74c9580717e8f85793bd4, user_id=209bb6d71b7e4fbbbf8b1169dd24af0e, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.932822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486ad6f-5a22-45fa-83b3-f5251d669e7c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.939876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5161f19-c067-4607-802c-8fceddfa0361 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:35.945630 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ae214-25e5-43f8-8ba1-bf4f168b0c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:35.946964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae214-25e5-43f8-8ba1-bf4f168b0c5e admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.947254 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae214-25e5-43f8-8ba1-bf4f168b0c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.947539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae214-25e5-43f8-8ba1-bf4f168b0c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:35.949632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ae214-25e5-43f8-8ba1-bf4f168b0c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:35.949945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ae214-25e5-43f8-8ba1-bf4f168b0c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:35.951306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1042/2071] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:35 2022] PUT /identity/v3/projects/fe3ea9192cb74c9580717e8f85793bd4/users/209bb6d71b7e4fbbbf8b1169dd24af0e/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:35.952145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486ad6f-5a22-45fa-83b3-f5251d669e7c admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:35.959878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ae214-25e5-43f8-8ba1-bf4f168b0c5e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:35.980613 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1030/2072] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:35.981987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ce075-7719-482d-9706-62b63312b24b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:35.982275 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ce075-7719-482d-9706-62b63312b24b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:35.982547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ce075-7719-482d-9706-62b63312b24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.030525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ae2ce075-7719-482d-9706-62b63312b24b None None] MFA Rules not processed for user `209bb6d71b7e4fbbbf8b1169dd24af0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:36.031789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ae2ce075-7719-482d-9706-62b63312b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:36.063841 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486ad6f-5a22-45fa-83b3-f5251d669e7c admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.068808 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60885d8c-67f1-4e65-89fc-7303775cf3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.069697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60885d8c-67f1-4e65-89fc-7303775cf3e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.069981 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60885d8c-67f1-4e65-89fc-7303775cf3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.070256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60885d8c-67f1-4e65-89fc-7303775cf3e1 admin admin] PATH_INFO: `/v3/projects/9cd62c69af5c400c845aad5a56db0384/users/5c067086d16e4f149f42fca3c986d756/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.086801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60885d8c-67f1-4e65-89fc-7303775cf3e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd62c69af5c400c845aad5a56db0384, user_id=5c067086d16e4f149f42fca3c986d756, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.089630 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60885d8c-67f1-4e65-89fc-7303775cf3e1 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:36.107241 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1043/2073] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:35 2022] PUT /identity/v3/projects/9cd62c69af5c400c845aad5a56db0384/users/5c067086d16e4f149f42fca3c986d756/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:36.108037 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60885d8c-67f1-4e65-89fc-7303775cf3e1 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.125942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1031/2074] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:36.127195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ce075-7719-482d-9706-62b63312b24b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.144303 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ce075-7719-482d-9706-62b63312b24b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.168217 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:36.220774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44124694-e132-451e-8ba5-a4c403afacd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.221442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44124694-e132-451e-8ba5-a4c403afacd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.221729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44124694-e132-451e-8ba5-a4c403afacd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.222008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44124694-e132-451e-8ba5-a4c403afacd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.222780 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44124694-e132-451e-8ba5-a4c403afacd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.224565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44124694-e132-451e-8ba5-a4c403afacd5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:36.233616 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60885d8c-67f1-4e65-89fc-7303775cf3e1 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.234947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1032/2075] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:36.236743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44124694-e132-451e-8ba5-a4c403afacd5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.238590 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-44124694-e132-451e-8ba5-a4c403afacd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:36.240104 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8bafc-d36c-4583-9b72-48571864a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.240851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8bafc-d36c-4583-9b72-48571864a593 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.241197 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8bafc-d36c-4583-9b72-48571864a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.241527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8bafc-d36c-4583-9b72-48571864a593 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.242221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8bafc-d36c-4583-9b72-48571864a593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.244210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8bafc-d36c-4583-9b72-48571864a593 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:36.273328 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1044/2076] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:36 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:36.273328 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8bafc-d36c-4583-9b72-48571864a593 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.280857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:36.296611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44124694-e132-451e-8ba5-a4c403afacd5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.334879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8bafc-d36c-4583-9b72-48571864a593 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.339503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310984e2-11e1-4afd-bfb2-5984a3981223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.340380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310984e2-11e1-4afd-bfb2-5984a3981223 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.340661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310984e2-11e1-4afd-bfb2-5984a3981223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.340939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310984e2-11e1-4afd-bfb2-5984a3981223 admin admin] PATH_INFO: `/v3/projects/9cd62c69af5c400c845aad5a56db0384/users/5c067086d16e4f149f42fca3c986d756/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.342993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310984e2-11e1-4afd-bfb2-5984a3981223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd62c69af5c400c845aad5a56db0384, user_id=5c067086d16e4f149f42fca3c986d756, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.346303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310984e2-11e1-4afd-bfb2-5984a3981223 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:36.349848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f87b26-c7d2-4df3-a0c9-a659ad2d1454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.350690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f87b26-c7d2-4df3-a0c9-a659ad2d1454 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.350974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f87b26-c7d2-4df3-a0c9-a659ad2d1454 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.351248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f87b26-c7d2-4df3-a0c9-a659ad2d1454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.356815 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1045/2077] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:36 2022] PUT /identity/v3/projects/9cd62c69af5c400c845aad5a56db0384/users/5c067086d16e4f149f42fca3c986d756/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:36.357667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310984e2-11e1-4afd-bfb2-5984a3981223 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.420209 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f87b26-c7d2-4df3-a0c9-a659ad2d1454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.421717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f87b26-c7d2-4df3-a0c9-a659ad2d1454 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:36.425020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310984e2-11e1-4afd-bfb2-5984a3981223 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.429849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02efb3-2614-456d-8c74-6da6c7064566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.430509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02efb3-2614-456d-8c74-6da6c7064566 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.430827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02efb3-2614-456d-8c74-6da6c7064566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.431239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02efb3-2614-456d-8c74-6da6c7064566 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.431746 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1033/2078] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:36.431939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02efb3-2614-456d-8c74-6da6c7064566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.432947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2928f-4e88-46c6-a526-e8a631c9c6b2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.433291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2928f-4e88-46c6-a526-e8a631c9c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.433570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2928f-4e88-46c6-a526-e8a631c9c6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.433872 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02efb3-2614-456d-8c74-6da6c7064566 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:36.459834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1046/2079] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:36 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:36.463680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02efb3-2614-456d-8c74-6da6c7064566 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.467362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-34b2928f-4e88-46c6-a526-e8a631c9c6b2 None None] MFA Rules not processed for user `5c067086d16e4f149f42fca3c986d756`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:36.468561 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-34b2928f-4e88-46c6-a526-e8a631c9c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:36.474395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02efb3-2614-456d-8c74-6da6c7064566 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.479374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.480267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.480548 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.480820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] PATH_INFO: `/v3/users/209bb6d71b7e4fbbbf8b1169dd24af0e` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.482045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209bb6d71b7e4fbbbf8b1169dd24af0e)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.484011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:36.488994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:36.535275 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209bb6d71b7e4fbbbf8b1169dd24af0e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:36.542965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209bb6d71b7e4fbbbf8b1169dd24af0e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:36.544001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209bb6d71b7e4fbbbf8b1169dd24af0e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:36.544625 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209bb6d71b7e4fbbbf8b1169dd24af0e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:36.546393 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1034/2080] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:36.548331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2928f-4e88-46c6-a526-e8a631c9c6b2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.561110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2928f-4e88-46c6-a526-e8a631c9c6b2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.565383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209bb6d71b7e4fbbbf8b1169dd24af0e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:36.566187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfdd4f-581d-44fa-92e8-0d39ad10ea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.566985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfdd4f-581d-44fa-92e8-0d39ad10ea72 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.567170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfdd4f-581d-44fa-92e8-0d39ad10ea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.567452 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfdd4f-581d-44fa-92e8-0d39ad10ea72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.568183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfdd4f-581d-44fa-92e8-0d39ad10ea72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.569820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfdd4f-581d-44fa-92e8-0d39ad10ea72 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:36.586801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1035/2081] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:36.586986 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1047/2082] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:36 2022] DELETE /identity/v3/users/209bb6d71b7e4fbbbf8b1169dd24af0e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:36.587096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfdd4f-581d-44fa-92e8-0d39ad10ea72 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.587174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.587679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:36.588664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-50cfdd4f-581d-44fa-92e8-0d39ad10ea72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:36.597314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:36.659750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfdd4f-581d-44fa-92e8-0d39ad10ea72 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.662134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fafe3-7bd6-4753-b941-77be95d60491 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.669627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b1a59-91f2-438e-9ff0-8b9494694beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.670353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b1a59-91f2-438e-9ff0-8b9494694beb admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.670657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b1a59-91f2-438e-9ff0-8b9494694beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.670941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b1a59-91f2-438e-9ff0-8b9494694beb admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.671664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b1a59-91f2-438e-9ff0-8b9494694beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.673355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b1a59-91f2-438e-9ff0-8b9494694beb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:36.684577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1048/2083] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:36.685888 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa888d-5f51-4c31-8e18-c3011069fd99 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.686178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa888d-5f51-4c31-8e18-c3011069fd99 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.686460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa888d-5f51-4c31-8e18-c3011069fd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.705339 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-95aa888d-5f51-4c31-8e18-c3011069fd99 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:36.706801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-95aa888d-5f51-4c31-8e18-c3011069fd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:36.714673 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0ec1c-da66-43bd-aa25-0c4840d58933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.715276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ec1c-da66-43bd-aa25-0c4840d58933 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.715558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ec1c-da66-43bd-aa25-0c4840d58933 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.715861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ec1c-da66-43bd-aa25-0c4840d58933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.716334 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1049/2084] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:36.717130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa888d-5f51-4c31-8e18-c3011069fd99 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.721420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7dc0ec1c-da66-43bd-aa25-0c4840d58933 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:36.727248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa888d-5f51-4c31-8e18-c3011069fd99 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.731977 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83122f-cc89-4941-8a7c-34c53aeb97ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.732839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83122f-cc89-4941-8a7c-34c53aeb97ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.733126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83122f-cc89-4941-8a7c-34c53aeb97ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.733406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83122f-cc89-4941-8a7c-34c53aeb97ec admin admin] PATH_INFO: `/v3/projects/4e4697429804472bb21a1d7d01e57c48/users/6066d51f447f4e5f87fa0638b03b0ad4/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.751613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83122f-cc89-4941-8a7c-34c53aeb97ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4697429804472bb21a1d7d01e57c48, user_id=6066d51f447f4e5f87fa0638b03b0ad4, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.754454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83122f-cc89-4941-8a7c-34c53aeb97ec admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:36.770883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1050/2085] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:36 2022] PUT /identity/v3/projects/4e4697429804472bb21a1d7d01e57c48/users/6066d51f447f4e5f87fa0638b03b0ad4/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:36.772075 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83122f-cc89-4941-8a7c-34c53aeb97ec admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.773909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-5d83122f-cc89-4941-8a7c-34c53aeb97ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:36.816999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0ec1c-da66-43bd-aa25-0c4840d58933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.818490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0ec1c-da66-43bd-aa25-0c4840d58933 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:36.828435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1036/2086] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:36 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:36.829864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b3474-88b8-4b3f-87e7-8bfac8ed43a9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.830155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b3474-88b8-4b3f-87e7-8bfac8ed43a9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.830433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b3474-88b8-4b3f-87e7-8bfac8ed43a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.834231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83122f-cc89-4941-8a7c-34c53aeb97ec admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.837828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf0d0a-0462-4249-a96e-977c9a47bf5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.838469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf0d0a-0462-4249-a96e-977c9a47bf5b service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.838795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf0d0a-0462-4249-a96e-977c9a47bf5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.839070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf0d0a-0462-4249-a96e-977c9a47bf5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.851520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:36.868779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a68b3474-88b8-4b3f-87e7-8bfac8ed43a9 None None] MFA Rules not processed for user `6066d51f447f4e5f87fa0638b03b0ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:36.869984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a68b3474-88b8-4b3f-87e7-8bfac8ed43a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:36.915378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf0d0a-0462-4249-a96e-977c9a47bf5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.916875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf0d0a-0462-4249-a96e-977c9a47bf5b service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:36.927103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1051/2087] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:36.927959 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf0d0a-0462-4249-a96e-977c9a47bf5b service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.941984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1037/2088] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:36.946355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b3474-88b8-4b3f-87e7-8bfac8ed43a9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:36.949778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:36.958934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b3474-88b8-4b3f-87e7-8bfac8ed43a9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:36.967346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be5adf-faae-4707-920c-b29259c477f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:36.968428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be5adf-faae-4707-920c-b29259c477f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:36.968687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be5adf-faae-4707-920c-b29259c477f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:36.969042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be5adf-faae-4707-920c-b29259c477f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:36.970442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be5adf-faae-4707-920c-b29259c477f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:36.973230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be5adf-faae-4707-920c-b29259c477f3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:37.004721 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf0d0a-0462-4249-a96e-977c9a47bf5b service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:37.006098 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1038/2089] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:36 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:37.010269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be5adf-faae-4707-920c-b29259c477f3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:37.083895 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be5adf-faae-4707-920c-b29259c477f3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:37.094112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139a362-2e2b-4288-85f7-567caed4421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:37.094752 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139a362-2e2b-4288-85f7-567caed4421a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.095046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139a362-2e2b-4288-85f7-567caed4421a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.095326 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139a362-2e2b-4288-85f7-567caed4421a admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.095817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b84ed-e434-4512-b0c7-97d8a07387b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:37.096043 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139a362-2e2b-4288-85f7-567caed4421a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:37.096812 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b84ed-e434-4512-b0c7-97d8a07387b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.097173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b84ed-e434-4512-b0c7-97d8a07387b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.098071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b84ed-e434-4512-b0c7-97d8a07387b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.098203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139a362-2e2b-4288-85f7-567caed4421a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:37.100534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f51b84ed-e434-4512-b0c7-97d8a07387b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:37.132169 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1039/2090] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:37 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:37.133504 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139a362-2e2b-4288-85f7-567caed4421a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:37.144556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139a362-2e2b-4288-85f7-567caed4421a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:37.150471 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cf31e-6b44-424e-b44a-61b8b8249b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:37.150712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf31e-6b44-424e-b44a-61b8b8249b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.151005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf31e-6b44-424e-b44a-61b8b8249b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.151282 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf31e-6b44-424e-b44a-61b8b8249b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.152020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cf31e-6b44-424e-b44a-61b8b8249b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:37.153806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cf31e-6b44-424e-b44a-61b8b8249b9c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:37.169975 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1040/2091] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:37.170898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cf31e-6b44-424e-b44a-61b8b8249b9c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:37.187205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cf31e-6b44-424e-b44a-61b8b8249b9c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:37.193248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70545f1-764e-4fe0-8f60-1601217022fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:37.194136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70545f1-764e-4fe0-8f60-1601217022fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.194417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70545f1-764e-4fe0-8f60-1601217022fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.194719 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70545f1-764e-4fe0-8f60-1601217022fa admin admin] PATH_INFO: `/v3/projects/d051ef4ffe0a4db8859a02647d23b6c6/users/56e4eddce6c44197b100113487aa1530/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.209125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b84ed-e434-4512-b0c7-97d8a07387b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:37.210175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b84ed-e434-4512-b0c7-97d8a07387b8 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:37.211713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70545f1-764e-4fe0-8f60-1601217022fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d051ef4ffe0a4db8859a02647d23b6c6, user_id=56e4eddce6c44197b100113487aa1530, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:37.214279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70545f1-764e-4fe0-8f60-1601217022fa admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:37.236829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1052/2092] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:37.238008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1041/2093] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:37 2022] PUT /identity/v3/projects/d051ef4ffe0a4db8859a02647d23b6c6/users/56e4eddce6c44197b100113487aa1530/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:37.241633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b84ed-e434-4512-b0c7-97d8a07387b8 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:37.255225 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b84ed-e434-4512-b0c7-97d8a07387b8 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:37.300652 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70545f1-764e-4fe0-8f60-1601217022fa admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:37.302659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f70545f1-764e-4fe0-8f60-1601217022fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:37.390296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:37.405000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71908565-1d83-46ec-9703-28a437bc569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:37.406235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71908565-1d83-46ec-9703-28a437bc569b admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.406773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71908565-1d83-46ec-9703-28a437bc569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.415929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71908565-1d83-46ec-9703-28a437bc569b admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.417760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71908565-1d83-46ec-9703-28a437bc569b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:37.419980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71908565-1d83-46ec-9703-28a437bc569b admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:37.441121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70545f1-764e-4fe0-8f60-1601217022fa admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:37.444557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1053/2094] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:37.447451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e07d-1940-431a-a1de-0bb5149cfa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:37.449081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e07d-1940-431a-a1de-0bb5149cfa10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.449081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e07d-1940-431a-a1de-0bb5149cfa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.449438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e07d-1940-431a-a1de-0bb5149cfa10 admin admin] PATH_INFO: `/v3/projects/fe3ea9192cb74c9580717e8f85793bd4` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.450882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5e07d-1940-431a-a1de-0bb5149cfa10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3ea9192cb74c9580717e8f85793bd4)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:37.452148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71908565-1d83-46ec-9703-28a437bc569b admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:37.452873 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5e07d-1940-431a-a1de-0bb5149cfa10 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:37.466008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71908565-1d83-46ec-9703-28a437bc569b admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:37.475435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2a9cc-d09f-4a41-878b-0ebe42f0fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:37.477359 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2a9cc-d09f-4a41-878b-0ebe42f0fdbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.477964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2a9cc-d09f-4a41-878b-0ebe42f0fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.479013 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2a9cc-d09f-4a41-878b-0ebe42f0fdbb admin admin] PATH_INFO: `/v3/projects/d051ef4ffe0a4db8859a02647d23b6c6/users/56e4eddce6c44197b100113487aa1530/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.482325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2a9cc-d09f-4a41-878b-0ebe42f0fdbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d051ef4ffe0a4db8859a02647d23b6c6, user_id=56e4eddce6c44197b100113487aa1530, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:37.486274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2a9cc-d09f-4a41-878b-0ebe42f0fdbb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:37.508217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1054/2095] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:37 2022] PUT /identity/v3/projects/d051ef4ffe0a4db8859a02647d23b6c6/users/56e4eddce6c44197b100113487aa1530/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:37.518132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-13c5e07d-1940-431a-a1de-0bb5149cfa10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3ea9192cb74c9580717e8f85793bd4', 'request_id': 'req-13c5e07d-1940-431a-a1de-0bb5149cfa10'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:37.519775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520b3dd-6084-40dc-982b-cc227be3614b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.521145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520b3dd-6084-40dc-982b-cc227be3614b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.521504 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520b3dd-6084-40dc-982b-cc227be3614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.525291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-13c5e07d-1940-431a-a1de-0bb5149cfa10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3ea9192cb74c9580717e8f85793bd4', 'request_id': 'req-13c5e07d-1940-431a-a1de-0bb5149cfa10'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:37.531849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-13c5e07d-1940-431a-a1de-0bb5149cfa10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3ea9192cb74c9580717e8f85793bd4', 'request_id': 'req-13c5e07d-1940-431a-a1de-0bb5149cfa10'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:37.548597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-13c5e07d-1940-431a-a1de-0bb5149cfa10 admin admin] The token cache is being invalidate because project fe3ea9192cb74c9580717e8f85793bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:37.549221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-13c5e07d-1940-431a-a1de-0bb5149cfa10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:37.550001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-13c5e07d-1940-431a-a1de-0bb5149cfa10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:37.554662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1042/2096] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:37 2022] DELETE /identity/v3/projects/fe3ea9192cb74c9580717e8f85793bd4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:37.554821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:37.557165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34ceea-b314-49d7-8001-cc5153024d10 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.557303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-9520b3dd-6084-40dc-982b-cc227be3614b None None] MFA Rules not processed for user `56e4eddce6c44197b100113487aa1530`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:37.557563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34ceea-b314-49d7-8001-cc5153024d10 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.558229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34ceea-b314-49d7-8001-cc5153024d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.558546 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9520b3dd-6084-40dc-982b-cc227be3614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:37.581236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ea34ceea-b314-49d7-8001-cc5153024d10 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:37.582644 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ea34ceea-b314-49d7-8001-cc5153024d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:37.674711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1043/2097] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:37.681666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4c01e-288b-47fb-9d45-d99191ea8d54 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.682389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4c01e-288b-47fb-9d45-d99191ea8d54 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.683038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4c01e-288b-47fb-9d45-d99191ea8d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.688820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1055/2098] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:37.706857 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-cdf4c01e-288b-47fb-9d45-d99191ea8d54 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:37.708062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cdf4c01e-288b-47fb-9d45-d99191ea8d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:37.716695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1044/2099] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:37.721035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520b3dd-6084-40dc-982b-cc227be3614b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:37.721527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4c01e-288b-47fb-9d45-d99191ea8d54 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:37.722962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9520b3dd-6084-40dc-982b-cc227be3614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:37.730277 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4c01e-288b-47fb-9d45-d99191ea8d54 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:37.736164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261ba88-0aa7-4e6b-a222-95a91cfe1ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:37.736813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261ba88-0aa7-4e6b-a222-95a91cfe1ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.737699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261ba88-0aa7-4e6b-a222-95a91cfe1ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.737699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261ba88-0aa7-4e6b-a222-95a91cfe1ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.738148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261ba88-0aa7-4e6b-a222-95a91cfe1ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:37.738445 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261ba88-0aa7-4e6b-a222-95a91cfe1ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:37.740456 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261ba88-0aa7-4e6b-a222-95a91cfe1ed8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:37.756009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1045/2100] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:16:37.759989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261ba88-0aa7-4e6b-a222-95a91cfe1ed8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:37.772618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261ba88-0aa7-4e6b-a222-95a91cfe1ed8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:37.779359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0903af-f5fe-46ea-8381-fa11e78ac78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:37.780111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0903af-f5fe-46ea-8381-fa11e78ac78e admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.780398 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0903af-f5fe-46ea-8381-fa11e78ac78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.780679 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0903af-f5fe-46ea-8381-fa11e78ac78e admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.781380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0903af-f5fe-46ea-8381-fa11e78ac78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:37.783566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0903af-f5fe-46ea-8381-fa11e78ac78e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:37.795410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520b3dd-6084-40dc-982b-cc227be3614b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:37.800569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03451861-7a96-4dde-b2cc-25d489136d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:37.801395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03451861-7a96-4dde-b2cc-25d489136d5c service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.801506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03451861-7a96-4dde-b2cc-25d489136d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.801775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03451861-7a96-4dde-b2cc-25d489136d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.815924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03451861-7a96-4dde-b2cc-25d489136d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:37.817620 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03451861-7a96-4dde-b2cc-25d489136d5c service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:37.823102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1046/2101] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:37 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:37.826059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0903af-f5fe-46ea-8381-fa11e78ac78e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:37.834116 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1056/2102] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:37.851949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:37.910312 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0903af-f5fe-46ea-8381-fa11e78ac78e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:37.918185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144991c6-40ad-4545-9a39-f6aead359508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:37.919770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144991c6-40ad-4545-9a39-f6aead359508 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:37.919924 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144991c6-40ad-4545-9a39-f6aead359508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:37.920208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144991c6-40ad-4545-9a39-f6aead359508 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:37.920928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144991c6-40ad-4545-9a39-f6aead359508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:37.924273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144991c6-40ad-4545-9a39-f6aead359508 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:37.961109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1047/2103] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:37 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:37.966842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144991c6-40ad-4545-9a39-f6aead359508 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:37.967227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03451861-7a96-4dde-b2cc-25d489136d5c service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:37.968822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-144991c6-40ad-4545-9a39-f6aead359508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:37.984369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03451861-7a96-4dde-b2cc-25d489136d5c service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:37.989747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144991c6-40ad-4545-9a39-f6aead359508 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:38.000074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb2477-5634-4ac2-9ee0-096e09b16751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:38.002219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb2477-5634-4ac2-9ee0-096e09b16751 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:38.003625 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb2477-5634-4ac2-9ee0-096e09b16751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:38.004060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb2477-5634-4ac2-9ee0-096e09b16751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:38.005524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865317f7-fb43-43a1-a2bc-2af2764d6b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:38.006102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb2477-5634-4ac2-9ee0-096e09b16751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:38.008402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb2477-5634-4ac2-9ee0-096e09b16751 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:38.009908 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865317f7-fb43-43a1-a2bc-2af2764d6b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:38.010363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865317f7-fb43-43a1-a2bc-2af2764d6b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:38.010678 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865317f7-fb43-43a1-a2bc-2af2764d6b18 admin admin] PATH_INFO: `/v3/users/6066d51f447f4e5f87fa0638b03b0ad4` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:38.012500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865317f7-fb43-43a1-a2bc-2af2764d6b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6066d51f447f4e5f87fa0638b03b0ad4)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:38.020507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865317f7-fb43-43a1-a2bc-2af2764d6b18 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:38.057800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1057/2104] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:38.060238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb2477-5634-4ac2-9ee0-096e09b16751 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:38.080792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb2477-5634-4ac2-9ee0-096e09b16751 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:38.091876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7511f0-fa53-4213-bda1-6398fa1c966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:38.092947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7511f0-fa53-4213-bda1-6398fa1c966f admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:38.093405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7511f0-fa53-4213-bda1-6398fa1c966f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:38.093988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7511f0-fa53-4213-bda1-6398fa1c966f admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:38.095718 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7511f0-fa53-4213-bda1-6398fa1c966f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:38.097594 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7511f0-fa53-4213-bda1-6398fa1c966f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:38.107670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-865317f7-fb43-43a1-a2bc-2af2764d6b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6066d51f447f4e5f87fa0638b03b0ad4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:38.115097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1058/2105] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:38.116726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7511f0-fa53-4213-bda1-6398fa1c966f admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:38.122114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-865317f7-fb43-43a1-a2bc-2af2764d6b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6066d51f447f4e5f87fa0638b03b0ad4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:38.131952 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7511f0-fa53-4213-bda1-6398fa1c966f admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:38.140581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-865317f7-fb43-43a1-a2bc-2af2764d6b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6066d51f447f4e5f87fa0638b03b0ad4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:38.140812 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a2e1f-d5e8-4d9d-937a-ad0fd5d815de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:38.141329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-865317f7-fb43-43a1-a2bc-2af2764d6b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6066d51f447f4e5f87fa0638b03b0ad4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:38.142989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-865317f7-fb43-43a1-a2bc-2af2764d6b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6066d51f447f4e5f87fa0638b03b0ad4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:38.143823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a2e1f-d5e8-4d9d-937a-ad0fd5d815de admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:38.144087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a2e1f-d5e8-4d9d-937a-ad0fd5d815de admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:38.144366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a2e1f-d5e8-4d9d-937a-ad0fd5d815de admin admin] PATH_INFO: `/v3/projects/b791fbed0800400290c38ac5f481ec60/users/4bd2d93a30444c8fa6de094160f0ad97/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:38.169925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1048/2106] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:37 2022] DELETE /identity/v3/users/6066d51f447f4e5f87fa0638b03b0ad4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:38.174528 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f26f9-89e2-4d8b-af68-432471bbe846 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:38.175390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f26f9-89e2-4d8b-af68-432471bbe846 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:38.176018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f26f9-89e2-4d8b-af68-432471bbe846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:38.182202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a2e1f-d5e8-4d9d-937a-ad0fd5d815de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b791fbed0800400290c38ac5f481ec60, user_id=4bd2d93a30444c8fa6de094160f0ad97, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:38.185191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a2e1f-d5e8-4d9d-937a-ad0fd5d815de admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:38.206236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-593f26f9-89e2-4d8b-af68-432471bbe846 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:38.207638 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-593f26f9-89e2-4d8b-af68-432471bbe846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:38.219077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1059/2107] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:38 2022] PUT /identity/v3/projects/b791fbed0800400290c38ac5f481ec60/users/4bd2d93a30444c8fa6de094160f0ad97/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:38.231270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608774a1-b39d-49f2-b79f-354f145f8c75 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:38.231627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608774a1-b39d-49f2-b79f-354f145f8c75 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:38.231920 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608774a1-b39d-49f2-b79f-354f145f8c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:38.314838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-608774a1-b39d-49f2-b79f-354f145f8c75 None None] MFA Rules not processed for user `4bd2d93a30444c8fa6de094160f0ad97`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:38.316069 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-608774a1-b39d-49f2-b79f-354f145f8c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:38.326329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1049/2108] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:38.346966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f26f9-89e2-4d8b-af68-432471bbe846 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:38.349106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-593f26f9-89e2-4d8b-af68-432471bbe846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:38.388555 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:38.398228 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:38.432443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1060/2109] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:38.443414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608774a1-b39d-49f2-b79f-354f145f8c75 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:38.444812 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-608774a1-b39d-49f2-b79f-354f145f8c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:38.446133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f26f9-89e2-4d8b-af68-432471bbe846 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:38.450775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c2c82-3a47-497e-8715-321113f404e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:38.451558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c2c82-3a47-497e-8715-321113f404e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:38.451940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c2c82-3a47-497e-8715-321113f404e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:38.452336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c2c82-3a47-497e-8715-321113f404e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:38.467111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c2c82-3a47-497e-8715-321113f404e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:38.468748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c2c82-3a47-497e-8715-321113f404e6 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:38.495617 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1050/2110] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:38.528544 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608774a1-b39d-49f2-b79f-354f145f8c75 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:38.533209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79cfcf-484b-4ead-a69c-785861a6d1de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:38.533755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79cfcf-484b-4ead-a69c-785861a6d1de service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:38.534046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79cfcf-484b-4ead-a69c-785861a6d1de service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:38.534304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79cfcf-484b-4ead-a69c-785861a6d1de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:38.544817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79cfcf-484b-4ead-a69c-785861a6d1de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:38.546231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79cfcf-484b-4ead-a69c-785861a6d1de service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:38.559350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1061/2111] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:38.894566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c2c82-3a47-497e-8715-321113f404e6 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:38.896936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3a8c2c82-3a47-497e-8715-321113f404e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:38.917053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c2c82-3a47-497e-8715-321113f404e6 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:38.926083 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:38.927666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:38.928007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:38.928940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] PATH_INFO: `/v3/projects/4e4697429804472bb21a1d7d01e57c48` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:38.930815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4697429804472bb21a1d7d01e57c48)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:38.933109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:38.987999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4697429804472bb21a1d7d01e57c48', 'request_id': 'req-1fe65b68-4c30-4078-b03e-549df5ce05b4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:38.995951 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4697429804472bb21a1d7d01e57c48', 'request_id': 'req-1fe65b68-4c30-4078-b03e-549df5ce05b4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.003692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4697429804472bb21a1d7d01e57c48', 'request_id': 'req-1fe65b68-4c30-4078-b03e-549df5ce05b4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.016147 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] The token cache is being invalidate because project 4e4697429804472bb21a1d7d01e57c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:39.017446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.017739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.019347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1051/2112] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:38 2022] DELETE /identity/v3/projects/4e4697429804472bb21a1d7d01e57c48 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:39.023498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79cfcf-484b-4ead-a69c-785861a6d1de service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:39.034645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79cfcf-484b-4ead-a69c-785861a6d1de service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:39.099221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c558494-d85a-49b5-a552-1289142f89d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:39.100604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c558494-d85a-49b5-a552-1289142f89d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:39.100973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c558494-d85a-49b5-a552-1289142f89d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:39.101250 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c558494-d85a-49b5-a552-1289142f89d3 admin admin] PATH_INFO: `/v3/users/56e4eddce6c44197b100113487aa1530` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:39.102653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c558494-d85a-49b5-a552-1289142f89d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e4eddce6c44197b100113487aa1530)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:39.104980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c558494-d85a-49b5-a552-1289142f89d3 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:39.153085 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8c558494-d85a-49b5-a552-1289142f89d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e4eddce6c44197b100113487aa1530'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.160296 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8c558494-d85a-49b5-a552-1289142f89d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e4eddce6c44197b100113487aa1530'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.160965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8c558494-d85a-49b5-a552-1289142f89d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e4eddce6c44197b100113487aa1530'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.161593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8c558494-d85a-49b5-a552-1289142f89d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e4eddce6c44197b100113487aa1530'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.175298 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8c558494-d85a-49b5-a552-1289142f89d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e4eddce6c44197b100113487aa1530'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.189755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1062/2113] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:39 2022] DELETE /identity/v3/users/56e4eddce6c44197b100113487aa1530 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:39.459324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:39.460852 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:39.476288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe65b68-4c30-4078-b03e-549df5ce05b4 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:39.537202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:39.538143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:39.538423 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:39.538727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a admin admin] PATH_INFO: `/v3/projects/d051ef4ffe0a4db8859a02647d23b6c6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:39.539932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d051ef4ffe0a4db8859a02647d23b6c6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:39.541870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:39.605086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd051ef4ffe0a4db8859a02647d23b6c6', 'request_id': 'req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.607537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:39.612324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd051ef4ffe0a4db8859a02647d23b6c6', 'request_id': 'req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.621905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd051ef4ffe0a4db8859a02647d23b6c6', 'request_id': 'req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.643140 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a admin admin] The token cache is being invalidate because project d051ef4ffe0a4db8859a02647d23b6c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:39.643763 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.644479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d19bf9c7-8cd5-4ed1-9e59-460d41bfb93a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:39.646166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1052/2114] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:39 2022] DELETE /identity/v3/projects/d051ef4ffe0a4db8859a02647d23b6c6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:39.650995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4c109-3f50-4a0b-9da9-124714fd3711 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:39.651391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4c109-3f50-4a0b-9da9-124714fd3711 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:39.651739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4c109-3f50-4a0b-9da9-124714fd3711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:39.664949 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:39.671497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-53f4c109-3f50-4a0b-9da9-124714fd3711 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:39.672756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-53f4c109-3f50-4a0b-9da9-124714fd3711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:39.744875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1063/2115] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:39.754392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690876bc-cd6c-43fe-ae5d-5f5bd397a3a5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:39.754721 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690876bc-cd6c-43fe-ae5d-5f5bd397a3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:39.754997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690876bc-cd6c-43fe-ae5d-5f5bd397a3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:39.774649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-690876bc-cd6c-43fe-ae5d-5f5bd397a3a5 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:39.775899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-690876bc-cd6c-43fe-ae5d-5f5bd397a3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:39.787017 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1053/2116] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:39.788345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4c109-3f50-4a0b-9da9-124714fd3711 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:39.798637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4c109-3f50-4a0b-9da9-124714fd3711 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:39.803213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538a84-baa9-47a0-8f66-4247c2c2d78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:39.803861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538a84-baa9-47a0-8f66-4247c2c2d78a admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:39.804143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538a84-baa9-47a0-8f66-4247c2c2d78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:39.804418 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538a84-baa9-47a0-8f66-4247c2c2d78a admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:39.805145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77538a84-baa9-47a0-8f66-4247c2c2d78a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:39.805454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77538a84-baa9-47a0-8f66-4247c2c2d78a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:39.807130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77538a84-baa9-47a0-8f66-4247c2c2d78a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:39.819611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1064/2117] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:39.823980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690876bc-cd6c-43fe-ae5d-5f5bd397a3a5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:39.833898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690876bc-cd6c-43fe-ae5d-5f5bd397a3a5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:39.838557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee1860-2a5f-4215-83d2-d1be2a3681e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:39.839249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee1860-2a5f-4215-83d2-d1be2a3681e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:39.839530 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee1860-2a5f-4215-83d2-d1be2a3681e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:39.839808 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee1860-2a5f-4215-83d2-d1be2a3681e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:39.840494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee1860-2a5f-4215-83d2-d1be2a3681e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:39.842401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee1860-2a5f-4215-83d2-d1be2a3681e2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:39.874611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1054/2118] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:39 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:39.876159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538a84-baa9-47a0-8f66-4247c2c2d78a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:39.887045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538a84-baa9-47a0-8f66-4247c2c2d78a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:39.955148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0b31e-e4c2-4249-920a-8a7f6e1fd2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:39.955840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0b31e-e4c2-4249-920a-8a7f6e1fd2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:39.956124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0b31e-e4c2-4249-920a-8a7f6e1fd2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:39.956454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0b31e-e4c2-4249-920a-8a7f6e1fd2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:39.957168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0b31e-e4c2-4249-920a-8a7f6e1fd2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:39.959118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0b31e-e4c2-4249-920a-8a7f6e1fd2e2 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:39.966921 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad829-6051-4988-828d-8ba9533b477f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:39.967415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad829-6051-4988-828d-8ba9533b477f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:39.967525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad829-6051-4988-828d-8ba9533b477f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:39.987025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1065/2119] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:39 2022] POST /identity/v3/users => generated 281 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:39.988005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2fbad829-6051-4988-828d-8ba9533b477f None None] MFA Rules not processed for user `4bd2d93a30444c8fa6de094160f0ad97`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:39.988122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0b31e-e4c2-4249-920a-8a7f6e1fd2e2 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:39.989209 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2fbad829-6051-4988-828d-8ba9533b477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:40.002554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0b31e-e4c2-4249-920a-8a7f6e1fd2e2 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:40.008642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa7122-068f-4581-9334-c11592bc01da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:40.009321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa7122-068f-4581-9334-c11592bc01da admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:40.009604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa7122-068f-4581-9334-c11592bc01da admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:40.009880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa7122-068f-4581-9334-c11592bc01da admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:40.010864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa7122-068f-4581-9334-c11592bc01da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:40.012647 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa7122-068f-4581-9334-c11592bc01da admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:40.030169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1066/2120] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:40.031371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa7122-068f-4581-9334-c11592bc01da admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:40.042010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa7122-068f-4581-9334-c11592bc01da admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:40.049157 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befa587-cef5-4027-8581-d5f744fbde0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:40.049870 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befa587-cef5-4027-8581-d5f744fbde0a admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:40.050157 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befa587-cef5-4027-8581-d5f744fbde0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:40.050474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befa587-cef5-4027-8581-d5f744fbde0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:40.051237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befa587-cef5-4027-8581-d5f744fbde0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:40.052821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befa587-cef5-4027-8581-d5f744fbde0a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:40.053584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1055/2121] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:40.066430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1067/2122] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:40.070238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbad829-6051-4988-828d-8ba9533b477f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:40.082638 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbad829-6051-4988-828d-8ba9533b477f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:40.087203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a014195-60c6-404c-bc41-b0f178d45d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:40.088107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a014195-60c6-404c-bc41-b0f178d45d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:40.088388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a014195-60c6-404c-bc41-b0f178d45d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:40.088659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a014195-60c6-404c-bc41-b0f178d45d4a admin admin] PATH_INFO: `/v3/projects/1ed84a0b923143f086103d2a85c076db/users/20617b761b4b44fc96493933a98adc5e/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:40.104126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a014195-60c6-404c-bc41-b0f178d45d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed84a0b923143f086103d2a85c076db, user_id=20617b761b4b44fc96493933a98adc5e, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:40.107235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a014195-60c6-404c-bc41-b0f178d45d4a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:40.125836 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1056/2123] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:40 2022] PUT /identity/v3/projects/1ed84a0b923143f086103d2a85c076db/users/20617b761b4b44fc96493933a98adc5e/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:40.136039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8bd11-85f2-4c5b-b19c-17d3bfe4df33 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:40.136324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8bd11-85f2-4c5b-b19c-17d3bfe4df33 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:40.136596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8bd11-85f2-4c5b-b19c-17d3bfe4df33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:40.176360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-62a8bd11-85f2-4c5b-b19c-17d3bfe4df33 None None] MFA Rules not processed for user `20617b761b4b44fc96493933a98adc5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:40.177585 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-62a8bd11-85f2-4c5b-b19c-17d3bfe4df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:40.237060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:40.262507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1068/2124] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:40.290824 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a014195-60c6-404c-bc41-b0f178d45d4a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:40.292444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4a014195-60c6-404c-bc41-b0f178d45d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:40.362961 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a014195-60c6-404c-bc41-b0f178d45d4a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:40.371185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb0360-f21a-41a3-ab27-6e74c6cd0d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:40.371842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb0360-f21a-41a3-ab27-6e74c6cd0d7c service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:40.372126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb0360-f21a-41a3-ab27-6e74c6cd0d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:40.372396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb0360-f21a-41a3-ab27-6e74c6cd0d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:40.383385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb0360-f21a-41a3-ab27-6e74c6cd0d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:40.384847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb0360-f21a-41a3-ab27-6e74c6cd0d7c service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:40.403457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1057/2125] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:40.418360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8bd11-85f2-4c5b-b19c-17d3bfe4df33 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:40.484472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8bd11-85f2-4c5b-b19c-17d3bfe4df33 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:40.489125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:40.489979 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:40.490254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:40.490521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] PATH_INFO: `/v3/users/20617b761b4b44fc96493933a98adc5e` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:40.491754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=20617b761b4b44fc96493933a98adc5e)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:40.493667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:40.556146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20617b761b4b44fc96493933a98adc5e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:40.571955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20617b761b4b44fc96493933a98adc5e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:40.573171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20617b761b4b44fc96493933a98adc5e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:40.574071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20617b761b4b44fc96493933a98adc5e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:40.592291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20617b761b4b44fc96493933a98adc5e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:40.609539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1069/2126] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:40 2022] DELETE /identity/v3/users/20617b761b4b44fc96493933a98adc5e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:40.615109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fee66-288f-42c2-bc14-379a083badc3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:40.615342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fee66-288f-42c2-bc14-379a083badc3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:40.615622 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fee66-288f-42c2-bc14-379a083badc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:40.643728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-603fee66-288f-42c2-bc14-379a083badc3 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:40.645655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-603fee66-288f-42c2-bc14-379a083badc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:40.680155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:40.715932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1058/2127] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:40.729040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:40.730492 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:40.816925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2151160-fb46-437c-aaf1-5ac6c9cb0c6d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:40.820673 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb27aea-2d64-40a9-933b-e8284d4cff4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:40.821317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb27aea-2d64-40a9-933b-e8284d4cff4d service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:40.822520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb27aea-2d64-40a9-933b-e8284d4cff4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:40.823166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb27aea-2d64-40a9-933b-e8284d4cff4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:40.834333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb27aea-2d64-40a9-933b-e8284d4cff4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:40.835838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb27aea-2d64-40a9-933b-e8284d4cff4d service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:40.847837 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1070/2128] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:41.348499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fee66-288f-42c2-bc14-379a083badc3 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:41.350741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-603fee66-288f-42c2-bc14-379a083badc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:41.370604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fee66-288f-42c2-bc14-379a083badc3 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:41.374964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6888f6-c7b7-4ff6-b488-64964209a431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:41.376696 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6888f6-c7b7-4ff6-b488-64964209a431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:41.377172 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6888f6-c7b7-4ff6-b488-64964209a431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:41.377455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6888f6-c7b7-4ff6-b488-64964209a431 admin admin] PATH_INFO: `/v3/projects/1ed84a0b923143f086103d2a85c076db` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:41.378784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6888f6-c7b7-4ff6-b488-64964209a431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed84a0b923143f086103d2a85c076db)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:41.380759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6888f6-c7b7-4ff6-b488-64964209a431 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:41.435944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5b6888f6-c7b7-4ff6-b488-64964209a431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed84a0b923143f086103d2a85c076db', 'request_id': 'req-5b6888f6-c7b7-4ff6-b488-64964209a431'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:41.445588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5b6888f6-c7b7-4ff6-b488-64964209a431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed84a0b923143f086103d2a85c076db', 'request_id': 'req-5b6888f6-c7b7-4ff6-b488-64964209a431'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:41.456617 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5b6888f6-c7b7-4ff6-b488-64964209a431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed84a0b923143f086103d2a85c076db', 'request_id': 'req-5b6888f6-c7b7-4ff6-b488-64964209a431'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:41.473066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5b6888f6-c7b7-4ff6-b488-64964209a431 admin admin] The token cache is being invalidate because project 1ed84a0b923143f086103d2a85c076db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:41.473803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5b6888f6-c7b7-4ff6-b488-64964209a431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:41.474752 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5b6888f6-c7b7-4ff6-b488-64964209a431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:41.477734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1059/2129] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:41 2022] DELETE /identity/v3/projects/1ed84a0b923143f086103d2a85c076db => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:41.482250 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a71ece-a6fa-49da-b13a-966602eaa420 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:41.482757 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a71ece-a6fa-49da-b13a-966602eaa420 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:41.483179 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a71ece-a6fa-49da-b13a-966602eaa420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:41.504073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-71a71ece-a6fa-49da-b13a-966602eaa420 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:41.505331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-71a71ece-a6fa-49da-b13a-966602eaa420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:41.518586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:41.590668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1071/2130] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:41.598050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6f977-5f17-400d-a1e8-7540ab333b60 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:41.598395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6f977-5f17-400d-a1e8-7540ab333b60 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:41.598728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6f977-5f17-400d-a1e8-7540ab333b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:41.620834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-37a6f977-5f17-400d-a1e8-7540ab333b60 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:41.622115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-37a6f977-5f17-400d-a1e8-7540ab333b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:41.629327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a71ece-a6fa-49da-b13a-966602eaa420 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:41.630758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-71a71ece-a6fa-49da-b13a-966602eaa420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:41.633724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1060/2131] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:41.637935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6f977-5f17-400d-a1e8-7540ab333b60 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:41.644393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a71ece-a6fa-49da-b13a-966602eaa420 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:41.647934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6f977-5f17-400d-a1e8-7540ab333b60 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:41.650322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa4808-1e52-4876-955a-2d9937aa1e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:41.651894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa4808-1e52-4876-955a-2d9937aa1e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:41.652182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa4808-1e52-4876-955a-2d9937aa1e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:41.652458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa4808-1e52-4876-955a-2d9937aa1e4a admin admin] PATH_INFO: `/v3/users/3ee9f9874c8a406ea4531572fb1c8306` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:41.652991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014831be-74f0-4efb-8d16-d6a88abadbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:41.653641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014831be-74f0-4efb-8d16-d6a88abadbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:41.653920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014831be-74f0-4efb-8d16-d6a88abadbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:41.654197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014831be-74f0-4efb-8d16-d6a88abadbe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:41.654433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa4808-1e52-4876-955a-2d9937aa1e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee9f9874c8a406ea4531572fb1c8306)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:41.654966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014831be-74f0-4efb-8d16-d6a88abadbe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:41.655276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014831be-74f0-4efb-8d16-d6a88abadbe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:41.656423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa4808-1e52-4876-955a-2d9937aa1e4a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:41.658982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014831be-74f0-4efb-8d16-d6a88abadbe2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:41.674237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1061/2132] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:41.675441 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014831be-74f0-4efb-8d16-d6a88abadbe2 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:41.687540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014831be-74f0-4efb-8d16-d6a88abadbe2 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:41.697674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809f58c-deac-4fdd-90ae-48666a09f378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:41.698286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809f58c-deac-4fdd-90ae-48666a09f378 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:41.698570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809f58c-deac-4fdd-90ae-48666a09f378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:41.698881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809f58c-deac-4fdd-90ae-48666a09f378 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:41.700211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809f58c-deac-4fdd-90ae-48666a09f378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:41.703263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809f58c-deac-4fdd-90ae-48666a09f378 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:41.749029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-fbaa4808-1e52-4876-955a-2d9937aa1e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee9f9874c8a406ea4531572fb1c8306'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:41.768439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-fbaa4808-1e52-4876-955a-2d9937aa1e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee9f9874c8a406ea4531572fb1c8306'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:41.769639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-fbaa4808-1e52-4876-955a-2d9937aa1e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee9f9874c8a406ea4531572fb1c8306'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:41.770654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-fbaa4808-1e52-4876-955a-2d9937aa1e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee9f9874c8a406ea4531572fb1c8306'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:41.773967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1062/2133] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:41 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:41.777134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809f58c-deac-4fdd-90ae-48666a09f378 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:41.780173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2809f58c-deac-4fdd-90ae-48666a09f378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:41.800181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-fbaa4808-1e52-4876-955a-2d9937aa1e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee9f9874c8a406ea4531572fb1c8306'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:41.834485 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1072/2134] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:41 2022] DELETE /identity/v3/users/3ee9f9874c8a406ea4531572fb1c8306 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:41.838965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883787ac-ec18-478a-b8cf-373646394f5b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:41.839262 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883787ac-ec18-478a-b8cf-373646394f5b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:41.839545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883787ac-ec18-478a-b8cf-373646394f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:41.872711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-883787ac-ec18-478a-b8cf-373646394f5b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:41.874230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-883787ac-ec18-478a-b8cf-373646394f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:41.907628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809f58c-deac-4fdd-90ae-48666a09f378 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:41.934352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:41.947533 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1073/2135] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:41.963509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883787ac-ec18-478a-b8cf-373646394f5b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:41.966091 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-883787ac-ec18-478a-b8cf-373646394f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:42.010667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93baeb18-6017-467d-a34b-efb0a7d9d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:42.011602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baeb18-6017-467d-a34b-efb0a7d9d086 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:42.011956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baeb18-6017-467d-a34b-efb0a7d9d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:42.012320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baeb18-6017-467d-a34b-efb0a7d9d086 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:42.013091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93baeb18-6017-467d-a34b-efb0a7d9d086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:42.016492 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93baeb18-6017-467d-a34b-efb0a7d9d086 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:42.031348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:42.075709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1063/2136] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:41 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:42.078006 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93baeb18-6017-467d-a34b-efb0a7d9d086 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:42.082110 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883787ac-ec18-478a-b8cf-373646394f5b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:42.085847 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9795ec-09f5-460a-b89f-ea54267e4941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:42.086508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9795ec-09f5-460a-b89f-ea54267e4941 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:42.086977 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9795ec-09f5-460a-b89f-ea54267e4941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:42.087261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9795ec-09f5-460a-b89f-ea54267e4941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:42.089558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93baeb18-6017-467d-a34b-efb0a7d9d086 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:42.094527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8ba71-05cf-4fb2-8d13-1bb0cf72ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:42.095244 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8ba71-05cf-4fb2-8d13-1bb0cf72ad61 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:42.095528 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8ba71-05cf-4fb2-8d13-1bb0cf72ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:42.095837 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8ba71-05cf-4fb2-8d13-1bb0cf72ad61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:42.096608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8ba71-05cf-4fb2-8d13-1bb0cf72ad61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:42.098240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8ba71-05cf-4fb2-8d13-1bb0cf72ad61 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:42.104800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9795ec-09f5-460a-b89f-ea54267e4941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:42.107222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9795ec-09f5-460a-b89f-ea54267e4941 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:42.110369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1064/2137] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:42.115185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8ba71-05cf-4fb2-8d13-1bb0cf72ad61 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:42.126881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1074/2138] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:42.128253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8ba71-05cf-4fb2-8d13-1bb0cf72ad61 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:42.133113 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca573e-11d2-43cc-a99c-7489a3aa536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:42.133804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca573e-11d2-43cc-a99c-7489a3aa536b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:42.134090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca573e-11d2-43cc-a99c-7489a3aa536b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:42.134370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca573e-11d2-43cc-a99c-7489a3aa536b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:42.135146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca573e-11d2-43cc-a99c-7489a3aa536b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:42.136766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca573e-11d2-43cc-a99c-7489a3aa536b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:42.152404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1065/2139] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:42.153711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9795ec-09f5-460a-b89f-ea54267e4941 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:42.171728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9795ec-09f5-460a-b89f-ea54267e4941 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:42.191264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f45d8-a87d-467c-9f05-e9ff2b82ac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:42.192087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f45d8-a87d-467c-9f05-e9ff2b82ac76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:42.192372 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f45d8-a87d-467c-9f05-e9ff2b82ac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:42.192647 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f45d8-a87d-467c-9f05-e9ff2b82ac76 admin admin] PATH_INFO: `/v3/projects/8340013ad89848f8a702d83e87c58f57/users/09b1d70bb4d9480cbbe8a8c080b31f84/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:42.218365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f45d8-a87d-467c-9f05-e9ff2b82ac76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8340013ad89848f8a702d83e87c58f57, user_id=09b1d70bb4d9480cbbe8a8c080b31f84, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:42.222531 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f45d8-a87d-467c-9f05-e9ff2b82ac76 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:42.249709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1075/2140] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:42 2022] PUT /identity/v3/projects/8340013ad89848f8a702d83e87c58f57/users/09b1d70bb4d9480cbbe8a8c080b31f84/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:42.262199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d774dc-7f95-46b4-89b4-66a8ce4f50ee None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:42.262498 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d774dc-7f95-46b4-89b4-66a8ce4f50ee None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:42.262954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d774dc-7f95-46b4-89b4-66a8ce4f50ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:42.316015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-05d774dc-7f95-46b4-89b4-66a8ce4f50ee None None] MFA Rules not processed for user `09b1d70bb4d9480cbbe8a8c080b31f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:42.318101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-05d774dc-7f95-46b4-89b4-66a8ce4f50ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:42.455854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1066/2141] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:42.461117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f45d8-a87d-467c-9f05-e9ff2b82ac76 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:42.605414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f45d8-a87d-467c-9f05-e9ff2b82ac76 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:42.616943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca88451-6d5c-4892-bc81-ceb0cc5da917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:42.618290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca88451-6d5c-4892-bc81-ceb0cc5da917 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:42.618764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca88451-6d5c-4892-bc81-ceb0cc5da917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:42.620543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca88451-6d5c-4892-bc81-ceb0cc5da917 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:42.622352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca88451-6d5c-4892-bc81-ceb0cc5da917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:42.625079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca88451-6d5c-4892-bc81-ceb0cc5da917 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:42.670870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d774dc-7f95-46b4-89b4-66a8ce4f50ee None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:42.673347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-05d774dc-7f95-46b4-89b4-66a8ce4f50ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:42.713033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d774dc-7f95-46b4-89b4-66a8ce4f50ee None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:42.721243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1076/2142] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:42 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:42.723164 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca88451-6d5c-4892-bc81-ceb0cc5da917 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:42.780977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:42.782890 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:42.783166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:42.783442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] PATH_INFO: `/v3/projects/fe15c36e96024614ac8342a4a0b0db2f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:42.784701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe15c36e96024614ac8342a4a0b0db2f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:42.786588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:42.808622 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca88451-6d5c-4892-bc81-ceb0cc5da917 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:42.814231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee312c8d-c010-4a55-8a31-8930b2cfec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:42.814481 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee312c8d-c010-4a55-8a31-8930b2cfec27 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:42.814556 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee312c8d-c010-4a55-8a31-8930b2cfec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:42.817203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee312c8d-c010-4a55-8a31-8930b2cfec27 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:42.817203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee312c8d-c010-4a55-8a31-8930b2cfec27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:42.817439 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:42.819134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee312c8d-c010-4a55-8a31-8930b2cfec27 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:42.845461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1077/2143] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:42 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:42.850074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee312c8d-c010-4a55-8a31-8930b2cfec27 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:42.851612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe15c36e96024614ac8342a4a0b0db2f', 'request_id': 'req-73efb984-4627-4a5f-863f-0648488bc9ab'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:42.859103 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe15c36e96024614ac8342a4a0b0db2f', 'request_id': 'req-73efb984-4627-4a5f-863f-0648488bc9ab'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:42.865573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe15c36e96024614ac8342a4a0b0db2f', 'request_id': 'req-73efb984-4627-4a5f-863f-0648488bc9ab'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:42.867473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee312c8d-c010-4a55-8a31-8930b2cfec27 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:42.885019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] The token cache is being invalidate because project fe15c36e96024614ac8342a4a0b0db2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:42.885794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:42.886191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:42.888112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1067/2144] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:42 2022] DELETE /identity/v3/projects/fe15c36e96024614ac8342a4a0b0db2f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:42.892249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:42.894834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:42.896736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:42.955358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a766a-f0c1-4d81-a5ec-451a04238b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:42.956252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a766a-f0c1-4d81-a5ec-451a04238b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:42.956353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a766a-f0c1-4d81-a5ec-451a04238b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:42.956621 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a766a-f0c1-4d81-a5ec-451a04238b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:42.957364 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a766a-f0c1-4d81-a5ec-451a04238b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:42.959007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a766a-f0c1-4d81-a5ec-451a04238b15 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:42.978983 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1078/2145] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:42.980479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a766a-f0c1-4d81-a5ec-451a04238b15 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:42.984350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-489a766a-f0c1-4d81-a5ec-451a04238b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:43.007700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efb984-4627-4a5f-863f-0648488bc9ab admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:43.011309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a766a-f0c1-4d81-a5ec-451a04238b15 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:43.015984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263c325-97c2-451f-a782-a31330ad59c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:43.017325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263c325-97c2-451f-a782-a31330ad59c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:43.017614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263c325-97c2-451f-a782-a31330ad59c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:43.017893 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263c325-97c2-451f-a782-a31330ad59c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:43.018651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263c325-97c2-451f-a782-a31330ad59c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:43.020266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263c325-97c2-451f-a782-a31330ad59c6 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:43.025671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:43.027134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:43.027905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:43.028411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] PATH_INFO: `/v3/users/5c067086d16e4f149f42fca3c986d756` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:43.030663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c067086d16e4f149f42fca3c986d756)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:43.038071 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:43.038270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1079/2146] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:43.045367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263c325-97c2-451f-a782-a31330ad59c6 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:43.070376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263c325-97c2-451f-a782-a31330ad59c6 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:43.078287 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4221f7-951f-4a34-8ea7-bc52221093d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:43.080199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4221f7-951f-4a34-8ea7-bc52221093d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:43.080795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4221f7-951f-4a34-8ea7-bc52221093d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:43.081029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4221f7-951f-4a34-8ea7-bc52221093d6 admin admin] PATH_INFO: `/v3/projects/93579b41344a44bfa002122a36e9465f/users/5a5a0458ebf64b8498322f36a7f15b75/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:43.102380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4221f7-951f-4a34-8ea7-bc52221093d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93579b41344a44bfa002122a36e9465f, user_id=5a5a0458ebf64b8498322f36a7f15b75, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:43.107068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4221f7-951f-4a34-8ea7-bc52221093d6 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:43.135701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1080/2147] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:43 2022] PUT /identity/v3/projects/93579b41344a44bfa002122a36e9465f/users/5a5a0458ebf64b8498322f36a7f15b75/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:43.148261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a322eda-a832-4d19-9aa5-924eb58326a8 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:43.148634 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a322eda-a832-4d19-9aa5-924eb58326a8 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:43.148820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a322eda-a832-4d19-9aa5-924eb58326a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:43.170729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c067086d16e4f149f42fca3c986d756'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:43.185617 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c067086d16e4f149f42fca3c986d756'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:43.196226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-7a322eda-a832-4d19-9aa5-924eb58326a8 None None] MFA Rules not processed for user `5a5a0458ebf64b8498322f36a7f15b75`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:43.197509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-7a322eda-a832-4d19-9aa5-924eb58326a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:43.200758 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c067086d16e4f149f42fca3c986d756'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:43.201504 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c067086d16e4f149f42fca3c986d756'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:43.202148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c067086d16e4f149f42fca3c986d756'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:43.253800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1068/2148] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:42 2022] DELETE /identity/v3/users/5c067086d16e4f149f42fca3c986d756 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:43.342663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1081/2149] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:43.348092 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:43.349563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:43.395921 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:43.449093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35266743-94b3-410e-a880-d88d5f20ca31 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:43.458305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e39290-99d7-44d2-9672-5290ba82bd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:43.459444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e39290-99d7-44d2-9672-5290ba82bd39 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:43.459905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e39290-99d7-44d2-9672-5290ba82bd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:43.460194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e39290-99d7-44d2-9672-5290ba82bd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:43.460910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e39290-99d7-44d2-9672-5290ba82bd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:43.463029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e39290-99d7-44d2-9672-5290ba82bd39 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:43.499494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1069/2150] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:43 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:43.500007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a322eda-a832-4d19-9aa5-924eb58326a8 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:43.587090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a322eda-a832-4d19-9aa5-924eb58326a8 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:43.601263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:43.649188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae227d-e1e9-4ab3-a95b-397ebcde1072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:43.649868 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae227d-e1e9-4ab3-a95b-397ebcde1072 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:43.650181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae227d-e1e9-4ab3-a95b-397ebcde1072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:43.650466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae227d-e1e9-4ab3-a95b-397ebcde1072 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:43.651166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae227d-e1e9-4ab3-a95b-397ebcde1072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:43.653116 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae227d-e1e9-4ab3-a95b-397ebcde1072 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:43.675930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1082/2151] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:43 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:43.680388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e39290-99d7-44d2-9672-5290ba82bd39 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:43.697163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e39290-99d7-44d2-9672-5290ba82bd39 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:43.704544 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9864e73-c559-4219-ba66-b3184d9743ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:43.705336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9864e73-c559-4219-ba66-b3184d9743ea admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:43.705692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9864e73-c559-4219-ba66-b3184d9743ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:43.708111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9864e73-c559-4219-ba66-b3184d9743ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:43.708943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9864e73-c559-4219-ba66-b3184d9743ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:43.710730 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9864e73-c559-4219-ba66-b3184d9743ea admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:43.727818 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1070/2152] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:43.732022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae227d-e1e9-4ab3-a95b-397ebcde1072 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:43.745687 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae227d-e1e9-4ab3-a95b-397ebcde1072 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:43.756048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d3108-b6d3-414d-88c4-15c63999ef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:43.757236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d3108-b6d3-414d-88c4-15c63999ef4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:43.757684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d3108-b6d3-414d-88c4-15c63999ef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:43.758138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d3108-b6d3-414d-88c4-15c63999ef4d admin admin] PATH_INFO: `/v3/projects/9903ce402abb4edea0abc5ee36449342/users/e207d49e3c91455999b0c159c1861d26/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:43.777137 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d3108-b6d3-414d-88c4-15c63999ef4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9903ce402abb4edea0abc5ee36449342, user_id=e207d49e3c91455999b0c159c1861d26, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:43.780577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d3108-b6d3-414d-88c4-15c63999ef4d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:43.791112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9864e73-c559-4219-ba66-b3184d9743ea admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:43.794337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b9864e73-c559-4219-ba66-b3184d9743ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:43.799420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1083/2153] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:43 2022] PUT /identity/v3/projects/9903ce402abb4edea0abc5ee36449342/users/e207d49e3c91455999b0c159c1861d26/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:43.803012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d3108-b6d3-414d-88c4-15c63999ef4d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:43.818696 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9864e73-c559-4219-ba66-b3184d9743ea admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:43.901020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d3108-b6d3-414d-88c4-15c63999ef4d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:43.907269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fcde2-c3d2-420e-817e-d2b9338cbec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:43.908381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fcde2-c3d2-420e-817e-d2b9338cbec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:43.908807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fcde2-c3d2-420e-817e-d2b9338cbec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:43.909150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87402f-dac5-465c-a7fd-c59effa72203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:43.909645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fcde2-c3d2-420e-817e-d2b9338cbec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:43.910176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87402f-dac5-465c-a7fd-c59effa72203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:43.910859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87402f-dac5-465c-a7fd-c59effa72203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:43.911096 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fcde2-c3d2-420e-817e-d2b9338cbec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:43.911227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87402f-dac5-465c-a7fd-c59effa72203 admin admin] PATH_INFO: `/v3/projects/9cd62c69af5c400c845aad5a56db0384` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:43.913062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87402f-dac5-465c-a7fd-c59effa72203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd62c69af5c400c845aad5a56db0384)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:43.914007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fcde2-c3d2-420e-817e-d2b9338cbec9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:43.915706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87402f-dac5-465c-a7fd-c59effa72203 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:43.928039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1084/2154] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:43.933445 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fcde2-c3d2-420e-817e-d2b9338cbec9 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:43.947569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fcde2-c3d2-420e-817e-d2b9338cbec9 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:43.953212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade8a05-8a97-4f77-b1c1-045be4abce34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:43.954535 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade8a05-8a97-4f77-b1c1-045be4abce34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:43.955344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade8a05-8a97-4f77-b1c1-045be4abce34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:43.955735 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade8a05-8a97-4f77-b1c1-045be4abce34 admin admin] PATH_INFO: `/v3/projects/9903ce402abb4edea0abc5ee36449342/users/e207d49e3c91455999b0c159c1861d26/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:43.959737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade8a05-8a97-4f77-b1c1-045be4abce34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9903ce402abb4edea0abc5ee36449342, user_id=e207d49e3c91455999b0c159c1861d26, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:43.962793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade8a05-8a97-4f77-b1c1-045be4abce34 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:43.975828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1085/2155] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:43 2022] PUT /identity/v3/projects/9903ce402abb4edea0abc5ee36449342/users/e207d49e3c91455999b0c159c1861d26/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:43.981788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2a87402f-dac5-465c-a7fd-c59effa72203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd62c69af5c400c845aad5a56db0384', 'request_id': 'req-2a87402f-dac5-465c-a7fd-c59effa72203'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:43.989520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2a87402f-dac5-465c-a7fd-c59effa72203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd62c69af5c400c845aad5a56db0384', 'request_id': 'req-2a87402f-dac5-465c-a7fd-c59effa72203'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:43.993532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73a32a-bf49-403e-bb8b-61ee176068fe None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:43.996029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73a32a-bf49-403e-bb8b-61ee176068fe None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:43.996423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73a32a-bf49-403e-bb8b-61ee176068fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:43.996552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2a87402f-dac5-465c-a7fd-c59effa72203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd62c69af5c400c845aad5a56db0384', 'request_id': 'req-2a87402f-dac5-465c-a7fd-c59effa72203'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:44.019163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2a87402f-dac5-465c-a7fd-c59effa72203 admin admin] The token cache is being invalidate because project 9cd62c69af5c400c845aad5a56db0384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:44.019361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2a87402f-dac5-465c-a7fd-c59effa72203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:44.020031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2a87402f-dac5-465c-a7fd-c59effa72203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:44.022388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1071/2156] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:43 2022] DELETE /identity/v3/projects/9cd62c69af5c400c845aad5a56db0384 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:44.028569 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8258cd1-ec44-4ae3-952f-5d1c2a30337d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:44.028866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8258cd1-ec44-4ae3-952f-5d1c2a30337d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:44.029723 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8258cd1-ec44-4ae3-952f-5d1c2a30337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:44.095212 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c8258cd1-ec44-4ae3-952f-5d1c2a30337d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:44.095863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ab73a32a-bf49-403e-bb8b-61ee176068fe None None] MFA Rules not processed for user `e207d49e3c91455999b0c159c1861d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:44.096708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c8258cd1-ec44-4ae3-952f-5d1c2a30337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:44.097042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ab73a32a-bf49-403e-bb8b-61ee176068fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:44.133213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:44.170568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:44.178998 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1072/2157] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:44.187038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5d246-c09f-493a-81db-7d9deb508b80 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:44.187325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5d246-c09f-493a-81db-7d9deb508b80 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:44.187601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5d246-c09f-493a-81db-7d9deb508b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:44.195035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1086/2158] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:44.208402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73a32a-bf49-403e-bb8b-61ee176068fe None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:44.209692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2be5d246-c09f-493a-81db-7d9deb508b80 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:44.209825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ab73a32a-bf49-403e-bb8b-61ee176068fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:44.210990 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2be5d246-c09f-493a-81db-7d9deb508b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:44.225266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1073/2159] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:44.226420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5d246-c09f-493a-81db-7d9deb508b80 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:44.237343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5d246-c09f-493a-81db-7d9deb508b80 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:44.247147 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4ecc4-3bd3-4dbd-a6b3-b27a05e9ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:44.248373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4ecc4-3bd3-4dbd-a6b3-b27a05e9ace8 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:44.249817 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4ecc4-3bd3-4dbd-a6b3-b27a05e9ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:44.250117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4ecc4-3bd3-4dbd-a6b3-b27a05e9ace8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:44.251854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4ecc4-3bd3-4dbd-a6b3-b27a05e9ace8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:44.252248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4ecc4-3bd3-4dbd-a6b3-b27a05e9ace8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:44.256611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4ecc4-3bd3-4dbd-a6b3-b27a05e9ace8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:44.277290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1074/2160] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:44.278153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4ecc4-3bd3-4dbd-a6b3-b27a05e9ace8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:44.289857 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4ecc4-3bd3-4dbd-a6b3-b27a05e9ace8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:44.294687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23854359-ff45-4489-b706-1b2292fda0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:44.294870 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73a32a-bf49-403e-bb8b-61ee176068fe None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:44.295342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23854359-ff45-4489-b706-1b2292fda0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:44.295617 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23854359-ff45-4489-b706-1b2292fda0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:44.295892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23854359-ff45-4489-b706-1b2292fda0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:44.296576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23854359-ff45-4489-b706-1b2292fda0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:44.300789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23854359-ff45-4489-b706-1b2292fda0a6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:44.304181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfb8cf-61d2-45e7-abce-f5177a74c144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:44.304869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb8cf-61d2-45e7-abce-f5177a74c144 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:44.305149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb8cf-61d2-45e7-abce-f5177a74c144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:44.305423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb8cf-61d2-45e7-abce-f5177a74c144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:44.308323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-dcbfb8cf-61d2-45e7-abce-f5177a74c144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:44.347093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1075/2161] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:44 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:44.349985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23854359-ff45-4489-b706-1b2292fda0a6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:44.380993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfb8cf-61d2-45e7-abce-f5177a74c144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:44.382473 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfb8cf-61d2-45e7-abce-f5177a74c144 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:44.392276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1087/2162] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:16:44.433847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23854359-ff45-4489-b706-1b2292fda0a6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:44.439557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02e207-7c0d-4e32-9aee-34ae16a004fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:44.440222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02e207-7c0d-4e32-9aee-34ae16a004fa admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:44.440506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02e207-7c0d-4e32-9aee-34ae16a004fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:44.440810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02e207-7c0d-4e32-9aee-34ae16a004fa admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:44.441470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02e207-7c0d-4e32-9aee-34ae16a004fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:44.443420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02e207-7c0d-4e32-9aee-34ae16a004fa admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:44.472850 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1076/2163] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:44 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:44.476937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfb8cf-61d2-45e7-abce-f5177a74c144 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:44.489279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfb8cf-61d2-45e7-abce-f5177a74c144 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:44.494226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2be29-c111-4fe2-9a03-753f3f83eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:44.494988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2be29-c111-4fe2-9a03-753f3f83eb5b admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:44.495335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2be29-c111-4fe2-9a03-753f3f83eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:44.495678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2be29-c111-4fe2-9a03-753f3f83eb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:44.496534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2be29-c111-4fe2-9a03-753f3f83eb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:44.498233 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2be29-c111-4fe2-9a03-753f3f83eb5b admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:44.511803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1088/2164] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:44.515715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02e207-7c0d-4e32-9aee-34ae16a004fa admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:44.529414 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02e207-7c0d-4e32-9aee-34ae16a004fa admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:44.536990 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43b3bd-3817-4163-ab09-e3f1eebbea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:44.537883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43b3bd-3817-4163-ab09-e3f1eebbea12 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:44.538485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43b3bd-3817-4163-ab09-e3f1eebbea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:44.538950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43b3bd-3817-4163-ab09-e3f1eebbea12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:44.539983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43b3bd-3817-4163-ab09-e3f1eebbea12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:44.542190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43b3bd-3817-4163-ab09-e3f1eebbea12 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:44.582099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1077/2165] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:44.586567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2be29-c111-4fe2-9a03-753f3f83eb5b admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:44.599400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2be29-c111-4fe2-9a03-753f3f83eb5b admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:44.605601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb2145-7e49-4bce-87e6-391427b03ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:44.606552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb2145-7e49-4bce-87e6-391427b03ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:44.606980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb2145-7e49-4bce-87e6-391427b03ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:44.607177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb2145-7e49-4bce-87e6-391427b03ea7 admin admin] PATH_INFO: `/v3/projects/c585299d93654063a0f5cb76b35da94c/users/648bbc92a77c4883820f14de9dc1c2ea/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:44.642169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb2145-7e49-4bce-87e6-391427b03ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c585299d93654063a0f5cb76b35da94c, user_id=648bbc92a77c4883820f14de9dc1c2ea, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:44.646867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb2145-7e49-4bce-87e6-391427b03ea7 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:44.663912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1089/2166] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:44 2022] PUT /identity/v3/projects/c585299d93654063a0f5cb76b35da94c/users/648bbc92a77c4883820f14de9dc1c2ea/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:44.677263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f3207-6a47-4579-8921-3bb1c2cc689e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:44.677557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f3207-6a47-4579-8921-3bb1c2cc689e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:44.678157 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f3207-6a47-4579-8921-3bb1c2cc689e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:44.732944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-576f3207-6a47-4579-8921-3bb1c2cc689e None None] MFA Rules not processed for user `648bbc92a77c4883820f14de9dc1c2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:44.735404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-576f3207-6a47-4579-8921-3bb1c2cc689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:44.834355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:44.841444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1078/2167] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:44.846562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb2145-7e49-4bce-87e6-391427b03ea7 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:44.934711 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb2145-7e49-4bce-87e6-391427b03ea7 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:44.940862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513303a-7400-4b39-93d8-e2cf0561dca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:44.941525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513303a-7400-4b39-93d8-e2cf0561dca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:44.942049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513303a-7400-4b39-93d8-e2cf0561dca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:44.942049 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513303a-7400-4b39-93d8-e2cf0561dca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:44.942775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513303a-7400-4b39-93d8-e2cf0561dca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:44.944694 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513303a-7400-4b39-93d8-e2cf0561dca4 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:44.960365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:44.981103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1090/2168] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:44 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:44.982794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f3207-6a47-4579-8921-3bb1c2cc689e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:44.996194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f3207-6a47-4579-8921-3bb1c2cc689e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:45.072251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b54ae2-2f2c-473c-8915-6cc6e875a96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:45.072928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b54ae2-2f2c-473c-8915-6cc6e875a96f admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:45.073213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b54ae2-2f2c-473c-8915-6cc6e875a96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:45.073491 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b54ae2-2f2c-473c-8915-6cc6e875a96f admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:45.074231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b54ae2-2f2c-473c-8915-6cc6e875a96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:45.076309 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b54ae2-2f2c-473c-8915-6cc6e875a96f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:45.107163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513303a-7400-4b39-93d8-e2cf0561dca4 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:45.107813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1079/2169] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:44 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:45.121604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513303a-7400-4b39-93d8-e2cf0561dca4 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:45.131728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cacda-d34a-46dc-b435-7a6afa60e23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:45.132629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cacda-d34a-46dc-b435-7a6afa60e23e admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:45.132746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cacda-d34a-46dc-b435-7a6afa60e23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:45.133137 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cacda-d34a-46dc-b435-7a6afa60e23e admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:45.133878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cacda-d34a-46dc-b435-7a6afa60e23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:45.135742 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cacda-d34a-46dc-b435-7a6afa60e23e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:45.148919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1091/2170] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:45.153057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b54ae2-2f2c-473c-8915-6cc6e875a96f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:45.164728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b54ae2-2f2c-473c-8915-6cc6e875a96f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:45.169718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a71a83-f046-4ad0-8255-9976b7e5c738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:45.170373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a71a83-f046-4ad0-8255-9976b7e5c738 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:45.170678 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a71a83-f046-4ad0-8255-9976b7e5c738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:45.170954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a71a83-f046-4ad0-8255-9976b7e5c738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:45.171680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a71a83-f046-4ad0-8255-9976b7e5c738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:45.173695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a71a83-f046-4ad0-8255-9976b7e5c738 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:45.184311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1080/2171] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:45.188628 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cacda-d34a-46dc-b435-7a6afa60e23e admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:45.200223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cacda-d34a-46dc-b435-7a6afa60e23e admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:45.205600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52882e17-0a84-437c-9642-bd5a111ef4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:45.206483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52882e17-0a84-437c-9642-bd5a111ef4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:45.206802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52882e17-0a84-437c-9642-bd5a111ef4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:45.207085 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52882e17-0a84-437c-9642-bd5a111ef4d4 admin admin] PATH_INFO: `/v3/projects/4a178966eea949b0b14c01d566e67c20/users/e808604eb6cb4a9bbed829b22c5aacbb/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:45.223956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52882e17-0a84-437c-9642-bd5a111ef4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a178966eea949b0b14c01d566e67c20, user_id=e808604eb6cb4a9bbed829b22c5aacbb, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:45.226797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52882e17-0a84-437c-9642-bd5a111ef4d4 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:45.240932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1092/2172] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:45 2022] PUT /identity/v3/projects/4a178966eea949b0b14c01d566e67c20/users/e808604eb6cb4a9bbed829b22c5aacbb/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:45.252419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1bc19-65db-4120-bea5-0e668b4e33b6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:45.252709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1bc19-65db-4120-bea5-0e668b4e33b6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:45.252985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1bc19-65db-4120-bea5-0e668b4e33b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:45.285798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-22a1bc19-65db-4120-bea5-0e668b4e33b6 None None] MFA Rules not processed for user `e808604eb6cb4a9bbed829b22c5aacbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:45.287406 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-22a1bc19-65db-4120-bea5-0e668b4e33b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:45.368328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1081/2173] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:45.372587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52882e17-0a84-437c-9642-bd5a111ef4d4 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:45.460489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52882e17-0a84-437c-9642-bd5a111ef4d4 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:45.470017 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3416a-8e9b-4e49-813c-2d57c22a33d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:45.470783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3416a-8e9b-4e49-813c-2d57c22a33d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:45.471070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3416a-8e9b-4e49-813c-2d57c22a33d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:45.471344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3416a-8e9b-4e49-813c-2d57c22a33d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:45.472059 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3416a-8e9b-4e49-813c-2d57c22a33d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:45.474076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3416a-8e9b-4e49-813c-2d57c22a33d5 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:45.505128 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1093/2174] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:45 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:45.509083 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1bc19-65db-4120-bea5-0e668b4e33b6 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:45.520338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1bc19-65db-4120-bea5-0e668b4e33b6 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:45.591832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63cee2-dffc-4436-9b7e-2050b3ed8695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:45.592506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63cee2-dffc-4436-9b7e-2050b3ed8695 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:45.592791 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63cee2-dffc-4436-9b7e-2050b3ed8695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:45.593068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63cee2-dffc-4436-9b7e-2050b3ed8695 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:45.593777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63cee2-dffc-4436-9b7e-2050b3ed8695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:45.596272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63cee2-dffc-4436-9b7e-2050b3ed8695 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:45.613045 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:45.625353 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1082/2175] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:45 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:45.629822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3416a-8e9b-4e49-813c-2d57c22a33d5 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:45.640573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3416a-8e9b-4e49-813c-2d57c22a33d5 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:45.645593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b3e82-bc21-41f6-bad0-dd532c52573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:45.646264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b3e82-bc21-41f6-bad0-dd532c52573d admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:45.646547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b3e82-bc21-41f6-bad0-dd532c52573d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:45.646867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b3e82-bc21-41f6-bad0-dd532c52573d admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:45.647600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b3e82-bc21-41f6-bad0-dd532c52573d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:45.649218 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b3e82-bc21-41f6-bad0-dd532c52573d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:45.661409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1094/2176] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:45.665399 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63cee2-dffc-4436-9b7e-2050b3ed8695 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:45.676340 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63cee2-dffc-4436-9b7e-2050b3ed8695 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:45.682049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb1853-97da-4ba4-b711-f5688222da57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:45.683433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb1853-97da-4ba4-b711-f5688222da57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:45.683997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb1853-97da-4ba4-b711-f5688222da57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:45.683997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb1853-97da-4ba4-b711-f5688222da57 admin admin] PATH_INFO: `/v3/projects/48de0b42907d47e29245492a73bb11b4/users/3c5da13270d24fae8a37c998a4dc90c6/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:45.701301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb1853-97da-4ba4-b711-f5688222da57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48de0b42907d47e29245492a73bb11b4, user_id=3c5da13270d24fae8a37c998a4dc90c6, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:45.704443 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb1853-97da-4ba4-b711-f5688222da57 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:45.753011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1083/2177] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:45 2022] PUT /identity/v3/projects/48de0b42907d47e29245492a73bb11b4/users/3c5da13270d24fae8a37c998a4dc90c6/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:45.758764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b3e82-bc21-41f6-bad0-dd532c52573d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:45.785704 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b3e82-bc21-41f6-bad0-dd532c52573d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:45.915733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6009c9-f666-4208-a63b-a70716d5839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:45.916368 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6009c9-f666-4208-a63b-a70716d5839e admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:45.917458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6009c9-f666-4208-a63b-a70716d5839e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:45.917773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6009c9-f666-4208-a63b-a70716d5839e admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:45.918490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6009c9-f666-4208-a63b-a70716d5839e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:45.920168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6009c9-f666-4208-a63b-a70716d5839e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:45.957444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1095/2178] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:45.959437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb1853-97da-4ba4-b711-f5688222da57 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:45.974886 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb1853-97da-4ba4-b711-f5688222da57 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:45.993117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ff04-cdf4-4c1a-a173-620be10a75b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:45.994029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ff04-cdf4-4c1a-a173-620be10a75b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:45.994312 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ff04-cdf4-4c1a-a173-620be10a75b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:45.994593 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ff04-cdf4-4c1a-a173-620be10a75b0 admin admin] PATH_INFO: `/v3/projects/48de0b42907d47e29245492a73bb11b4/users/3c5da13270d24fae8a37c998a4dc90c6/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:45.996800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3ff04-cdf4-4c1a-a173-620be10a75b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48de0b42907d47e29245492a73bb11b4, user_id=3c5da13270d24fae8a37c998a4dc90c6, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:45.999807 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3ff04-cdf4-4c1a-a173-620be10a75b0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:46.030364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1084/2179] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:45 2022] PUT /identity/v3/projects/48de0b42907d47e29245492a73bb11b4/users/3c5da13270d24fae8a37c998a4dc90c6/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:46.040782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d885175-9a3a-4b40-9a25-124a530a84e8 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:46.041060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d885175-9a3a-4b40-9a25-124a530a84e8 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:46.041341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d885175-9a3a-4b40-9a25-124a530a84e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:46.105782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-8d885175-9a3a-4b40-9a25-124a530a84e8 None None] MFA Rules not processed for user `3c5da13270d24fae8a37c998a4dc90c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:46.107056 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8d885175-9a3a-4b40-9a25-124a530a84e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:46.158189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:46.186808 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ff04-cdf4-4c1a-a173-620be10a75b0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:46.254375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1096/2180] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:46.261440 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ff04-cdf4-4c1a-a173-620be10a75b0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:46.265176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d748b3-7910-4fbc-8c2d-238611855c79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:46.265823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d748b3-7910-4fbc-8c2d-238611855c79 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:46.266712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d885175-9a3a-4b40-9a25-124a530a84e8 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:46.266843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d748b3-7910-4fbc-8c2d-238611855c79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:46.267036 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d748b3-7910-4fbc-8c2d-238611855c79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:46.268661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8d885175-9a3a-4b40-9a25-124a530a84e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:46.268927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-48d748b3-7910-4fbc-8c2d-238611855c79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:46.281088 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d885175-9a3a-4b40-9a25-124a530a84e8 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:46.284864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de924fe4-4cf4-472a-8fa6-33eb5866d3ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:46.285508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de924fe4-4cf4-472a-8fa6-33eb5866d3ef service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:46.285790 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de924fe4-4cf4-472a-8fa6-33eb5866d3ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:46.286061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de924fe4-4cf4-472a-8fa6-33eb5866d3ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:46.340730 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d748b3-7910-4fbc-8c2d-238611855c79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:46.342919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d748b3-7910-4fbc-8c2d-238611855c79 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:46.350063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de924fe4-4cf4-472a-8fa6-33eb5866d3ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:46.351554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de924fe4-4cf4-472a-8fa6-33eb5866d3ef service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:46.353225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1085/2181] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:16:46.362205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1097/2182] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:16:47.144606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d748b3-7910-4fbc-8c2d-238611855c79 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:47.153478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d748b3-7910-4fbc-8c2d-238611855c79 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:47.159779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c4b8b-0ddc-4f68-897a-5d5c012c00b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:47.159779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c4b8b-0ddc-4f68-897a-5d5c012c00b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:47.159779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c4b8b-0ddc-4f68-897a-5d5c012c00b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:47.159779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c4b8b-0ddc-4f68-897a-5d5c012c00b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:47.184854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb082-5e16-42de-95f4-d8061b73a62a None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:47.185371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb082-5e16-42de-95f4-d8061b73a62a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:47.185678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb082-5e16-42de-95f4-d8061b73a62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:47.211794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-1c5bb082-5e16-42de-95f4-d8061b73a62a None None] MFA Rules not processed for user `48e816a85da046fbb8a02f9a84ecd6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:47.213063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1c5bb082-5e16-42de-95f4-d8061b73a62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:47.233511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c4b8b-0ddc-4f68-897a-5d5c012c00b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:47.235187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c4b8b-0ddc-4f68-897a-5d5c012c00b5 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:47.245362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1086/2183] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:47.274385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1098/2184] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:48.286768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c4b8b-0ddc-4f68-897a-5d5c012c00b5 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:48.300264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c4b8b-0ddc-4f68-897a-5d5c012c00b5 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:48.308586 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c135a-e291-4047-8700-fadf93bcccd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:48.309455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c135a-e291-4047-8700-fadf93bcccd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:48.309795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c135a-e291-4047-8700-fadf93bcccd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:48.310184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c135a-e291-4047-8700-fadf93bcccd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:48.332347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:48.480233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c135a-e291-4047-8700-fadf93bcccd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:48.488105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c135a-e291-4047-8700-fadf93bcccd7 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:48.525456 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1087/2185] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:49.622148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bb082-5e16-42de-95f4-d8061b73a62a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:49.637931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bb082-5e16-42de-95f4-d8061b73a62a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:49.644663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2060da3-62eb-406d-af6b-ae8eb05c832b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:49.645707 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060da3-62eb-406d-af6b-ae8eb05c832b service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:49.646221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060da3-62eb-406d-af6b-ae8eb05c832b service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:49.646661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060da3-62eb-406d-af6b-ae8eb05c832b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:49.690848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2060da3-62eb-406d-af6b-ae8eb05c832b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:49.692946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2060da3-62eb-406d-af6b-ae8eb05c832b service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:49.716660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1099/2186] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:51.513738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c135a-e291-4047-8700-fadf93bcccd7 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:51.515229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8b0c135a-e291-4047-8700-fadf93bcccd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:51.593163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c135a-e291-4047-8700-fadf93bcccd7 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:51.599962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:51.600953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:51.601154 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:51.601372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] PATH_INFO: `/v3/users/cf94ea4bbf414d2d89cfe3c232f2a54b` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:51.602581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf94ea4bbf414d2d89cfe3c232f2a54b)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:51.604947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:51.660937 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf94ea4bbf414d2d89cfe3c232f2a54b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:51.667658 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf94ea4bbf414d2d89cfe3c232f2a54b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:51.675537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf94ea4bbf414d2d89cfe3c232f2a54b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:51.675984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf94ea4bbf414d2d89cfe3c232f2a54b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:51.676652 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf94ea4bbf414d2d89cfe3c232f2a54b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:51.694404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1088/2187] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:51 2022] DELETE /identity/v3/users/cf94ea4bbf414d2d89cfe3c232f2a54b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:51.827687 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2060da3-62eb-406d-af6b-ae8eb05c832b service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:51.829845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-a2060da3-62eb-406d-af6b-ae8eb05c832b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:51.843371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2060da3-62eb-406d-af6b-ae8eb05c832b service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:51.886880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:51.888446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:51.907325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:51.924284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a1b49-31a6-467d-861d-d11da597281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:51.925180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1b49-31a6-467d-861d-d11da597281a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:51.925458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1b49-31a6-467d-861d-d11da597281a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:51.925786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1b49-31a6-467d-861d-d11da597281a admin admin] PATH_INFO: `/v3/users/09b1d70bb4d9480cbbe8a8c080b31f84` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:51.926986 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a1b49-31a6-467d-861d-d11da597281a admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b1d70bb4d9480cbbe8a8c080b31f84)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:51.928947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a1b49-31a6-467d-861d-d11da597281a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:51.934370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:51.990088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c7ded-fb51-43ac-8f7b-1a0983267733 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:51.993442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d31a1b49-31a6-467d-861d-d11da597281a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b1d70bb4d9480cbbe8a8c080b31f84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:52.000698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455aeb1e-fda8-4b4d-8a09-732f09bed305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:52.001806 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d31a1b49-31a6-467d-861d-d11da597281a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b1d70bb4d9480cbbe8a8c080b31f84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:52.002514 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d31a1b49-31a6-467d-861d-d11da597281a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b1d70bb4d9480cbbe8a8c080b31f84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:52.002653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455aeb1e-fda8-4b4d-8a09-732f09bed305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.002933 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455aeb1e-fda8-4b4d-8a09-732f09bed305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.003217 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455aeb1e-fda8-4b4d-8a09-732f09bed305 admin admin] PATH_INFO: `/v3/projects/6f60bd09c67c4a3ba0f96d5367a3cd76` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.003332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d31a1b49-31a6-467d-861d-d11da597281a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b1d70bb4d9480cbbe8a8c080b31f84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:52.004627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455aeb1e-fda8-4b4d-8a09-732f09bed305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f60bd09c67c4a3ba0f96d5367a3cd76)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:52.007837 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455aeb1e-fda8-4b4d-8a09-732f09bed305 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:52.017467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d31a1b49-31a6-467d-861d-d11da597281a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b1d70bb4d9480cbbe8a8c080b31f84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:52.034379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1100/2188] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:51 2022] DELETE /identity/v3/users/09b1d70bb4d9480cbbe8a8c080b31f84 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:52.039033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fb51e-dad2-48d2-af00-8ce9170b49a3 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.039322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fb51e-dad2-48d2-af00-8ce9170b49a3 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.039597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fb51e-dad2-48d2-af00-8ce9170b49a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.060421 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f23fb51e-dad2-48d2-af00-8ce9170b49a3 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:52.062399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f23fb51e-dad2-48d2-af00-8ce9170b49a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:52.068472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-455aeb1e-fda8-4b4d-8a09-732f09bed305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'request_id': 'req-455aeb1e-fda8-4b4d-8a09-732f09bed305'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:52.076754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-455aeb1e-fda8-4b4d-8a09-732f09bed305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'request_id': 'req-455aeb1e-fda8-4b4d-8a09-732f09bed305'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:52.082180 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-455aeb1e-fda8-4b4d-8a09-732f09bed305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f60bd09c67c4a3ba0f96d5367a3cd76', 'request_id': 'req-455aeb1e-fda8-4b4d-8a09-732f09bed305'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:52.100632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-455aeb1e-fda8-4b4d-8a09-732f09bed305 admin admin] The token cache is being invalidate because project 6f60bd09c67c4a3ba0f96d5367a3cd76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:52.101016 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-455aeb1e-fda8-4b4d-8a09-732f09bed305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:52.101753 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-455aeb1e-fda8-4b4d-8a09-732f09bed305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:52.103992 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1089/2189] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:51 2022] DELETE /identity/v3/projects/6f60bd09c67c4a3ba0f96d5367a3cd76 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:52.108714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84a79d-3ef8-45fa-ad63-82a34daffa05 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.109421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84a79d-3ef8-45fa-ad63-82a34daffa05 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.110345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84a79d-3ef8-45fa-ad63-82a34daffa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.132490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2d84a79d-3ef8-45fa-ad63-82a34daffa05 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:52.134273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2d84a79d-3ef8-45fa-ad63-82a34daffa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:52.144044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1101/2190] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:52.155788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fb51e-dad2-48d2-af00-8ce9170b49a3 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:52.157749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f23fb51e-dad2-48d2-af00-8ce9170b49a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:52.230783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1090/2191] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:52.237269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9c0d-aad7-44f8-b740-e8bb874d3008 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.237563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9c0d-aad7-44f8-b740-e8bb874d3008 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.237842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9c0d-aad7-44f8-b740-e8bb874d3008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.239482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fb51e-dad2-48d2-af00-8ce9170b49a3 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:52.244609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c36bb-abda-4a38-ab96-1d93b0c5d417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:52.246026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c36bb-abda-4a38-ab96-1d93b0c5d417 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.246567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c36bb-abda-4a38-ab96-1d93b0c5d417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.247074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c36bb-abda-4a38-ab96-1d93b0c5d417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.260399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c36bb-abda-4a38-ab96-1d93b0c5d417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:52.261973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c36bb-abda-4a38-ab96-1d93b0c5d417 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:52.269636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-cfaf9c0d-aad7-44f8-b740-e8bb874d3008 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:52.271252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cfaf9c0d-aad7-44f8-b740-e8bb874d3008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:52.278672 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1102/2192] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:16:52.290228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1091/2193] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:52.295593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c36bb-abda-4a38-ab96-1d93b0c5d417 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:52.306742 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c36bb-abda-4a38-ab96-1d93b0c5d417 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:52.312454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45d4a8-cdfe-4c0a-be06-75f267da19f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:52.313868 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45d4a8-cdfe-4c0a-be06-75f267da19f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.314250 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45d4a8-cdfe-4c0a-be06-75f267da19f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.314596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45d4a8-cdfe-4c0a-be06-75f267da19f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.315437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45d4a8-cdfe-4c0a-be06-75f267da19f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:52.315852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45d4a8-cdfe-4c0a-be06-75f267da19f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:52.317513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45d4a8-cdfe-4c0a-be06-75f267da19f4 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:52.320536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:52.334699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1103/2194] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:16:52.339197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf9c0d-aad7-44f8-b740-e8bb874d3008 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:52.356864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf9c0d-aad7-44f8-b740-e8bb874d3008 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:52.370975 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9619bb-10dc-4628-9acb-3d4594907b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:52.374884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9619bb-10dc-4628-9acb-3d4594907b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.376712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9619bb-10dc-4628-9acb-3d4594907b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.377278 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9619bb-10dc-4628-9acb-3d4594907b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.378219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9619bb-10dc-4628-9acb-3d4594907b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:52.383383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9619bb-10dc-4628-9acb-3d4594907b9d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:52.433347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1092/2195] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:52 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:52.437568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45d4a8-cdfe-4c0a-be06-75f267da19f4 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:52.449854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45d4a8-cdfe-4c0a-be06-75f267da19f4 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:52.534956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad35a2-29ac-4513-9c6c-9cb1a6f59d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:52.535794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad35a2-29ac-4513-9c6c-9cb1a6f59d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.536247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad35a2-29ac-4513-9c6c-9cb1a6f59d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.536662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad35a2-29ac-4513-9c6c-9cb1a6f59d5a admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.537860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad35a2-29ac-4513-9c6c-9cb1a6f59d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:52.539507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad35a2-29ac-4513-9c6c-9cb1a6f59d5a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:52.587514 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1104/2196] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:52 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:52.592020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9619bb-10dc-4628-9acb-3d4594907b9d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:52.611335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9619bb-10dc-4628-9acb-3d4594907b9d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:52.619245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67cc83-147a-4c91-b533-20f9688fe096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:52.620107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67cc83-147a-4c91-b533-20f9688fe096 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.620449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67cc83-147a-4c91-b533-20f9688fe096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.620793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67cc83-147a-4c91-b533-20f9688fe096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.622029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67cc83-147a-4c91-b533-20f9688fe096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:52.627171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67cc83-147a-4c91-b533-20f9688fe096 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:52.641618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1093/2197] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:52.646094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad35a2-29ac-4513-9c6c-9cb1a6f59d5a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:52.660834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad35a2-29ac-4513-9c6c-9cb1a6f59d5a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:52.667978 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153f318-937a-477d-b5c6-e875864a32e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:52.668799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153f318-937a-477d-b5c6-e875864a32e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.669231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153f318-937a-477d-b5c6-e875864a32e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.669615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153f318-937a-477d-b5c6-e875864a32e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.670423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153f318-937a-477d-b5c6-e875864a32e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:52.672413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153f318-937a-477d-b5c6-e875864a32e9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:52.685691 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1105/2198] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:52.690431 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67cc83-147a-4c91-b533-20f9688fe096 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:52.707618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67cc83-147a-4c91-b533-20f9688fe096 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:52.714173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6cedf-57f4-41c8-9bc0-c4585b5377a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:52.715279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6cedf-57f4-41c8-9bc0-c4585b5377a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.715745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6cedf-57f4-41c8-9bc0-c4585b5377a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.716809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6cedf-57f4-41c8-9bc0-c4585b5377a9 admin admin] PATH_INFO: `/v3/projects/8eb5b190f1b0422b96dcda6d2a08abdc/users/82f18e244efa4f139f88a232180f850c/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.747299 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6cedf-57f4-41c8-9bc0-c4585b5377a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb5b190f1b0422b96dcda6d2a08abdc, user_id=82f18e244efa4f139f88a232180f850c, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:52.750830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6cedf-57f4-41c8-9bc0-c4585b5377a9 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:52.755893 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:52.789219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1094/2199] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:52 2022] PUT /identity/v3/projects/8eb5b190f1b0422b96dcda6d2a08abdc/users/82f18e244efa4f139f88a232180f850c/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:52.804248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153f318-937a-477d-b5c6-e875864a32e9 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:52.805176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a3488-fa93-4704-9b87-ca00fe4e766a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.806152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a3488-fa93-4704-9b87-ca00fe4e766a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.807342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a3488-fa93-4704-9b87-ca00fe4e766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.808713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b153f318-937a-477d-b5c6-e875864a32e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:52.849626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153f318-937a-477d-b5c6-e875864a32e9 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:52.851555 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e47a3488-fa93-4704-9b87-ca00fe4e766a None None] MFA Rules not processed for user `82f18e244efa4f139f88a232180f850c`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:52.853264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e47a3488-fa93-4704-9b87-ca00fe4e766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:52.937851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:52.938967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:52.939459 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:52.940052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] PATH_INFO: `/v3/projects/8340013ad89848f8a702d83e87c58f57` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:52.940470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1095/2200] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:52.941840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8340013ad89848f8a702d83e87c58f57)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:52.946322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:52.952123 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a3488-fa93-4704-9b87-ca00fe4e766a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:52.953949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e47a3488-fa93-4704-9b87-ca00fe4e766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:53.032699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8340013ad89848f8a702d83e87c58f57', 'request_id': 'req-65140100-1fdc-4619-9280-1a1e20cc8d9d'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.041253 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8340013ad89848f8a702d83e87c58f57', 'request_id': 'req-65140100-1fdc-4619-9280-1a1e20cc8d9d'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.045030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a3488-fa93-4704-9b87-ca00fe4e766a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:53.051962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8340013ad89848f8a702d83e87c58f57', 'request_id': 'req-65140100-1fdc-4619-9280-1a1e20cc8d9d'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.066090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] The token cache is being invalidate because project 8340013ad89848f8a702d83e87c58f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:53.066899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.067605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.070287 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1106/2201] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:52 2022] DELETE /identity/v3/projects/8340013ad89848f8a702d83e87c58f57 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:53.074020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:53.075837 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:53.083649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:53.147358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72ebe3-0d23-4e1d-9da0-5085044544e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:53.148014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72ebe3-0d23-4e1d-9da0-5085044544e7 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:53.148392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72ebe3-0d23-4e1d-9da0-5085044544e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:53.148667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72ebe3-0d23-4e1d-9da0-5085044544e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:53.150972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3d72ebe3-0d23-4e1d-9da0-5085044544e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:53.158326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65140100-1fdc-4619-9280-1a1e20cc8d9d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:53.164656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:53.165997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:53.166284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:53.166566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] PATH_INFO: `/v3/users/5a5a0458ebf64b8498322f36a7f15b75` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:53.168763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5a0458ebf64b8498322f36a7f15b75)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:53.170507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:53.174875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:53.237177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72ebe3-0d23-4e1d-9da0-5085044544e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:53.238436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5a0458ebf64b8498322f36a7f15b75'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.239033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72ebe3-0d23-4e1d-9da0-5085044544e7 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:53.246206 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5a0458ebf64b8498322f36a7f15b75'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.246934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5a0458ebf64b8498322f36a7f15b75'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.247553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5a0458ebf64b8498322f36a7f15b75'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.249356 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1096/2202] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:16:53.260725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5a0458ebf64b8498322f36a7f15b75'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.282603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1107/2203] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:53 2022] DELETE /identity/v3/users/5a5a0458ebf64b8498322f36a7f15b75 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:53.630210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72ebe3-0d23-4e1d-9da0-5085044544e7 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:53.646976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72ebe3-0d23-4e1d-9da0-5085044544e7 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:53.755019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:53.755881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:53.756219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:53.756503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] PATH_INFO: `/v3/projects/93579b41344a44bfa002122a36e9465f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:53.757732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93579b41344a44bfa002122a36e9465f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:53.759741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:53.822635 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93579b41344a44bfa002122a36e9465f', 'request_id': 'req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.829392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93579b41344a44bfa002122a36e9465f', 'request_id': 'req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.835630 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93579b41344a44bfa002122a36e9465f', 'request_id': 'req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.850702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] The token cache is being invalidate because project 93579b41344a44bfa002122a36e9465f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:53.850991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.851627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:53.853168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1097/2204] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:53 2022] DELETE /identity/v3/projects/93579b41344a44bfa002122a36e9465f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:53.857283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:53.858894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:53.872817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec5faf-3017-4f4e-a545-20819aad7f1c admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:53.933800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b779f4-9d86-4491-a311-0cd034dfd46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:53.934709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b779f4-9d86-4491-a311-0cd034dfd46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:53.934996 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b779f4-9d86-4491-a311-0cd034dfd46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:53.935274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b779f4-9d86-4491-a311-0cd034dfd46d admin admin] PATH_INFO: `/v3/users/e207d49e3c91455999b0c159c1861d26` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:53.936562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b779f4-9d86-4491-a311-0cd034dfd46d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e207d49e3c91455999b0c159c1861d26)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:53.938965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b779f4-9d86-4491-a311-0cd034dfd46d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:53.971945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:54.002217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-22b779f4-9d86-4491-a311-0cd034dfd46d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e207d49e3c91455999b0c159c1861d26'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.013703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-22b779f4-9d86-4491-a311-0cd034dfd46d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e207d49e3c91455999b0c159c1861d26'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.014633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-22b779f4-9d86-4491-a311-0cd034dfd46d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e207d49e3c91455999b0c159c1861d26'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.015242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-22b779f4-9d86-4491-a311-0cd034dfd46d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e207d49e3c91455999b0c159c1861d26'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.035999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-22b779f4-9d86-4491-a311-0cd034dfd46d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e207d49e3c91455999b0c159c1861d26'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.058267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1108/2205] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:53 2022] DELETE /identity/v3/users/e207d49e3c91455999b0c159c1861d26 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:54.080239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:54.082503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:54.100329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6d5d4-5bd1-4dac-989d-ab8e8522d017 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:54.153785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:54.168502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:54.169369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:54.169647 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:54.169917 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] PATH_INFO: `/v3/users/648bbc92a77c4883820f14de9dc1c2ea` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:54.171153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=648bbc92a77c4883820f14de9dc1c2ea)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:54.173657 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:54.225198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648bbc92a77c4883820f14de9dc1c2ea'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.232272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648bbc92a77c4883820f14de9dc1c2ea'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.241378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648bbc92a77c4883820f14de9dc1c2ea'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.242003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648bbc92a77c4883820f14de9dc1c2ea'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.242713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648bbc92a77c4883820f14de9dc1c2ea'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.263319 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1098/2206] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:54 2022] DELETE /identity/v3/users/648bbc92a77c4883820f14de9dc1c2ea => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:54.268124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad6515-6094-470b-bd7f-46673bc70af4 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:54.268578 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad6515-6094-470b-bd7f-46673bc70af4 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:54.268859 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad6515-6094-470b-bd7f-46673bc70af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:54.286781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-7aad6515-6094-470b-bd7f-46673bc70af4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:54.287985 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-7aad6515-6094-470b-bd7f-46673bc70af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:54.362475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1109/2207] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:54.375162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:54.377566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:54.435584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4604ec9-4e64-4dd9-8102-08f6bb58ce91 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:54.439989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933912a-36d5-404e-82a1-fa6a4a5f0a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:54.440633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933912a-36d5-404e-82a1-fa6a4a5f0a22 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:54.440917 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933912a-36d5-404e-82a1-fa6a4a5f0a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:54.441196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933912a-36d5-404e-82a1-fa6a4a5f0a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:54.450901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933912a-36d5-404e-82a1-fa6a4a5f0a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:54.452377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933912a-36d5-404e-82a1-fa6a4a5f0a22 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:54.462944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1099/2208] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:54.478996 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad6515-6094-470b-bd7f-46673bc70af4 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:54.480427 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-7aad6515-6094-470b-bd7f-46673bc70af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:54.493179 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad6515-6094-470b-bd7f-46673bc70af4 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:54.498290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4a53f-eb62-4907-8b7c-b86013e3972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:54.499505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a53f-eb62-4907-8b7c-b86013e3972c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:54.499952 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a53f-eb62-4907-8b7c-b86013e3972c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:54.500144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a53f-eb62-4907-8b7c-b86013e3972c admin admin] PATH_INFO: `/v3/projects/9903ce402abb4edea0abc5ee36449342` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:54.501638 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4a53f-eb62-4907-8b7c-b86013e3972c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9903ce402abb4edea0abc5ee36449342)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:54.503768 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4a53f-eb62-4907-8b7c-b86013e3972c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:54.560358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-5ad4a53f-eb62-4907-8b7c-b86013e3972c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9903ce402abb4edea0abc5ee36449342', 'request_id': 'req-5ad4a53f-eb62-4907-8b7c-b86013e3972c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.575823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-5ad4a53f-eb62-4907-8b7c-b86013e3972c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9903ce402abb4edea0abc5ee36449342', 'request_id': 'req-5ad4a53f-eb62-4907-8b7c-b86013e3972c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.583013 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-5ad4a53f-eb62-4907-8b7c-b86013e3972c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9903ce402abb4edea0abc5ee36449342', 'request_id': 'req-5ad4a53f-eb62-4907-8b7c-b86013e3972c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.593795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-5ad4a53f-eb62-4907-8b7c-b86013e3972c admin admin] The token cache is being invalidate because project 9903ce402abb4edea0abc5ee36449342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:54.595369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-5ad4a53f-eb62-4907-8b7c-b86013e3972c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.596056 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-5ad4a53f-eb62-4907-8b7c-b86013e3972c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.597641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1110/2209] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:54 2022] DELETE /identity/v3/projects/9903ce402abb4edea0abc5ee36449342 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:54.604659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b0c92-d7d7-44a0-830e-4d5db3f56d96 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:54.605093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b0c92-d7d7-44a0-830e-4d5db3f56d96 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:54.605378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b0c92-d7d7-44a0-830e-4d5db3f56d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:54.642518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-991b0c92-d7d7-44a0-830e-4d5db3f56d96 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:54.643800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-991b0c92-d7d7-44a0-830e-4d5db3f56d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:54.720144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1100/2210] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:54.727854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd663053-e0cb-4688-ab1d-5cd4c9a67002 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:54.728146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd663053-e0cb-4688-ab1d-5cd4c9a67002 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:54.728427 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd663053-e0cb-4688-ab1d-5cd4c9a67002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:54.763705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-dd663053-e0cb-4688-ab1d-5cd4c9a67002 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:54.764963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-dd663053-e0cb-4688-ab1d-5cd4c9a67002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:54.791281 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1111/2211] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:54.792658 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b0c92-d7d7-44a0-830e-4d5db3f56d96 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:54.805143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd663053-e0cb-4688-ab1d-5cd4c9a67002 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:54.807312 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b0c92-d7d7-44a0-830e-4d5db3f56d96 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:54.808624 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-dd663053-e0cb-4688-ab1d-5cd4c9a67002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:54.824158 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d361d-bb7a-4348-b419-d61cacf7e971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:54.824835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d361d-bb7a-4348-b419-d61cacf7e971 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:54.825377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d361d-bb7a-4348-b419-d61cacf7e971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:54.825658 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d361d-bb7a-4348-b419-d61cacf7e971 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:54.826422 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d361d-bb7a-4348-b419-d61cacf7e971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:54.826755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d361d-bb7a-4348-b419-d61cacf7e971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:54.828554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d361d-bb7a-4348-b419-d61cacf7e971 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:54.837470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:54.844063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd663053-e0cb-4688-ab1d-5cd4c9a67002 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:54.850216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:54.851247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:54.851610 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:54.851988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] PATH_INFO: `/v3/projects/c585299d93654063a0f5cb76b35da94c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:54.853635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c585299d93654063a0f5cb76b35da94c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:54.856393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:54.863916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1101/2212] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:16:54.866075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d361d-bb7a-4348-b419-d61cacf7e971 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:54.878204 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:54.887724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d361d-bb7a-4348-b419-d61cacf7e971 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:54.898827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660bb2e-66f4-4a19-a9d5-e1306ae8b272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:54.899850 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660bb2e-66f4-4a19-a9d5-e1306ae8b272 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:54.900294 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660bb2e-66f4-4a19-a9d5-e1306ae8b272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:54.900718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660bb2e-66f4-4a19-a9d5-e1306ae8b272 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:54.901449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660bb2e-66f4-4a19-a9d5-e1306ae8b272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:54.903860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660bb2e-66f4-4a19-a9d5-e1306ae8b272 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:54.933266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c585299d93654063a0f5cb76b35da94c', 'request_id': 'req-34e973c4-ef99-4c39-b08f-231235c005d5'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.945915 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c585299d93654063a0f5cb76b35da94c', 'request_id': 'req-34e973c4-ef99-4c39-b08f-231235c005d5'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.954003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c585299d93654063a0f5cb76b35da94c', 'request_id': 'req-34e973c4-ef99-4c39-b08f-231235c005d5'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.954973 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1102/2213] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:54 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:54.958075 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660bb2e-66f4-4a19-a9d5-e1306ae8b272 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:54.970612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] The token cache is being invalidate because project c585299d93654063a0f5cb76b35da94c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:54.971804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.973658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:54.977546 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1112/2214] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:54 2022] DELETE /identity/v3/projects/c585299d93654063a0f5cb76b35da94c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:54.981394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:54.983822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:55.066465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660bb2e-66f4-4a19-a9d5-e1306ae8b272 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:55.072804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe82cdc-4236-4e97-80a9-2a68d65cf391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:55.073106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e973c4-ef99-4c39-b08f-231235c005d5 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:55.073499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe82cdc-4236-4e97-80a9-2a68d65cf391 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:55.073787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe82cdc-4236-4e97-80a9-2a68d65cf391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:55.074063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe82cdc-4236-4e97-80a9-2a68d65cf391 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:55.074788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe82cdc-4236-4e97-80a9-2a68d65cf391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:55.076803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe82cdc-4236-4e97-80a9-2a68d65cf391 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:55.077846 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:55.079303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:55.079585 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:55.079864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] PATH_INFO: `/v3/users/e808604eb6cb4a9bbed829b22c5aacbb` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:55.081172 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e808604eb6cb4a9bbed829b22c5aacbb)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:55.083175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:55.102655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1103/2215] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:54 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:55.103720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe82cdc-4236-4e97-80a9-2a68d65cf391 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:55.105316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6fe82cdc-4236-4e97-80a9-2a68d65cf391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:55.119547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe82cdc-4236-4e97-80a9-2a68d65cf391 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:55.125133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5430b6-e96a-4802-93f9-0714a7bfa258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:55.126518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5430b6-e96a-4802-93f9-0714a7bfa258 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:55.126827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5430b6-e96a-4802-93f9-0714a7bfa258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:55.127128 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5430b6-e96a-4802-93f9-0714a7bfa258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:55.127903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5430b6-e96a-4802-93f9-0714a7bfa258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:55.129504 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5430b6-e96a-4802-93f9-0714a7bfa258 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:55.134832 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e808604eb6cb4a9bbed829b22c5aacbb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.142569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e808604eb6cb4a9bbed829b22c5aacbb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.143081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1104/2216] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:55.143586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e808604eb6cb4a9bbed829b22c5aacbb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.144361 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e808604eb6cb4a9bbed829b22c5aacbb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.146917 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5430b6-e96a-4802-93f9-0714a7bfa258 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:55.148535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fe5430b6-e96a-4802-93f9-0714a7bfa258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:55.156791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e808604eb6cb4a9bbed829b22c5aacbb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.160974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5430b6-e96a-4802-93f9-0714a7bfa258 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:55.166344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89e205-e7b8-468e-9d71-239baa7b53ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:55.167091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e205-e7b8-468e-9d71-239baa7b53ad admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:55.167471 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e205-e7b8-468e-9d71-239baa7b53ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:55.167779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e205-e7b8-468e-9d71-239baa7b53ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:55.168764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e205-e7b8-468e-9d71-239baa7b53ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:55.170386 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e205-e7b8-468e-9d71-239baa7b53ad admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:55.173929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1113/2217] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:54 2022] DELETE /identity/v3/users/e808604eb6cb4a9bbed829b22c5aacbb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:55.182814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1105/2218] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:55.187245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:55.215225 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:55.256626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971b43c-8a93-474d-963d-ef83b9870093 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:55.261862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210889d-4e86-4ffa-a3fc-f956bceb9974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:55.262870 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210889d-4e86-4ffa-a3fc-f956bceb9974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:55.263178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210889d-4e86-4ffa-a3fc-f956bceb9974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:55.263453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210889d-4e86-4ffa-a3fc-f956bceb9974 admin admin] PATH_INFO: `/v3/projects/cad2999c58284b92b7166848a3e1f261/users/8b54a55cff584d948b96c1c439e57eda/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:55.280556 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210889d-4e86-4ffa-a3fc-f956bceb9974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad2999c58284b92b7166848a3e1f261, user_id=8b54a55cff584d948b96c1c439e57eda, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:55.283252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210889d-4e86-4ffa-a3fc-f956bceb9974 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:55.298277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1114/2219] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:55 2022] PUT /identity/v3/projects/cad2999c58284b92b7166848a3e1f261/users/8b54a55cff584d948b96c1c439e57eda/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:55.304088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a16cfa-a20c-4002-8784-707c3343e586 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:55.304424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a16cfa-a20c-4002-8784-707c3343e586 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:55.304702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a16cfa-a20c-4002-8784-707c3343e586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:55.324064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-63a16cfa-a20c-4002-8784-707c3343e586 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:55.325268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-63a16cfa-a20c-4002-8784-707c3343e586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:55.404574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1106/2220] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:55.426047 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210889d-4e86-4ffa-a3fc-f956bceb9974 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:55.427859 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c210889d-4e86-4ffa-a3fc-f956bceb9974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:55.483641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a16cfa-a20c-4002-8784-707c3343e586 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:55.486119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-63a16cfa-a20c-4002-8784-707c3343e586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:55.500644 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a16cfa-a20c-4002-8784-707c3343e586 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:55.501999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210889d-4e86-4ffa-a3fc-f956bceb9974 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:55.506358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaf495-9e14-485d-9b5d-78a48b28be82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:55.507151 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaf495-9e14-485d-9b5d-78a48b28be82 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:55.507441 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaf495-9e14-485d-9b5d-78a48b28be82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:55.507717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaf495-9e14-485d-9b5d-78a48b28be82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:55.519283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aaf495-9e14-485d-9b5d-78a48b28be82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:55.520778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aaf495-9e14-485d-9b5d-78a48b28be82 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:55.524955 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:55.527260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:55.527547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:55.527829 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] PATH_INFO: `/v3/projects/4a178966eea949b0b14c01d566e67c20` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:55.529139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a178966eea949b0b14c01d566e67c20)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:55.531342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:55.538966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1115/2221] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:55.576074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:55.585139 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a178966eea949b0b14c01d566e67c20', 'request_id': 'req-93482dec-4243-418b-a945-8a6f820bed29'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.592573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a178966eea949b0b14c01d566e67c20', 'request_id': 'req-93482dec-4243-418b-a945-8a6f820bed29'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.598969 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a178966eea949b0b14c01d566e67c20', 'request_id': 'req-93482dec-4243-418b-a945-8a6f820bed29'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.612500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] The token cache is being invalidate because project 4a178966eea949b0b14c01d566e67c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:55.612792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.613463 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.615767 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1107/2222] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:55 2022] DELETE /identity/v3/projects/4a178966eea949b0b14c01d566e67c20 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:55.619619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaf495-9e14-485d-9b5d-78a48b28be82 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:55.631922 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaf495-9e14-485d-9b5d-78a48b28be82 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:55.694607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:55.695519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:55.695797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:55.696231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] PATH_INFO: `/v3/users/3c5da13270d24fae8a37c998a4dc90c6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:55.697488 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5da13270d24fae8a37c998a4dc90c6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:55.699458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:55.748723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5da13270d24fae8a37c998a4dc90c6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.751452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:55.757728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5da13270d24fae8a37c998a4dc90c6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.758491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5da13270d24fae8a37c998a4dc90c6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.759737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5da13270d24fae8a37c998a4dc90c6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.774408 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5da13270d24fae8a37c998a4dc90c6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:55.789273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1116/2223] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:55 2022] DELETE /identity/v3/users/3c5da13270d24fae8a37c998a4dc90c6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:56.160901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:56.162441 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:56.177771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93482dec-4243-418b-a945-8a6f820bed29 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:56.250836 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e93828-bb85-434d-af31-2089cae98910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:56.252353 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e93828-bb85-434d-af31-2089cae98910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:56.252723 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e93828-bb85-434d-af31-2089cae98910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:56.253112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e93828-bb85-434d-af31-2089cae98910 admin admin] PATH_INFO: `/v3/users/82f18e244efa4f139f88a232180f850c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:56.254701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e93828-bb85-434d-af31-2089cae98910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f18e244efa4f139f88a232180f850c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:56.256849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e93828-bb85-434d-af31-2089cae98910 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:56.349892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:56.351715 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:56.366569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdcd8d-1659-4dbf-8b74-37aebad5192e admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:56.372794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545582e4-52c5-4281-89b7-0851293a19ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:56.374601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545582e4-52c5-4281-89b7-0851293a19ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:56.374601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545582e4-52c5-4281-89b7-0851293a19ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:56.374929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545582e4-52c5-4281-89b7-0851293a19ef admin admin] PATH_INFO: `/v3/projects/48de0b42907d47e29245492a73bb11b4` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:56.376858 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545582e4-52c5-4281-89b7-0851293a19ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=48de0b42907d47e29245492a73bb11b4)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:56.378953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545582e4-52c5-4281-89b7-0851293a19ef admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:56.381657 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c4e93828-bb85-434d-af31-2089cae98910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f18e244efa4f139f88a232180f850c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:56.406427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c4e93828-bb85-434d-af31-2089cae98910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f18e244efa4f139f88a232180f850c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:56.420417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c4e93828-bb85-434d-af31-2089cae98910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f18e244efa4f139f88a232180f850c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:56.421482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c4e93828-bb85-434d-af31-2089cae98910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f18e244efa4f139f88a232180f850c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:56.422328 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c4e93828-bb85-434d-af31-2089cae98910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f18e244efa4f139f88a232180f850c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:56.473035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1108/2224] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:56 2022] DELETE /identity/v3/users/82f18e244efa4f139f88a232180f850c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:56.478130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca32b7-e470-4761-a2c7-2f842a4af27d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:56.478427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca32b7-e470-4761-a2c7-2f842a4af27d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:56.478724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-545582e4-52c5-4281-89b7-0851293a19ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48de0b42907d47e29245492a73bb11b4', 'request_id': 'req-545582e4-52c5-4281-89b7-0851293a19ef'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:56.478889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca32b7-e470-4761-a2c7-2f842a4af27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:56.489235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-545582e4-52c5-4281-89b7-0851293a19ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48de0b42907d47e29245492a73bb11b4', 'request_id': 'req-545582e4-52c5-4281-89b7-0851293a19ef'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:56.499465 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-545582e4-52c5-4281-89b7-0851293a19ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48de0b42907d47e29245492a73bb11b4', 'request_id': 'req-545582e4-52c5-4281-89b7-0851293a19ef'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:56.533145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-545582e4-52c5-4281-89b7-0851293a19ef admin admin] The token cache is being invalidate because project 48de0b42907d47e29245492a73bb11b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:56.533443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-545582e4-52c5-4281-89b7-0851293a19ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:56.535299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-545582e4-52c5-4281-89b7-0851293a19ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:56.538735 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1dca32b7-e470-4761-a2c7-2f842a4af27d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:56.539986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1dca32b7-e470-4761-a2c7-2f842a4af27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:56.544042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1117/2225] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:56 2022] DELETE /identity/v3/projects/48de0b42907d47e29245492a73bb11b4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:56.549828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420ec2e-5257-4c80-a9db-6d188d67520d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:56.550178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420ec2e-5257-4c80-a9db-6d188d67520d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:56.550462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420ec2e-5257-4c80-a9db-6d188d67520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:56.606827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f420ec2e-5257-4c80-a9db-6d188d67520d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:56.608430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f420ec2e-5257-4c80-a9db-6d188d67520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:56.628906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:56.653054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1109/2226] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:56.676146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca32b7-e470-4761-a2c7-2f842a4af27d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:56.680035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1dca32b7-e470-4761-a2c7-2f842a4af27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:56.742557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1118/2227] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:56.751794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366f471-3f6e-4218-9ac5-4ac2b7e6bf62 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:56.752224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366f471-3f6e-4218-9ac5-4ac2b7e6bf62 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:56.752515 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366f471-3f6e-4218-9ac5-4ac2b7e6bf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:56.792378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-4366f471-3f6e-4218-9ac5-4ac2b7e6bf62 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:56.793621 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4366f471-3f6e-4218-9ac5-4ac2b7e6bf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:56.816633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1119/2228] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:16:56.821817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366f471-3f6e-4218-9ac5-4ac2b7e6bf62 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:56.823335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca32b7-e470-4761-a2c7-2f842a4af27d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:56.833380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b069a-f24d-4d53-b406-8dac88efde7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:56.834756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366f471-3f6e-4218-9ac5-4ac2b7e6bf62 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:56.836073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b069a-f24d-4d53-b406-8dac88efde7e service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:56.836873 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b069a-f24d-4d53-b406-8dac88efde7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:56.837589 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b069a-f24d-4d53-b406-8dac88efde7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:56.848005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff780724-e904-4125-863a-0ff48f47ca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:56.848698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff780724-e904-4125-863a-0ff48f47ca79 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:56.849109 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff780724-e904-4125-863a-0ff48f47ca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:56.849396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff780724-e904-4125-863a-0ff48f47ca79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:56.850142 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff780724-e904-4125-863a-0ff48f47ca79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:56.850453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff780724-e904-4125-863a-0ff48f47ca79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:56.852105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff780724-e904-4125-863a-0ff48f47ca79 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:56.860938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b069a-f24d-4d53-b406-8dac88efde7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:56.864477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b069a-f24d-4d53-b406-8dac88efde7e service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:56.880307 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1120/2229] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:56.887740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff780724-e904-4125-863a-0ff48f47ca79 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:56.895377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1110/2230] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:16:56.913079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff780724-e904-4125-863a-0ff48f47ca79 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:56.922894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b040c-523e-47de-a435-1edcfc8012ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:56.924146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b040c-523e-47de-a435-1edcfc8012ae admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:56.924761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b040c-523e-47de-a435-1edcfc8012ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:56.925393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b040c-523e-47de-a435-1edcfc8012ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:56.926899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b040c-523e-47de-a435-1edcfc8012ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:56.931506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b040c-523e-47de-a435-1edcfc8012ae admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:56.983869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1121/2231] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:56 2022] POST /identity/v3/projects => generated 399 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:16:56.991025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b069a-f24d-4d53-b406-8dac88efde7e service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:57.018144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b069a-f24d-4d53-b406-8dac88efde7e service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:57.305350 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a214885-d8ea-47a0-b399-e85547b331fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:57.307851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a214885-d8ea-47a0-b399-e85547b331fc admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:57.310603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a214885-d8ea-47a0-b399-e85547b331fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:57.311633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a214885-d8ea-47a0-b399-e85547b331fc admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:57.312411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a214885-d8ea-47a0-b399-e85547b331fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:57.328286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a214885-d8ea-47a0-b399-e85547b331fc admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:57.408149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b040c-523e-47de-a435-1edcfc8012ae admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:57.409178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1111/2232] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:56 2022] POST /identity/v3/users => generated 300 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:57.437578 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b040c-523e-47de-a435-1edcfc8012ae admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:57.463196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e49e2-6d68-4074-8cb7-6c721090a59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:57.464077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e49e2-6d68-4074-8cb7-6c721090a59d admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:57.464429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e49e2-6d68-4074-8cb7-6c721090a59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:57.464771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e49e2-6d68-4074-8cb7-6c721090a59d admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:57.465632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e49e2-6d68-4074-8cb7-6c721090a59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:57.471597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e49e2-6d68-4074-8cb7-6c721090a59d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:57.476091 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:57.487822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1122/2233] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:57.491631 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a214885-d8ea-47a0-b399-e85547b331fc admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:57.506057 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a214885-d8ea-47a0-b399-e85547b331fc admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:57.511946 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bab98-a523-4d10-ac91-2a99db763dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:57.512971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bab98-a523-4d10-ac91-2a99db763dad admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:57.513253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bab98-a523-4d10-ac91-2a99db763dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:57.513526 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bab98-a523-4d10-ac91-2a99db763dad admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:57.514584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bab98-a523-4d10-ac91-2a99db763dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:57.517587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bab98-a523-4d10-ac91-2a99db763dad admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:57.530251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1112/2234] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:57.534226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e49e2-6d68-4074-8cb7-6c721090a59d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:57.545738 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e49e2-6d68-4074-8cb7-6c721090a59d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:57.550910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb5b1c-3181-4b00-8fba-f5e486f0fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:57.551998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb5b1c-3181-4b00-8fba-f5e486f0fa5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:57.552298 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb5b1c-3181-4b00-8fba-f5e486f0fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:57.552591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb5b1c-3181-4b00-8fba-f5e486f0fa5f admin admin] PATH_INFO: `/v3/projects/489e96467be04540a9016f0eb8256567/users/b6e7be8957194d4293a990a1fba73215/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:57.574896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb5b1c-3181-4b00-8fba-f5e486f0fa5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=489e96467be04540a9016f0eb8256567, user_id=b6e7be8957194d4293a990a1fba73215, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:57.577886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb5b1c-3181-4b00-8fba-f5e486f0fa5f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:57.600947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1123/2235] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:57 2022] PUT /identity/v3/projects/489e96467be04540a9016f0eb8256567/users/b6e7be8957194d4293a990a1fba73215/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:16:57.612293 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3707bcc-0d96-460f-894f-57b50397657b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:57.612721 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3707bcc-0d96-460f-894f-57b50397657b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:57.613065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3707bcc-0d96-460f-894f-57b50397657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:57.662213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c3707bcc-0d96-460f-894f-57b50397657b None None] MFA Rules not processed for user `b6e7be8957194d4293a990a1fba73215`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:57.663566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c3707bcc-0d96-460f-894f-57b50397657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:57.743229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:57.758465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1113/2236] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:57.768467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb5b1c-3181-4b00-8fba-f5e486f0fa5f admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:57.771124 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-29cb5b1c-3181-4b00-8fba-f5e486f0fa5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:57.905477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb5b1c-3181-4b00-8fba-f5e486f0fa5f admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:57.915073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75549138-ae05-4b12-9ea8-a7afe08ef04c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:57.915804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75549138-ae05-4b12-9ea8-a7afe08ef04c service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:57.916155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75549138-ae05-4b12-9ea8-a7afe08ef04c service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:57.916439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75549138-ae05-4b12-9ea8-a7afe08ef04c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:57.940652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75549138-ae05-4b12-9ea8-a7afe08ef04c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:57.942128 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75549138-ae05-4b12-9ea8-a7afe08ef04c service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:57.962636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1124/2237] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:16:58.081655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3707bcc-0d96-460f-894f-57b50397657b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:58.083397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c3707bcc-0d96-460f-894f-57b50397657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:58.222848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3707bcc-0d96-460f-894f-57b50397657b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:58.225742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:58.226598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:58.226909 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:58.227375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e admin admin] PATH_INFO: `/v3/projects/8eb5b190f1b0422b96dcda6d2a08abdc` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:58.228467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb5b190f1b0422b96dcda6d2a08abdc)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:58.232345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:58.317222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb5b190f1b0422b96dcda6d2a08abdc', 'request_id': 'req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:58.324801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb5b190f1b0422b96dcda6d2a08abdc', 'request_id': 'req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:58.332481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb5b190f1b0422b96dcda6d2a08abdc', 'request_id': 'req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:58.354512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e admin admin] The token cache is being invalidate because project 8eb5b190f1b0422b96dcda6d2a08abdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:16:58.354853 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:58.355553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c9e9a608-f27d-451d-a1fd-ebe7f54d579e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:16:58.357628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1114/2238] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:16:58 2022] DELETE /identity/v3/projects/8eb5b190f1b0422b96dcda6d2a08abdc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:58.366383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a42989-8005-4826-9cc3-2f3730c4cf90 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:58.366723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a42989-8005-4826-9cc3-2f3730c4cf90 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:58.366975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a42989-8005-4826-9cc3-2f3730c4cf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:58.390603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-06a42989-8005-4826-9cc3-2f3730c4cf90 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:58.392338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-06a42989-8005-4826-9cc3-2f3730c4cf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:58.691623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1125/2239] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:58.698786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf12722-5ef1-4e9c-82eb-e24c58ece2de None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:58.699095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf12722-5ef1-4e9c-82eb-e24c58ece2de None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:58.699362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf12722-5ef1-4e9c-82eb-e24c58ece2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:58.732918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ddf12722-5ef1-4e9c-82eb-e24c58ece2de None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:58.732918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ddf12722-5ef1-4e9c-82eb-e24c58ece2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:58.760351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1115/2240] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:58.769433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a42989-8005-4826-9cc3-2f3730c4cf90 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:58.784862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a42989-8005-4826-9cc3-2f3730c4cf90 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:58.792503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532549e-2f1a-4288-8820-a21f2165a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:58.793581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532549e-2f1a-4288-8820-a21f2165a4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:58.794122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532549e-2f1a-4288-8820-a21f2165a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:58.794669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532549e-2f1a-4288-8820-a21f2165a4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:58.795626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532549e-2f1a-4288-8820-a21f2165a4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:16:58.797348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532549e-2f1a-4288-8820-a21f2165a4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:58.806105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532549e-2f1a-4288-8820-a21f2165a4e7 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:58.824788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1126/2241] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:16:58.829231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf12722-5ef1-4e9c-82eb-e24c58ece2de None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:58.841094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf12722-5ef1-4e9c-82eb-e24c58ece2de None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:58.846890 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcf22e-99c5-4882-a275-400e5b9b3080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:58.847576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcf22e-99c5-4882-a275-400e5b9b3080 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:58.847896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcf22e-99c5-4882-a275-400e5b9b3080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:58.848137 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcf22e-99c5-4882-a275-400e5b9b3080 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:58.848827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcf22e-99c5-4882-a275-400e5b9b3080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:58.850846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcf22e-99c5-4882-a275-400e5b9b3080 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:58.897046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532549e-2f1a-4288-8820-a21f2165a4e7 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:58.897481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1116/2242] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:16:58 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:58.908309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532549e-2f1a-4288-8820-a21f2165a4e7 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:59.010439 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb676b-cf86-40d6-91d5-17a461a2e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:59.012436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb676b-cf86-40d6-91d5-17a461a2e936 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:59.013104 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb676b-cf86-40d6-91d5-17a461a2e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:59.013555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb676b-cf86-40d6-91d5-17a461a2e936 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:59.015026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb676b-cf86-40d6-91d5-17a461a2e936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:59.018760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb676b-cf86-40d6-91d5-17a461a2e936 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:59.033552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:59.066074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1127/2243] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:16:58 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:16:59.070680 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcf22e-99c5-4882-a275-400e5b9b3080 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:59.084033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcf22e-99c5-4882-a275-400e5b9b3080 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:59.097956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95f82a-362e-4072-a938-09dee6aae744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:59.098976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95f82a-362e-4072-a938-09dee6aae744 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:59.098976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95f82a-362e-4072-a938-09dee6aae744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:59.099169 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95f82a-362e-4072-a938-09dee6aae744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:59.099907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95f82a-362e-4072-a938-09dee6aae744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:59.101525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95f82a-362e-4072-a938-09dee6aae744 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:59.129733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1117/2244] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:16:59.133569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb676b-cf86-40d6-91d5-17a461a2e936 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:59.145678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb676b-cf86-40d6-91d5-17a461a2e936 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:59.152852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f447b-27a4-41d4-b1c8-de021452b9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:59.153967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f447b-27a4-41d4-b1c8-de021452b9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:59.154354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f447b-27a4-41d4-b1c8-de021452b9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:59.154761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f447b-27a4-41d4-b1c8-de021452b9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:59.156180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f447b-27a4-41d4-b1c8-de021452b9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:59.158060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f447b-27a4-41d4-b1c8-de021452b9ef admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:59.173403 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1128/2245] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:16:59.176904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95f82a-362e-4072-a938-09dee6aae744 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:59.189472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95f82a-362e-4072-a938-09dee6aae744 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:59.196979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2bcce-95c1-4d3c-b0ee-f3663cd9122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:59.200927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bcce-95c1-4d3c-b0ee-f3663cd9122c admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:59.200927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bcce-95c1-4d3c-b0ee-f3663cd9122c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:59.200927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bcce-95c1-4d3c-b0ee-f3663cd9122c admin admin] PATH_INFO: `/v3/projects/8daefbd914cc45a58999c6334c4e526f/users/260fa9798af6456087bb20bff53b9192/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:59.227116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2bcce-95c1-4d3c-b0ee-f3663cd9122c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8daefbd914cc45a58999c6334c4e526f, user_id=260fa9798af6456087bb20bff53b9192, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:59.230158 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2bcce-95c1-4d3c-b0ee-f3663cd9122c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:59.255409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1118/2246] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:16:59 2022] PUT /identity/v3/projects/8daefbd914cc45a58999c6334c4e526f/users/260fa9798af6456087bb20bff53b9192/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:16:59.266815 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07b95b-90f1-46cb-a514-4dece15c945d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:59.273096 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07b95b-90f1-46cb-a514-4dece15c945d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:59.273445 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07b95b-90f1-46cb-a514-4dece15c945d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:59.310758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-6b07b95b-90f1-46cb-a514-4dece15c945d None None] MFA Rules not processed for user `260fa9798af6456087bb20bff53b9192`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:59.312310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6b07b95b-90f1-46cb-a514-4dece15c945d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:59.338280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431afdd-c19a-434e-9822-68fb5a99d92e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:59.338852 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431afdd-c19a-434e-9822-68fb5a99d92e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:59.338852 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431afdd-c19a-434e-9822-68fb5a99d92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:59.362052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1431afdd-c19a-434e-9822-68fb5a99d92e None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:16:59.364236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1431afdd-c19a-434e-9822-68fb5a99d92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:59.395338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:59.402670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1129/2247] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:16:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:59.417402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07b95b-90f1-46cb-a514-4dece15c945d None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:59.418929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6b07b95b-90f1-46cb-a514-4dece15c945d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:59.470323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1119/2248] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:16:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:16:59.525910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431afdd-c19a-434e-9822-68fb5a99d92e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:59.527529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1431afdd-c19a-434e-9822-68fb5a99d92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:16:59.533451 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07b95b-90f1-46cb-a514-4dece15c945d None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:59.540228 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a949a-e2c5-4bfd-9df3-edfb3f1bb4c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:59.540951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a949a-e2c5-4bfd-9df3-edfb3f1bb4c3 service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:59.541299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a949a-e2c5-4bfd-9df3-edfb3f1bb4c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:59.541639 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a949a-e2c5-4bfd-9df3-edfb3f1bb4c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:59.551988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a949a-e2c5-4bfd-9df3-edfb3f1bb4c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:59.553732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a949a-e2c5-4bfd-9df3-edfb3f1bb4c3 service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:59.574083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1130/2249] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:16:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:16:59.640135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431afdd-c19a-434e-9822-68fb5a99d92e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:59.648298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e67137-9306-4e7e-8a75-ec4837fafaab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:59.649799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e67137-9306-4e7e-8a75-ec4837fafaab service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:59.650256 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e67137-9306-4e7e-8a75-ec4837fafaab service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:59.650553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e67137-9306-4e7e-8a75-ec4837fafaab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:59.664578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e67137-9306-4e7e-8a75-ec4837fafaab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:59.666636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e67137-9306-4e7e-8a75-ec4837fafaab service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:16:59.679481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1120/2250] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:16:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 08:16:59.854180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a949a-e2c5-4bfd-9df3-edfb3f1bb4c3 service nova] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:16:59.952217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:16:59.968171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a949a-e2c5-4bfd-9df3-edfb3f1bb4c3 service nova] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:16:59.980734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:16:59.983362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:16:59.983660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:16:59.983938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] PATH_INFO: `/v3/users/260fa9798af6456087bb20bff53b9192` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:16:59.990484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] RBAC: Authorizing `identity:delete_user(user_id=260fa9798af6456087bb20bff53b9192)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:16:59.992543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:00.137000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260fa9798af6456087bb20bff53b9192'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:00.186259 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260fa9798af6456087bb20bff53b9192'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:00.188814 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260fa9798af6456087bb20bff53b9192'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:00.189440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260fa9798af6456087bb20bff53b9192'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:00.258126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260fa9798af6456087bb20bff53b9192'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:00.291411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1131/2251] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:16:59 2022] DELETE /identity/v3/users/260fa9798af6456087bb20bff53b9192 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:17:00.296141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4941c5d-d568-4bcd-a1a9-79f4fc0fa8e3 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:00.297468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4941c5d-d568-4bcd-a1a9-79f4fc0fa8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:00.297762 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4941c5d-d568-4bcd-a1a9-79f4fc0fa8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:00.381087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d4941c5d-d568-4bcd-a1a9-79f4fc0fa8e3 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:00.382341 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d4941c5d-d568-4bcd-a1a9-79f4fc0fa8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:00.484362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1121/2252] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:00.495054 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:00.497440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:00.608301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235c18d-9d45-48a7-8704-4aed43f90957 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:00.608582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235c18d-9d45-48a7-8704-4aed43f90957 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:00.609052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235c18d-9d45-48a7-8704-4aed43f90957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:00.649203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9235c18d-9d45-48a7-8704-4aed43f90957 None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:00.651283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9235c18d-9d45-48a7-8704-4aed43f90957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:00.656743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f4fe-8737-4bd0-87bc-d671c5fdb86d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:00.675133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638667ed-3889-476e-9a8e-a39f08aacd2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:00.679399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638667ed-3889-476e-9a8e-a39f08aacd2a service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:00.679926 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638667ed-3889-476e-9a8e-a39f08aacd2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:00.680348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638667ed-3889-476e-9a8e-a39f08aacd2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:00.706750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638667ed-3889-476e-9a8e-a39f08aacd2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:00.708085 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638667ed-3889-476e-9a8e-a39f08aacd2a service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:00.730215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1132/2253] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:17:00.764604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1122/2254] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 21 08:17:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:17:00.779242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638667ed-3889-476e-9a8e-a39f08aacd2a service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:00.781157 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-638667ed-3889-476e-9a8e-a39f08aacd2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:00.878932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638667ed-3889-476e-9a8e-a39f08aacd2a service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:00.887140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1217d-4e63-4a14-a91f-63c423fe9d1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:00.887927 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1217d-4e63-4a14-a91f-63c423fe9d1d service swift] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:00.888309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1217d-4e63-4a14-a91f-63c423fe9d1d service swift] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:00.888951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1217d-4e63-4a14-a91f-63c423fe9d1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:00.902436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1217d-4e63-4a14-a91f-63c423fe9d1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:00.904294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1217d-4e63-4a14-a91f-63c423fe9d1d service swift] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:00.919634 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1133/2255] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:17:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:17:01.302224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793bade-89c4-469d-a0e9-6552f066de08 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:01.302513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793bade-89c4-469d-a0e9-6552f066de08 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:01.302830 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793bade-89c4-469d-a0e9-6552f066de08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:01.312270 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:01.328232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9793bade-89c4-469d-a0e9-6552f066de08 None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:01.339529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9793bade-89c4-469d-a0e9-6552f066de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:01.356843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1123/2256] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:17:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:01.366239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1217d-4e63-4a14-a91f-63c423fe9d1d service swift] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:01.379354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1217d-4e63-4a14-a91f-63c423fe9d1d service swift] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:01.391551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab56867-9d79-4012-846c-4054198f6f1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:01.392760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab56867-9d79-4012-846c-4054198f6f1a service swift] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:01.392883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab56867-9d79-4012-846c-4054198f6f1a service swift] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:01.393661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab56867-9d79-4012-846c-4054198f6f1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:01.402803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:01.409230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab56867-9d79-4012-846c-4054198f6f1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:01.411830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab56867-9d79-4012-846c-4054198f6f1a service swift] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:01.426856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1134/2257] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:17:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:17:01.496170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793bade-89c4-469d-a0e9-6552f066de08 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:01.499509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9793bade-89c4-469d-a0e9-6552f066de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:01.529021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793bade-89c4-469d-a0e9-6552f066de08 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:01.542359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a07b0-e062-45a8-a565-5de21a709f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:01.543777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a07b0-e062-45a8-a565-5de21a709f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:01.544324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a07b0-e062-45a8-a565-5de21a709f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:01.544613 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a07b0-e062-45a8-a565-5de21a709f65 admin admin] PATH_INFO: `/v3/projects/8daefbd914cc45a58999c6334c4e526f` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:01.546146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a07b0-e062-45a8-a565-5de21a709f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8daefbd914cc45a58999c6334c4e526f)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:01.548723 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a07b0-e062-45a8-a565-5de21a709f65 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:01.627833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-347a07b0-e062-45a8-a565-5de21a709f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8daefbd914cc45a58999c6334c4e526f', 'request_id': 'req-347a07b0-e062-45a8-a565-5de21a709f65'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:01.636023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-347a07b0-e062-45a8-a565-5de21a709f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8daefbd914cc45a58999c6334c4e526f', 'request_id': 'req-347a07b0-e062-45a8-a565-5de21a709f65'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:01.647053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-347a07b0-e062-45a8-a565-5de21a709f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8daefbd914cc45a58999c6334c4e526f', 'request_id': 'req-347a07b0-e062-45a8-a565-5de21a709f65'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:01.674433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-347a07b0-e062-45a8-a565-5de21a709f65 admin admin] The token cache is being invalidate because project 8daefbd914cc45a58999c6334c4e526f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:17:01.674766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-347a07b0-e062-45a8-a565-5de21a709f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:01.675707 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-347a07b0-e062-45a8-a565-5de21a709f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:01.677714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1124/2258] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:17:01 2022] DELETE /identity/v3/projects/8daefbd914cc45a58999c6334c4e526f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:01.684220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7310e-4419-4657-9733-7dce55d7fd66 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:01.686654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7310e-4419-4657-9733-7dce55d7fd66 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:01.688037 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7310e-4419-4657-9733-7dce55d7fd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:01.712347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f5a7310e-4419-4657-9733-7dce55d7fd66 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:01.714016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f5a7310e-4419-4657-9733-7dce55d7fd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:01.834950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1135/2259] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:01.837126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0f17-7faf-4381-8672-fd1698c73a95 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:01.837494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0f17-7faf-4381-8672-fd1698c73a95 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:01.837772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0f17-7faf-4381-8672-fd1698c73a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:01.862302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-882a0f17-7faf-4381-8672-fd1698c73a95 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:01.864210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-882a0f17-7faf-4381-8672-fd1698c73a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:01.874587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1125/2260] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:17:01.879988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7310e-4419-4657-9733-7dce55d7fd66 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:01.902732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7310e-4419-4657-9733-7dce55d7fd66 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:01.910851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e54566-5990-4f8d-a333-4aa031d3a54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:01.912760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e54566-5990-4f8d-a333-4aa031d3a54d admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:01.913423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e54566-5990-4f8d-a333-4aa031d3a54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:01.913891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e54566-5990-4f8d-a333-4aa031d3a54d admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:01.915621 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e54566-5990-4f8d-a333-4aa031d3a54d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:17:01.916114 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e54566-5990-4f8d-a333-4aa031d3a54d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:01.918011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e54566-5990-4f8d-a333-4aa031d3a54d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:01.951405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1136/2261] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:17:01.952363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a0f17-7faf-4381-8672-fd1698c73a95 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:01.963371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a0f17-7faf-4381-8672-fd1698c73a95 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:01.977758 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b171262-eb4a-48a6-86da-e664beb7b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:01.979117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b171262-eb4a-48a6-86da-e664beb7b5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:01.979552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b171262-eb4a-48a6-86da-e664beb7b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:01.979849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b171262-eb4a-48a6-86da-e664beb7b5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:01.980745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b171262-eb4a-48a6-86da-e664beb7b5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:01.982701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b171262-eb4a-48a6-86da-e664beb7b5a8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:02.028670 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1126/2262] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:17:01 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:02.033356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e54566-5990-4f8d-a333-4aa031d3a54d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:02.074732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e54566-5990-4f8d-a333-4aa031d3a54d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:02.124824 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2539a46-2280-45a3-a2e5-09e7df585e14 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:02.125284 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2539a46-2280-45a3-a2e5-09e7df585e14 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:02.125634 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2539a46-2280-45a3-a2e5-09e7df585e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:02.150134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c2539a46-2280-45a3-a2e5-09e7df585e14 None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:02.151850 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c2539a46-2280-45a3-a2e5-09e7df585e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:02.198565 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb43bcb-f8ec-4d47-9355-4445525884f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:02.199389 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb43bcb-f8ec-4d47-9355-4445525884f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:02.199681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb43bcb-f8ec-4d47-9355-4445525884f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:02.199964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb43bcb-f8ec-4d47-9355-4445525884f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:02.200670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb43bcb-f8ec-4d47-9355-4445525884f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:02.202692 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb43bcb-f8ec-4d47-9355-4445525884f9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:02.242058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1127/2263] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 21 08:17:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:17:02.254348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1137/2264] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:17:02 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:02.257733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb43bcb-f8ec-4d47-9355-4445525884f9 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:02.261063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8b4bf-af78-4de2-94f8-be96b743b6d5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:02.261699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8b4bf-af78-4de2-94f8-be96b743b6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:02.261699 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8b4bf-af78-4de2-94f8-be96b743b6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:02.272827 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb43bcb-f8ec-4d47-9355-4445525884f9 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:02.277886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e60a4b-4ef4-4ec1-a27d-a4f46366141f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:02.278676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e60a4b-4ef4-4ec1-a27d-a4f46366141f admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:02.279129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e60a4b-4ef4-4ec1-a27d-a4f46366141f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:02.279501 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e60a4b-4ef4-4ec1-a27d-a4f46366141f admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:02.280418 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e60a4b-4ef4-4ec1-a27d-a4f46366141f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:02.283487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e60a4b-4ef4-4ec1-a27d-a4f46366141f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:02.294709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f1d8b4bf-af78-4de2-94f8-be96b743b6d5 None None] MFA Rules not processed for user `8b54a55cff584d948b96c1c439e57eda`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:02.295232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1138/2265] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:17:02.296419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f1d8b4bf-af78-4de2-94f8-be96b743b6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:02.299804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e60a4b-4ef4-4ec1-a27d-a4f46366141f admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:02.301595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-29e60a4b-4ef4-4ec1-a27d-a4f46366141f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:02.380465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:02.411252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:02.415395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1128/2266] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:02.416460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8b4bf-af78-4de2-94f8-be96b743b6d5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:02.420764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e60a4b-4ef4-4ec1-a27d-a4f46366141f admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:02.428320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8b4bf-af78-4de2-94f8-be96b743b6d5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:02.431609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9fe36-c59c-4d78-834f-cbf5c119604d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:02.432424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9fe36-c59c-4d78-834f-cbf5c119604d service swift] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:02.435102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9fe36-c59c-4d78-834f-cbf5c119604d service swift] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:02.435406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9fe36-c59c-4d78-834f-cbf5c119604d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:02.437339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f03a1-7c1a-4a14-8d95-a2a62950b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:02.444729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f03a1-7c1a-4a14-8d95-a2a62950b409 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:02.444729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f03a1-7c1a-4a14-8d95-a2a62950b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:02.444729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f03a1-7c1a-4a14-8d95-a2a62950b409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:02.444729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f03a1-7c1a-4a14-8d95-a2a62950b409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:02.444729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f03a1-7c1a-4a14-8d95-a2a62950b409 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:02.467940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1129/2267] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:17:02.473091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f03a1-7c1a-4a14-8d95-a2a62950b409 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:02.475717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5e3f03a1-7c1a-4a14-8d95-a2a62950b409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:02.478874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9fe36-c59c-4d78-834f-cbf5c119604d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:02.480476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9fe36-c59c-4d78-834f-cbf5c119604d service swift] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:02.491497 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f03a1-7c1a-4a14-8d95-a2a62950b409 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:02.497644 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b07a78-e2dd-4ae0-9cc0-4fd0f76984f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:02.498275 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b07a78-e2dd-4ae0-9cc0-4fd0f76984f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:02.498552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b07a78-e2dd-4ae0-9cc0-4fd0f76984f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:02.499236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1139/2268] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:17:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:17:02.499529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b07a78-e2dd-4ae0-9cc0-4fd0f76984f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:02.500201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9fe36-c59c-4d78-834f-cbf5c119604d service swift] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:02.500743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b07a78-e2dd-4ae0-9cc0-4fd0f76984f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:02.504689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b07a78-e2dd-4ae0-9cc0-4fd0f76984f4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:02.525805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9fe36-c59c-4d78-834f-cbf5c119604d service swift] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:02.536984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67ace0-afbb-460d-a00f-6683f4a1fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:02.537969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67ace0-afbb-460d-a00f-6683f4a1fc3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:02.538307 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67ace0-afbb-460d-a00f-6683f4a1fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:02.538581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67ace0-afbb-460d-a00f-6683f4a1fc3e admin admin] PATH_INFO: `/v3/projects/62a26a8b7cef414488dbc6ef1933b7e3/users/f2d74ed5a1534d13956a6950be7a9814/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:02.566168 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1130/2269] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:17:02 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:02.570916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b07a78-e2dd-4ae0-9cc0-4fd0f76984f4 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:02.592149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67ace0-afbb-460d-a00f-6683f4a1fc3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a26a8b7cef414488dbc6ef1933b7e3, user_id=f2d74ed5a1534d13956a6950be7a9814, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:02.598394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67ace0-afbb-460d-a00f-6683f4a1fc3e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:02.619942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1140/2270] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:17:02 2022] PUT /identity/v3/projects/62a26a8b7cef414488dbc6ef1933b7e3/users/f2d74ed5a1534d13956a6950be7a9814/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:02.636426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df549f58-d8d2-4232-9203-862a72b48dee None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:02.636728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df549f58-d8d2-4232-9203-862a72b48dee None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:02.637579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df549f58-d8d2-4232-9203-862a72b48dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:02.663752 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b07a78-e2dd-4ae0-9cc0-4fd0f76984f4 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:02.694403 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-df549f58-d8d2-4232-9203-862a72b48dee None None] MFA Rules not processed for user `f2d74ed5a1534d13956a6950be7a9814`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:02.695834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-df549f58-d8d2-4232-9203-862a72b48dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:02.769104 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a97b0-cda0-499c-951d-b5d494617325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:02.770287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a97b0-cda0-499c-951d-b5d494617325 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:02.770987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a97b0-cda0-499c-951d-b5d494617325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:02.770987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a97b0-cda0-499c-951d-b5d494617325 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:02.772012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a97b0-cda0-499c-951d-b5d494617325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:02.774122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a97b0-cda0-499c-951d-b5d494617325 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:02.808880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1141/2271] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:02.814884 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df549f58-d8d2-4232-9203-862a72b48dee None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:02.835839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df549f58-d8d2-4232-9203-862a72b48dee None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:02.842760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3793dd-c17a-44c2-ae06-175357ffc9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:02.843998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3793dd-c17a-44c2-ae06-175357ffc9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:02.844749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1131/2272] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:17:02 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:02.845281 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3793dd-c17a-44c2-ae06-175357ffc9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:02.846723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3793dd-c17a-44c2-ae06-175357ffc9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:02.847606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3793dd-c17a-44c2-ae06-175357ffc9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:02.849559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3793dd-c17a-44c2-ae06-175357ffc9e2 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:02.851989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a97b0-cda0-499c-951d-b5d494617325 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:02.863844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a97b0-cda0-499c-951d-b5d494617325 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:02.868923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ea007-e38e-450b-9c17-500da5e0a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:02.869597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ea007-e38e-450b-9c17-500da5e0a3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:02.870018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ea007-e38e-450b-9c17-500da5e0a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:02.870290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ea007-e38e-450b-9c17-500da5e0a3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:02.871205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ea007-e38e-450b-9c17-500da5e0a3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:02.873237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ea007-e38e-450b-9c17-500da5e0a3a6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:02.893975 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1132/2274] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:17:02.894680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1142/2273] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:17:02 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:02.895113 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ea007-e38e-450b-9c17-500da5e0a3a6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:02.897749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3793dd-c17a-44c2-ae06-175357ffc9e2 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:02.907051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ea007-e38e-450b-9c17-500da5e0a3a6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:02.999316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:03.030380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253b6f2-c338-4d70-a796-ae71b2c66d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:03.031100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b6f2-c338-4d70-a796-ae71b2c66d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:03.032035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b6f2-c338-4d70-a796-ae71b2c66d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:03.032818 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b6f2-c338-4d70-a796-ae71b2c66d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:03.032916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253b6f2-c338-4d70-a796-ae71b2c66d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:03.035125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253b6f2-c338-4d70-a796-ae71b2c66d45 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:03.068397 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3793dd-c17a-44c2-ae06-175357ffc9e2 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:03.070767 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1133/2275] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:17:02 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:03.071690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253b6f2-c338-4d70-a796-ae71b2c66d45 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:03.075694 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2523444-7321-4b7f-a443-0cb40004e3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:03.076945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2523444-7321-4b7f-a443-0cb40004e3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:03.077791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2523444-7321-4b7f-a443-0cb40004e3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:03.079925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2523444-7321-4b7f-a443-0cb40004e3b8 admin admin] PATH_INFO: `/v3/projects/cf638c040b9e493e8f167d852dd0cfde/users/44de390119624cbc944b5bd7794528ce/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:03.092858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253b6f2-c338-4d70-a796-ae71b2c66d45 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:03.101794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2523444-7321-4b7f-a443-0cb40004e3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf638c040b9e493e8f167d852dd0cfde, user_id=44de390119624cbc944b5bd7794528ce, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:03.105125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2523444-7321-4b7f-a443-0cb40004e3b8 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:03.108393 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11371c99-42ba-419e-84c2-32a41fe59519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:03.109072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11371c99-42ba-419e-84c2-32a41fe59519 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:03.109392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11371c99-42ba-419e-84c2-32a41fe59519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:03.110188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11371c99-42ba-419e-84c2-32a41fe59519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:03.111171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11371c99-42ba-419e-84c2-32a41fe59519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:03.112853 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11371c99-42ba-419e-84c2-32a41fe59519 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:03.126430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1143/2276] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:17:02 2022] PUT /identity/v3/projects/cf638c040b9e493e8f167d852dd0cfde/users/44de390119624cbc944b5bd7794528ce/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:03.131844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2523444-7321-4b7f-a443-0cb40004e3b8 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:03.133461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1134/2277] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:17:03.135527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11371c99-42ba-419e-84c2-32a41fe59519 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:03.149387 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11371c99-42ba-419e-84c2-32a41fe59519 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:03.157311 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:03.228302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2523444-7321-4b7f-a443-0cb40004e3b8 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:03.233197 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca375a11-ba70-4172-9f42-22018cba2a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:03.233903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca375a11-ba70-4172-9f42-22018cba2a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:03.234188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca375a11-ba70-4172-9f42-22018cba2a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:03.234529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca375a11-ba70-4172-9f42-22018cba2a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:03.235387 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca375a11-ba70-4172-9f42-22018cba2a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:03.237067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca375a11-ba70-4172-9f42-22018cba2a83 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:03.248397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773f9ea-4cb6-475c-8afb-0cb3c1788560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:03.249604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773f9ea-4cb6-475c-8afb-0cb3c1788560 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:03.249875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773f9ea-4cb6-475c-8afb-0cb3c1788560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:03.250736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773f9ea-4cb6-475c-8afb-0cb3c1788560 admin admin] PATH_INFO: `/v3/projects/a955774d48a64a749fa84e6035d0e4d3/users/dc01aef87efc4e2b80c68a75bd69570e/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:03.262813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1144/2278] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:17:03.264580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca375a11-ba70-4172-9f42-22018cba2a83 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:03.273171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773f9ea-4cb6-475c-8afb-0cb3c1788560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a955774d48a64a749fa84e6035d0e4d3, user_id=dc01aef87efc4e2b80c68a75bd69570e, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:03.276785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773f9ea-4cb6-475c-8afb-0cb3c1788560 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:03.281121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca375a11-ba70-4172-9f42-22018cba2a83 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:03.291466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48649a-0340-4eae-bf3e-05c60635737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:03.292777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48649a-0340-4eae-bf3e-05c60635737f admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:03.293074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48649a-0340-4eae-bf3e-05c60635737f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:03.293478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48649a-0340-4eae-bf3e-05c60635737f admin admin] PATH_INFO: `/v3/projects/cf638c040b9e493e8f167d852dd0cfde/users/44de390119624cbc944b5bd7794528ce/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:03.298023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1135/2279] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:17:03 2022] PUT /identity/v3/projects/a955774d48a64a749fa84e6035d0e4d3/users/dc01aef87efc4e2b80c68a75bd69570e/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:03.298169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48649a-0340-4eae-bf3e-05c60635737f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf638c040b9e493e8f167d852dd0cfde, user_id=44de390119624cbc944b5bd7794528ce, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:03.299292 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48649a-0340-4eae-bf3e-05c60635737f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:03.299408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773f9ea-4cb6-475c-8afb-0cb3c1788560 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:03.364007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1145/2280] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:17:03 2022] PUT /identity/v3/projects/cf638c040b9e493e8f167d852dd0cfde/users/44de390119624cbc944b5bd7794528ce/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:17:03.418674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773f9ea-4cb6-475c-8afb-0cb3c1788560 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:03.516889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:03.537804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff6612-c68a-45f6-9749-edc8866b2c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:03.538603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff6612-c68a-45f6-9749-edc8866b2c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:03.539089 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff6612-c68a-45f6-9749-edc8866b2c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:03.543875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff6612-c68a-45f6-9749-edc8866b2c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:03.544768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff6612-c68a-45f6-9749-edc8866b2c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:03.548609 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff6612-c68a-45f6-9749-edc8866b2c8b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:03.570985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1136/2281] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:17:03.575521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48649a-0340-4eae-bf3e-05c60635737f admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:03.603822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48649a-0340-4eae-bf3e-05c60635737f admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:03.620363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99acb67-7585-4d00-9043-254a33ab8763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:03.626058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99acb67-7585-4d00-9043-254a33ab8763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:03.626443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99acb67-7585-4d00-9043-254a33ab8763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:03.626816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99acb67-7585-4d00-9043-254a33ab8763 admin admin] PATH_INFO: `/v3/projects/a955774d48a64a749fa84e6035d0e4d3/users/dc01aef87efc4e2b80c68a75bd69570e/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:03.629909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99acb67-7585-4d00-9043-254a33ab8763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a955774d48a64a749fa84e6035d0e4d3, user_id=dc01aef87efc4e2b80c68a75bd69570e, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:03.632723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99acb67-7585-4d00-9043-254a33ab8763 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:03.662476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1146/2282] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:17:03 2022] PUT /identity/v3/projects/a955774d48a64a749fa84e6035d0e4d3/users/dc01aef87efc4e2b80c68a75bd69570e/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:03.672568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6620d57-d0e1-4176-b1a1-00db2675be62 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:03.672869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6620d57-d0e1-4176-b1a1-00db2675be62 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:03.674066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6620d57-d0e1-4176-b1a1-00db2675be62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:03.727981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d6620d57-d0e1-4176-b1a1-00db2675be62 None None] MFA Rules not processed for user `dc01aef87efc4e2b80c68a75bd69570e`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:03.729401 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d6620d57-d0e1-4176-b1a1-00db2675be62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:03.842183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1137/2283] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:03.883378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99acb67-7585-4d00-9043-254a33ab8763 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:03.885501 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e99acb67-7585-4d00-9043-254a33ab8763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:03.978973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99acb67-7585-4d00-9043-254a33ab8763 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:03.983805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07f627-b828-4a35-9bd3-166b07908d31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:03.985700 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07f627-b828-4a35-9bd3-166b07908d31 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:03.985700 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07f627-b828-4a35-9bd3-166b07908d31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:03.986099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07f627-b828-4a35-9bd3-166b07908d31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:04.003895 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07f627-b828-4a35-9bd3-166b07908d31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:04.005821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07f627-b828-4a35-9bd3-166b07908d31 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:04.039106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1147/2284] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:17:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:17:04.127700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6620d57-d0e1-4176-b1a1-00db2675be62 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:04.129202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d6620d57-d0e1-4176-b1a1-00db2675be62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:04.150905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6620d57-d0e1-4176-b1a1-00db2675be62 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:04.161991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c25036-0f49-40cf-8af8-8ff31a4c5f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:04.163088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c25036-0f49-40cf-8af8-8ff31a4c5f79 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:04.163345 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c25036-0f49-40cf-8af8-8ff31a4c5f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:04.164277 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c25036-0f49-40cf-8af8-8ff31a4c5f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:04.272650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c25036-0f49-40cf-8af8-8ff31a4c5f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:04.274171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c25036-0f49-40cf-8af8-8ff31a4c5f79 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:04.284804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1138/2285] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:17:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:17:05.355017 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07f627-b828-4a35-9bd3-166b07908d31 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:05.362107 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-5f07f627-b828-4a35-9bd3-166b07908d31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:05.469345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07f627-b828-4a35-9bd3-166b07908d31 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:05.478014 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:05.479491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:05.480034 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:05.480530 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] PATH_INFO: `/v3/users/4bd2d93a30444c8fa6de094160f0ad97` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:05.485120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd2d93a30444c8fa6de094160f0ad97)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:05.487226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:05.599401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:05.624591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd2d93a30444c8fa6de094160f0ad97'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:05.640203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd2d93a30444c8fa6de094160f0ad97'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:05.641149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd2d93a30444c8fa6de094160f0ad97'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:05.641781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd2d93a30444c8fa6de094160f0ad97'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:05.657329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd2d93a30444c8fa6de094160f0ad97'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:05.686465 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1148/2286] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:17:05 2022] DELETE /identity/v3/users/4bd2d93a30444c8fa6de094160f0ad97 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:05.691293 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3759-e62b-47c5-9064-6ca090730f00 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:05.691833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3759-e62b-47c5-9064-6ca090730f00 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:05.691833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3759-e62b-47c5-9064-6ca090730f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:05.725486 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-178b3759-e62b-47c5-9064-6ca090730f00 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:05.726994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-178b3759-e62b-47c5-9064-6ca090730f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:05.924886 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1139/2287] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:17:05.935578 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:05.939619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:06.101227 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615726f4-1b9e-4e22-ac11-09f494eb52d1 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:06.105559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74329a69-3713-418b-b65c-0fc2cddb4674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:06.106229 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74329a69-3713-418b-b65c-0fc2cddb4674 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:06.106511 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74329a69-3713-418b-b65c-0fc2cddb4674 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:06.106846 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74329a69-3713-418b-b65c-0fc2cddb4674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:06.129243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74329a69-3713-418b-b65c-0fc2cddb4674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:06.133434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74329a69-3713-418b-b65c-0fc2cddb4674 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:06.176189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b3759-e62b-47c5-9064-6ca090730f00 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:06.177895 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-178b3759-e62b-47c5-9064-6ca090730f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:06.214691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b3759-e62b-47c5-9064-6ca090730f00 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:06.216880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1149/2288] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:17:06.256278 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:06.257176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:06.257460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:06.257736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] PATH_INFO: `/v3/users/b6e7be8957194d4293a990a1fba73215` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:06.261671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e7be8957194d4293a990a1fba73215)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:06.263844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:06.276634 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:06.361995 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e7be8957194d4293a990a1fba73215'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:06.377848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e7be8957194d4293a990a1fba73215'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:06.394582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e7be8957194d4293a990a1fba73215'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:06.395445 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e7be8957194d4293a990a1fba73215'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:06.396157 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e7be8957194d4293a990a1fba73215'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:06.436642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1140/2289] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:17:06 2022] DELETE /identity/v3/users/b6e7be8957194d4293a990a1fba73215 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:17:06.441409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21723abd-4a71-4956-b189-4938db9e1438 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:06.442208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21723abd-4a71-4956-b189-4938db9e1438 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:06.442667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21723abd-4a71-4956-b189-4938db9e1438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:06.483915 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-21723abd-4a71-4956-b189-4938db9e1438 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:06.486389 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-21723abd-4a71-4956-b189-4938db9e1438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:06.707547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1150/2290] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:06.724911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:06.727128 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:06.932711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34176e08-a7e9-4982-971d-306ae68551af admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:06.965933 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703bc07-2e91-47ba-bdfb-f28574986e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:06.967897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703bc07-2e91-47ba-bdfb-f28574986e4f service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:06.968199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703bc07-2e91-47ba-bdfb-f28574986e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:06.968503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703bc07-2e91-47ba-bdfb-f28574986e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:06.993317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703bc07-2e91-47ba-bdfb-f28574986e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:06.996467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703bc07-2e91-47ba-bdfb-f28574986e4f service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:07.029973 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1141/2291] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:17:07.161942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21723abd-4a71-4956-b189-4938db9e1438 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:07.163796 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-21723abd-4a71-4956-b189-4938db9e1438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:07.192152 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21723abd-4a71-4956-b189-4938db9e1438 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:07.206498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:07.209303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:07.209303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:07.209804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e admin admin] PATH_INFO: `/v3/projects/b791fbed0800400290c38ac5f481ec60` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:07.214447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b791fbed0800400290c38ac5f481ec60)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:07.218197 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:07.346658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:07.348644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b791fbed0800400290c38ac5f481ec60', 'request_id': 'req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:07.376943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b791fbed0800400290c38ac5f481ec60', 'request_id': 'req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:07.385901 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b791fbed0800400290c38ac5f481ec60', 'request_id': 'req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:07.399025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e admin admin] The token cache is being invalidate because project b791fbed0800400290c38ac5f481ec60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:17:07.399419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:07.400411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-dd0c38a8-0568-4462-8f51-1fb8dd94d08e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:07.402678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1151/2292] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:17:07 2022] DELETE /identity/v3/projects/b791fbed0800400290c38ac5f481ec60 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:07.408516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34992aa6-d9b1-4f6b-b60d-9d2317a75854 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:07.409032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34992aa6-d9b1-4f6b-b60d-9d2317a75854 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:07.409528 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34992aa6-d9b1-4f6b-b60d-9d2317a75854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:07.452942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-34992aa6-d9b1-4f6b-b60d-9d2317a75854 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:07.458451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-34992aa6-d9b1-4f6b-b60d-9d2317a75854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:07.647506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1142/2293] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:07.655240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20fe51-6725-410a-97be-2fb1fc00b108 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:07.658210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20fe51-6725-410a-97be-2fb1fc00b108 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:07.659169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20fe51-6725-410a-97be-2fb1fc00b108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:07.716650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-6b20fe51-6725-410a-97be-2fb1fc00b108 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:07.721177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6b20fe51-6725-410a-97be-2fb1fc00b108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:07.743212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1152/2294] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:07.748024 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34992aa6-d9b1-4f6b-b60d-9d2317a75854 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:07.764282 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34992aa6-d9b1-4f6b-b60d-9d2317a75854 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:07.772646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a86c4d-5eeb-413d-87c4-9cff9454740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:07.773397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a86c4d-5eeb-413d-87c4-9cff9454740c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:07.773681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a86c4d-5eeb-413d-87c4-9cff9454740c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:07.773960 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a86c4d-5eeb-413d-87c4-9cff9454740c admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:07.774749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a86c4d-5eeb-413d-87c4-9cff9454740c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:17:07.775377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a86c4d-5eeb-413d-87c4-9cff9454740c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:07.783155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a86c4d-5eeb-413d-87c4-9cff9454740c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:07.822325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1143/2295] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:17:07.823554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20fe51-6725-410a-97be-2fb1fc00b108 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:07.834864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20fe51-6725-410a-97be-2fb1fc00b108 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:07.840341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30989db-0e81-49fc-9f6d-f22a72f9ab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:07.841411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30989db-0e81-49fc-9f6d-f22a72f9ab83 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:07.841828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30989db-0e81-49fc-9f6d-f22a72f9ab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:07.842245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30989db-0e81-49fc-9f6d-f22a72f9ab83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:07.843240 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30989db-0e81-49fc-9f6d-f22a72f9ab83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:07.846408 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30989db-0e81-49fc-9f6d-f22a72f9ab83 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:07.891534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1153/2296] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:17:07 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:07.896065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a86c4d-5eeb-413d-87c4-9cff9454740c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:07.912539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a86c4d-5eeb-413d-87c4-9cff9454740c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:07.935276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:08.116361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930223d-5a70-4608-a6d3-bbbb02e7425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:08.117066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930223d-5a70-4608-a6d3-bbbb02e7425a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:08.117517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930223d-5a70-4608-a6d3-bbbb02e7425a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:08.118031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930223d-5a70-4608-a6d3-bbbb02e7425a admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:08.118520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930223d-5a70-4608-a6d3-bbbb02e7425a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:08.120760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930223d-5a70-4608-a6d3-bbbb02e7425a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:08.167516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1144/2297] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:17:07 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:08.171543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30989db-0e81-49fc-9f6d-f22a72f9ab83 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:08.189489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30989db-0e81-49fc-9f6d-f22a72f9ab83 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:08.196173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e27057-88fc-47fd-8852-4456496af796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:08.196980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e27057-88fc-47fd-8852-4456496af796 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:08.197610 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e27057-88fc-47fd-8852-4456496af796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:08.197995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e27057-88fc-47fd-8852-4456496af796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:08.200507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e27057-88fc-47fd-8852-4456496af796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:08.202294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e27057-88fc-47fd-8852-4456496af796 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:08.219006 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1154/2298] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:17:08.223765 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930223d-5a70-4608-a6d3-bbbb02e7425a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:08.252813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930223d-5a70-4608-a6d3-bbbb02e7425a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:08.266148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01888aac-c34b-4dca-a309-195c327cbc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:08.269213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01888aac-c34b-4dca-a309-195c327cbc2f admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:08.269705 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01888aac-c34b-4dca-a309-195c327cbc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:08.270161 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01888aac-c34b-4dca-a309-195c327cbc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:08.271080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01888aac-c34b-4dca-a309-195c327cbc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:08.278603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01888aac-c34b-4dca-a309-195c327cbc2f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:08.308783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1145/2299] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:17:08.312160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e27057-88fc-47fd-8852-4456496af796 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:08.318272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01888aac-c34b-4dca-a309-195c327cbc2f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:08.321033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-01888aac-c34b-4dca-a309-195c327cbc2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:08.331081 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e27057-88fc-47fd-8852-4456496af796 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:08.338564 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01888aac-c34b-4dca-a309-195c327cbc2f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:08.349143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:08.350694 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:08.354598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:08.355828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] PATH_INFO: `/v3/projects/489e96467be04540a9016f0eb8256567` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:08.360029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=489e96467be04540a9016f0eb8256567)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:08.372620 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:08.394851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e8212-5273-43b0-ad61-9617d86ad121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:08.395780 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e8212-5273-43b0-ad61-9617d86ad121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:08.396071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e8212-5273-43b0-ad61-9617d86ad121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:08.396340 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e8212-5273-43b0-ad61-9617d86ad121 admin admin] PATH_INFO: `/v3/projects/054a41c637b243f180a79969432bb3f8/users/0143621344994e29b232c9e35c25d427/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:08.458272 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e8212-5273-43b0-ad61-9617d86ad121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054a41c637b243f180a79969432bb3f8, user_id=0143621344994e29b232c9e35c25d427, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:08.462024 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e8212-5273-43b0-ad61-9617d86ad121 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:08.491222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1155/2300] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:17:08 2022] PUT /identity/v3/projects/054a41c637b243f180a79969432bb3f8/users/0143621344994e29b232c9e35c25d427/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:08.496518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a4c7-9a25-4bb0-aac9-28683dbc151d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:08.497006 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a4c7-9a25-4bb0-aac9-28683dbc151d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:08.497504 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a4c7-9a25-4bb0-aac9-28683dbc151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:08.501902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489e96467be04540a9016f0eb8256567', 'request_id': 'req-d2cdef62-9f83-4d93-be00-8e30a7562caa'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:08.512314 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489e96467be04540a9016f0eb8256567', 'request_id': 'req-d2cdef62-9f83-4d93-be00-8e30a7562caa'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:08.519822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489e96467be04540a9016f0eb8256567', 'request_id': 'req-d2cdef62-9f83-4d93-be00-8e30a7562caa'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:08.575393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-2b27a4c7-9a25-4bb0-aac9-28683dbc151d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:08.575868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] The token cache is being invalidate because project 489e96467be04540a9016f0eb8256567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:17:08.576740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:08.578744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2b27a4c7-9a25-4bb0-aac9-28683dbc151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:08.579015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:08.592904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1146/2301] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:17:08 2022] DELETE /identity/v3/projects/489e96467be04540a9016f0eb8256567 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:08.715568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1156/2302] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:17:08.726100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:08.731455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:08.849111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdef62-9f83-4d93-be00-8e30a7562caa admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:08.890071 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:08.930395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12233447-db31-4c84-b2c0-210a35138b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:08.931224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12233447-db31-4c84-b2c0-210a35138b91 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:08.931519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12233447-db31-4c84-b2c0-210a35138b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:08.931800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12233447-db31-4c84-b2c0-210a35138b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:08.943397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12233447-db31-4c84-b2c0-210a35138b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:08.945059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12233447-db31-4c84-b2c0-210a35138b91 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:08.959954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1147/2303] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:17:10.503249 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705812d-c26e-4c73-9d92-2c0ba2a987d3 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:10.503730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705812d-c26e-4c73-9d92-2c0ba2a987d3 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:10.503828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705812d-c26e-4c73-9d92-2c0ba2a987d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:10.534492 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f705812d-c26e-4c73-9d92-2c0ba2a987d3 None None] MFA Rules not processed for user `44de390119624cbc944b5bd7794528ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:10.535941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f705812d-c26e-4c73-9d92-2c0ba2a987d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:10.634399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:10.659975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1157/2304] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:10.660228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12233447-db31-4c84-b2c0-210a35138b91 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:10.662284 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-12233447-db31-4c84-b2c0-210a35138b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:10.788711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12233447-db31-4c84-b2c0-210a35138b91 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:10.801706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f8ddf-f12d-4792-b071-f28f66364369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:10.802385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8ddf-f12d-4792-b071-f28f66364369 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:10.802715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8ddf-f12d-4792-b071-f28f66364369 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:10.802997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8ddf-f12d-4792-b071-f28f66364369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:10.805668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-502f8ddf-f12d-4792-b071-f28f66364369 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:10.930226 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f8ddf-f12d-4792-b071-f28f66364369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:10.932227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f8ddf-f12d-4792-b071-f28f66364369 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:10.951690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1148/2305] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:17:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:17:13.665672 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d4081-ff09-4ea4-894a-5d8130a4b06b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:13.666122 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d4081-ff09-4ea4-894a-5d8130a4b06b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:13.666224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d4081-ff09-4ea4-894a-5d8130a4b06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:13.698479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-c55d4081-ff09-4ea4-894a-5d8130a4b06b None None] MFA Rules not processed for user `8b54a55cff584d948b96c1c439e57eda`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:13.700211 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c55d4081-ff09-4ea4-894a-5d8130a4b06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:13.722886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1158/2306] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:16.093991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065be8-f08d-47c7-8506-3d2b67309a64 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:16.094588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065be8-f08d-47c7-8506-3d2b67309a64 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:16.094824 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065be8-f08d-47c7-8506-3d2b67309a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:16.127298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c9065be8-f08d-47c7-8506-3d2b67309a64 None None] MFA Rules not processed for user `0143621344994e29b232c9e35c25d427`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:16.128602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c9065be8-f08d-47c7-8506-3d2b67309a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:16.201864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:16.211141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1149/2307] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:16.213884 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d4081-ff09-4ea4-894a-5d8130a4b06b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:16.215330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c55d4081-ff09-4ea4-894a-5d8130a4b06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:16.230771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d4081-ff09-4ea4-894a-5d8130a4b06b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:16.235838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cd041-17ee-4bb3-a2a0-1a870345d2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:16.236498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cd041-17ee-4bb3-a2a0-1a870345d2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:16.236784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cd041-17ee-4bb3-a2a0-1a870345d2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:16.237067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cd041-17ee-4bb3-a2a0-1a870345d2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:16.237774 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cd041-17ee-4bb3-a2a0-1a870345d2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:16.239844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cd041-17ee-4bb3-a2a0-1a870345d2f9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:16.270913 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1159/2308] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:17:16 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:16.272154 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065be8-f08d-47c7-8506-3d2b67309a64 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:16.284246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065be8-f08d-47c7-8506-3d2b67309a64 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:16.359472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6643771-f569-49d7-b915-568e77b9cb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:16.359779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6643771-f569-49d7-b915-568e77b9cb7a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:16.360173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6643771-f569-49d7-b915-568e77b9cb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:16.360969 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6643771-f569-49d7-b915-568e77b9cb7a admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:16.361290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6643771-f569-49d7-b915-568e77b9cb7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:16.363886 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6643771-f569-49d7-b915-568e77b9cb7a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:16.394606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1150/2309] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:17:16 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:16.396274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cd041-17ee-4bb3-a2a0-1a870345d2f9 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:16.406821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cd041-17ee-4bb3-a2a0-1a870345d2f9 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:16.412523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61c432-936d-435c-aa53-a09934530baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:16.413450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61c432-936d-435c-aa53-a09934530baa admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:16.413734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61c432-936d-435c-aa53-a09934530baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:16.414151 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61c432-936d-435c-aa53-a09934530baa admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:16.416018 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61c432-936d-435c-aa53-a09934530baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:16.421483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61c432-936d-435c-aa53-a09934530baa admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:16.436953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1160/2310] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:17:16.442141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6643771-f569-49d7-b915-568e77b9cb7a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:16.454289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6643771-f569-49d7-b915-568e77b9cb7a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:16.459566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7a61a-ac3c-46f8-8ad8-8acd304dda1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:16.460457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7a61a-ac3c-46f8-8ad8-8acd304dda1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:16.460745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7a61a-ac3c-46f8-8ad8-8acd304dda1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:16.461020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7a61a-ac3c-46f8-8ad8-8acd304dda1a admin admin] PATH_INFO: `/v3/projects/f3022549ca964c5898ee77721e436521/users/648ee78be0c446bbbe02163298297aa1/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:16.482373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7a61a-ac3c-46f8-8ad8-8acd304dda1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3022549ca964c5898ee77721e436521, user_id=648ee78be0c446bbbe02163298297aa1, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:16.487529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7a61a-ac3c-46f8-8ad8-8acd304dda1a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:16.502667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1151/2311] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:17:16 2022] PUT /identity/v3/projects/f3022549ca964c5898ee77721e436521/users/648ee78be0c446bbbe02163298297aa1/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:17:16.506635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61c432-936d-435c-aa53-a09934530baa admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:16.518568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61c432-936d-435c-aa53-a09934530baa admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:16.581783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e33bb-c1d4-4616-95d5-6330b8f80a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:16.582462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e33bb-c1d4-4616-95d5-6330b8f80a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:16.582784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e33bb-c1d4-4616-95d5-6330b8f80a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:16.583060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e33bb-c1d4-4616-95d5-6330b8f80a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:16.583791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e33bb-c1d4-4616-95d5-6330b8f80a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:16.585572 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e33bb-c1d4-4616-95d5-6330b8f80a26 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:16.600693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1161/2312] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:17:16.601889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7a61a-ac3c-46f8-8ad8-8acd304dda1a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:16.615172 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7a61a-ac3c-46f8-8ad8-8acd304dda1a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:16.621821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8814317-323a-4127-b847-2f41ed8507fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:16.622987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8814317-323a-4127-b847-2f41ed8507fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:16.623407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8814317-323a-4127-b847-2f41ed8507fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:16.623828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8814317-323a-4127-b847-2f41ed8507fa admin admin] PATH_INFO: `/v3/projects/f3022549ca964c5898ee77721e436521/users/648ee78be0c446bbbe02163298297aa1/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:16.627349 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8814317-323a-4127-b847-2f41ed8507fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3022549ca964c5898ee77721e436521, user_id=648ee78be0c446bbbe02163298297aa1, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:16.630525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8814317-323a-4127-b847-2f41ed8507fa admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:16.643809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1152/2313] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:17:16 2022] PUT /identity/v3/projects/f3022549ca964c5898ee77721e436521/users/648ee78be0c446bbbe02163298297aa1/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:17:18.593912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a818-15e8-4f47-8ac3-91c793285533 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:18.594580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a818-15e8-4f47-8ac3-91c793285533 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:18.594580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a818-15e8-4f47-8ac3-91c793285533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:18.641504 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d867a818-15e8-4f47-8ac3-91c793285533 None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:18.642776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d867a818-15e8-4f47-8ac3-91c793285533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:18.853341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1162/2314] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:17:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:18.874390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8814317-323a-4127-b847-2f41ed8507fa admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:18.877657 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c8814317-323a-4127-b847-2f41ed8507fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:19.024968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8814317-323a-4127-b847-2f41ed8507fa admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:19.033256 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b59b55-2504-40a3-a474-8e5b93b0525f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:19.034152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b59b55-2504-40a3-a474-8e5b93b0525f service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:19.034607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b59b55-2504-40a3-a474-8e5b93b0525f service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:19.035067 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b59b55-2504-40a3-a474-8e5b93b0525f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:19.046689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b59b55-2504-40a3-a474-8e5b93b0525f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:19.048940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b59b55-2504-40a3-a474-8e5b93b0525f service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:19.063668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1153/2315] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:17:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:17:23.531457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecf070-fb09-44e0-bcb1-ab09770fea7b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:23.532475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecf070-fb09-44e0-bcb1-ab09770fea7b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:23.532918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecf070-fb09-44e0-bcb1-ab09770fea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:23.575974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-12ecf070-fb09-44e0-bcb1-ab09770fea7b None None] MFA Rules not processed for user `de0dccd8f960443894a99baa79198005`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:23.577333 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-12ecf070-fb09-44e0-bcb1-ab09770fea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:23.710915 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1163/2316] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:25.572598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a08af-4af2-4f02-be53-ee5f936ec759 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:25.573929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a08af-4af2-4f02-be53-ee5f936ec759 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:25.574744 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a08af-4af2-4f02-be53-ee5f936ec759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:25.621013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-098a08af-4af2-4f02-be53-ee5f936ec759 None None] MFA Rules not processed for user `648ee78be0c446bbbe02163298297aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:25.624465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-098a08af-4af2-4f02-be53-ee5f936ec759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:25.674358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:25.753725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1154/2317] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:31.754139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecf070-fb09-44e0-bcb1-ab09770fea7b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:31.755829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-12ecf070-fb09-44e0-bcb1-ab09770fea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:31.763783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:31.838931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecf070-fb09-44e0-bcb1-ab09770fea7b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:31.842825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ff08f-2c29-4395-b437-35bdf2312ea9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31a233e2fc784b01a3a8a24599f3c1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:31.843525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ff08f-2c29-4395-b437-35bdf2312ea9 service glance] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:31.843958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ff08f-2c29-4395-b437-35bdf2312ea9 service glance] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:31.844509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ff08f-2c29-4395-b437-35bdf2312ea9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:31.922665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ff08f-2c29-4395-b437-35bdf2312ea9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:31.924649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ff08f-2c29-4395-b437-35bdf2312ea9 service glance] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:31.939152 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1164/2318] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:17:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:17:32.159668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda183ee-f091-4395-97ca-ad6b62fafbcb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:32.160249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda183ee-f091-4395-97ca-ad6b62fafbcb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:32.160249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda183ee-f091-4395-97ca-ad6b62fafbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:32.184230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-eda183ee-f091-4395-97ca-ad6b62fafbcb None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:32.185771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-eda183ee-f091-4395-97ca-ad6b62fafbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:32.195914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1155/2319] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:17:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:32.210469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ff08f-2c29-4395-b437-35bdf2312ea9 service glance] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:32.223262 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ff08f-2c29-4395-b437-35bdf2312ea9 service glance] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:32.230060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84585dd0-587b-4fab-a780-11763a900a25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:32.230825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84585dd0-587b-4fab-a780-11763a900a25 service swift] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:32.231139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84585dd0-587b-4fab-a780-11763a900a25 service swift] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:32.231591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84585dd0-587b-4fab-a780-11763a900a25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:32.241846 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84585dd0-587b-4fab-a780-11763a900a25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:32.243469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84585dd0-587b-4fab-a780-11763a900a25 service swift] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:32.253545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1165/2320] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:17:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:17:42.177023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=19 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:42.248598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=52 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:44.657170 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b1bfd-ea45-4a6f-94b1-899a48d7f5cd None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:44.657795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b1bfd-ea45-4a6f-94b1-899a48d7f5cd None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:44.657795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b1bfd-ea45-4a6f-94b1-899a48d7f5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:44.681612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-979b1bfd-ea45-4a6f-94b1-899a48d7f5cd None None] MFA Rules not processed for user `0143621344994e29b232c9e35c25d427`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:44.683435 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-979b1bfd-ea45-4a6f-94b1-899a48d7f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:44.693209 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1156/2321] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:50.969535 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e66e3-dd66-42c3-a914-ed5120ef3577 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:50.970241 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e66e3-dd66-42c3-a914-ed5120ef3577 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:50.970490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e66e3-dd66-42c3-a914-ed5120ef3577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:50.990964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-068e66e3-dd66-42c3-a914-ed5120ef3577 None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:50.992300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-068e66e3-dd66-42c3-a914-ed5120ef3577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:51.000058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1166/2322] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 21 08:17:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:51.013274 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b1bfd-ea45-4a6f-94b1-899a48d7f5cd None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:51.026200 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b1bfd-ea45-4a6f-94b1-899a48d7f5cd None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:51.031352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe93f5-f08b-42c0-b3dc-fa2d19875cd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:51.031988 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe93f5-f08b-42c0-b3dc-fa2d19875cd7 service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:51.032341 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe93f5-f08b-42c0-b3dc-fa2d19875cd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:51.032763 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe93f5-f08b-42c0-b3dc-fa2d19875cd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:51.040891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe93f5-f08b-42c0-b3dc-fa2d19875cd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:51.042460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe93f5-f08b-42c0-b3dc-fa2d19875cd7 service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:51.051301 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1157/2323] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:17:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:17:52.496640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554f686-0d5d-4f59-8240-f6ec164aa859 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:52.497087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554f686-0d5d-4f59-8240-f6ec164aa859 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:52.497256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554f686-0d5d-4f59-8240-f6ec164aa859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:52.547499 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-0554f686-0d5d-4f59-8240-f6ec164aa859 None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:52.554458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0554f686-0d5d-4f59-8240-f6ec164aa859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:52.595495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1167/2324] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:17:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:52.608221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe93f5-f08b-42c0-b3dc-fa2d19875cd7 service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:52.619671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe93f5-f08b-42c0-b3dc-fa2d19875cd7 service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:52.644721 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58cc80-ff53-477c-a888-890c9f0d21e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:52.645420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58cc80-ff53-477c-a888-890c9f0d21e1 service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:52.645702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58cc80-ff53-477c-a888-890c9f0d21e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:52.645979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58cc80-ff53-477c-a888-890c9f0d21e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:52.667212 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58cc80-ff53-477c-a888-890c9f0d21e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:52.669371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58cc80-ff53-477c-a888-890c9f0d21e1 service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:52.689655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1158/2325] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:17:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:17:53.740619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554f686-0d5d-4f59-8240-f6ec164aa859 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:53.743168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0554f686-0d5d-4f59-8240-f6ec164aa859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:53.964183 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554f686-0d5d-4f59-8240-f6ec164aa859 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:53.974111 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:53.975032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:53.975319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:53.979815 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] PATH_INFO: `/v3/users/f2d74ed5a1534d13956a6950be7a9814` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:53.981203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d74ed5a1534d13956a6950be7a9814)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:53.985153 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:54.108325 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d74ed5a1534d13956a6950be7a9814'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:54.130335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d74ed5a1534d13956a6950be7a9814'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:54.131273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d74ed5a1534d13956a6950be7a9814'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:54.132163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d74ed5a1534d13956a6950be7a9814'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:54.164052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d74ed5a1534d13956a6950be7a9814'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:54.196252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1168/2326] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:17:53 2022] DELETE /identity/v3/users/f2d74ed5a1534d13956a6950be7a9814 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:17:54.197819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8bb85-f8c4-443e-92c0-46926a03042e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:54.198785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8bb85-f8c4-443e-92c0-46926a03042e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:54.199288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8bb85-f8c4-443e-92c0-46926a03042e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:54.261472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e9a8bb85-f8c4-443e-92c0-46926a03042e None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:54.268279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e9a8bb85-f8c4-443e-92c0-46926a03042e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:54.483042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1159/2327] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:54.529414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:54.531867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:54.537460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:54.716678 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd133ca-84c9-4d14-b3f1-47e1a3947dd6 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:54.716985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd133ca-84c9-4d14-b3f1-47e1a3947dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:54.717292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd133ca-84c9-4d14-b3f1-47e1a3947dd6 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:54.720840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1160/2328] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:17:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 08:17:54.746667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fa9e9-4005-4390-a67e-4089354b7175 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:54.747195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fa9e9-4005-4390-a67e-4089354b7175 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:54.747646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fa9e9-4005-4390-a67e-4089354b7175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:54.784094 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-741fa9e9-4005-4390-a67e-4089354b7175 None None] MFA Rules not processed for user `53dfc3572d05469ca7e2de1acea3629a`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:54.785723 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-741fa9e9-4005-4390-a67e-4089354b7175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:54.918585 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0be0b0-09d9-4bc2-ad0e-564ecf29628a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:54.936670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19803052-f56e-43a1-9e6b-eab8dd472be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:54.937689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19803052-f56e-43a1-9e6b-eab8dd472be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:54.940535 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19803052-f56e-43a1-9e6b-eab8dd472be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:54.941235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19803052-f56e-43a1-9e6b-eab8dd472be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:54.970778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1161/2329] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:17:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:17:55.005412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19803052-f56e-43a1-9e6b-eab8dd472be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:55.015060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19803052-f56e-43a1-9e6b-eab8dd472be4 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:55.044644 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1169/2330] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:17:55.288986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fa9e9-4005-4390-a67e-4089354b7175 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:55.291156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-741fa9e9-4005-4390-a67e-4089354b7175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:55.311034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fa9e9-4005-4390-a67e-4089354b7175 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:55.317677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc7ef8-3690-4ce0-991d-7d7f8db3abf4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:55.318611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc7ef8-3690-4ce0-991d-7d7f8db3abf4 service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:55.320473 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc7ef8-3690-4ce0-991d-7d7f8db3abf4 service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:55.322124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc7ef8-3690-4ce0-991d-7d7f8db3abf4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:55.336682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc7ef8-3690-4ce0-991d-7d7f8db3abf4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:55.338693 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc7ef8-3690-4ce0-991d-7d7f8db3abf4 service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:55.356933 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1162/2331] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:17:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:17:55.712646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19803052-f56e-43a1-9e6b-eab8dd472be4 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:55.714195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-19803052-f56e-43a1-9e6b-eab8dd472be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:55.736489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19803052-f56e-43a1-9e6b-eab8dd472be4 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:55.748778 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:55.750035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:55.750386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:55.751424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] PATH_INFO: `/v3/users/48e816a85da046fbb8a02f9a84ecd6fb` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:55.754935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e816a85da046fbb8a02f9a84ecd6fb)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:55.757824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:55.882771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e816a85da046fbb8a02f9a84ecd6fb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:55.903091 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e816a85da046fbb8a02f9a84ecd6fb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:55.905581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e816a85da046fbb8a02f9a84ecd6fb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:55.907849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e816a85da046fbb8a02f9a84ecd6fb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:55.937195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e816a85da046fbb8a02f9a84ecd6fb'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:55.967719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1170/2332] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:17:55 2022] DELETE /identity/v3/users/48e816a85da046fbb8a02f9a84ecd6fb => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:56.292187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc7ef8-3690-4ce0-991d-7d7f8db3abf4 service placement] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:56.312819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc7ef8-3690-4ce0-991d-7d7f8db3abf4 service placement] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:56.450664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:56.474811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e471b6-3764-4c7f-b80d-cef4b4a57d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:56.476008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e471b6-3764-4c7f-b80d-cef4b4a57d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:56.476293 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e471b6-3764-4c7f-b80d-cef4b4a57d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:56.476572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e471b6-3764-4c7f-b80d-cef4b4a57d74 admin admin] PATH_INFO: `/v3/projects/d0ebfe281cb442e18830e44768082fdd` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:56.477924 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e471b6-3764-4c7f-b80d-cef4b4a57d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ebfe281cb442e18830e44768082fdd)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:56.490603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e471b6-3764-4c7f-b80d-cef4b4a57d74 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:56.570574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-12e471b6-3764-4c7f-b80d-cef4b4a57d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ebfe281cb442e18830e44768082fdd', 'request_id': 'req-12e471b6-3764-4c7f-b80d-cef4b4a57d74'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:56.579537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-12e471b6-3764-4c7f-b80d-cef4b4a57d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ebfe281cb442e18830e44768082fdd', 'request_id': 'req-12e471b6-3764-4c7f-b80d-cef4b4a57d74'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:56.587960 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-12e471b6-3764-4c7f-b80d-cef4b4a57d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ebfe281cb442e18830e44768082fdd', 'request_id': 'req-12e471b6-3764-4c7f-b80d-cef4b4a57d74'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:56.600737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:56.602371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:56.611889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-12e471b6-3764-4c7f-b80d-cef4b4a57d74 admin admin] The token cache is being invalidate because project d0ebfe281cb442e18830e44768082fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:17:56.612183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-12e471b6-3764-4c7f-b80d-cef4b4a57d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:56.613051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-12e471b6-3764-4c7f-b80d-cef4b4a57d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:56.615280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1163/2333] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:17:56 2022] DELETE /identity/v3/projects/d0ebfe281cb442e18830e44768082fdd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:56.620279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30019d8-eba9-4cb9-9d4c-6c332f2a8e05 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:56.632827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30019d8-eba9-4cb9-9d4c-6c332f2a8e05 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:56.633360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30019d8-eba9-4cb9-9d4c-6c332f2a8e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:56.684311 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a3c86-a166-4cca-941c-a148aaffaca8 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:56.701033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e30019d8-eba9-4cb9-9d4c-6c332f2a8e05 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:56.702430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e30019d8-eba9-4cb9-9d4c-6c332f2a8e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:56.767048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:56.808356 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1164/2334] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:17:56.810306 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34c91-b0a0-40c2-8e0c-093422d7a2d9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:56.810634 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34c91-b0a0-40c2-8e0c-093422d7a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:56.811136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34c91-b0a0-40c2-8e0c-093422d7a2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:56.826016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:56.827752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:56.830305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:56.833266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] PATH_INFO: `/v3/projects/62a26a8b7cef414488dbc6ef1933b7e3` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:56.836138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a26a8b7cef414488dbc6ef1933b7e3)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:56.839454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:56.856300 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-53d34c91-b0a0-40c2-8e0c-093422d7a2d9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:56.858827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-53d34c91-b0a0-40c2-8e0c-093422d7a2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:56.879931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1165/2335] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:56.886849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34c91-b0a0-40c2-8e0c-093422d7a2d9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:56.924042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34c91-b0a0-40c2-8e0c-093422d7a2d9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:56.960845 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f74b7-ecfd-4086-9088-0dbc6ca8967f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:56.961582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f74b7-ecfd-4086-9088-0dbc6ca8967f admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:56.961869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f74b7-ecfd-4086-9088-0dbc6ca8967f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:56.962144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f74b7-ecfd-4086-9088-0dbc6ca8967f admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:56.962915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f74b7-ecfd-4086-9088-0dbc6ca8967f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:17:56.963231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f74b7-ecfd-4086-9088-0dbc6ca8967f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:56.964863 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f74b7-ecfd-4086-9088-0dbc6ca8967f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:56.972952 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a26a8b7cef414488dbc6ef1933b7e3', 'request_id': 'req-0a363e26-2557-42af-a888-01f7869c1715'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:56.990283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a26a8b7cef414488dbc6ef1933b7e3', 'request_id': 'req-0a363e26-2557-42af-a888-01f7869c1715'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:56.992475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1166/2336] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:17:56.996860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f74b7-ecfd-4086-9088-0dbc6ca8967f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:57.005844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a26a8b7cef414488dbc6ef1933b7e3', 'request_id': 'req-0a363e26-2557-42af-a888-01f7869c1715'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:57.010163 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f74b7-ecfd-4086-9088-0dbc6ca8967f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:57.034449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] The token cache is being invalidate because project 62a26a8b7cef414488dbc6ef1933b7e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:17:57.035142 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:57.037283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:57.039365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1171/2337] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:17:56 2022] DELETE /identity/v3/projects/62a26a8b7cef414488dbc6ef1933b7e3 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:57.053052 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:57.059589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:57.082485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:57.129816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166d971-3e87-4e1b-b7fa-c1481b0a1756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:57.130496 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166d971-3e87-4e1b-b7fa-c1481b0a1756 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:57.130851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166d971-3e87-4e1b-b7fa-c1481b0a1756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:57.131130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166d971-3e87-4e1b-b7fa-c1481b0a1756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:57.131867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166d971-3e87-4e1b-b7fa-c1481b0a1756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:57.133787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166d971-3e87-4e1b-b7fa-c1481b0a1756 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:57.180840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a363e26-2557-42af-a888-01f7869c1715 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:57.195602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:57.196695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:57.197120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:57.197463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] PATH_INFO: `/v3/users/dc01aef87efc4e2b80c68a75bd69570e` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:57.198952 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc01aef87efc4e2b80c68a75bd69570e)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:57.201223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:57.207475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1167/2338] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:17:56 2022] POST /identity/v3/projects => generated 369 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:57.211323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166d971-3e87-4e1b-b7fa-c1481b0a1756 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:57.214758 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2166d971-3e87-4e1b-b7fa-c1481b0a1756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:57.319871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc01aef87efc4e2b80c68a75bd69570e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:57.331204 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc01aef87efc4e2b80c68a75bd69570e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:57.340871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc01aef87efc4e2b80c68a75bd69570e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:57.344162 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc01aef87efc4e2b80c68a75bd69570e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:57.373171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166d971-3e87-4e1b-b7fa-c1481b0a1756 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:57.375293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc01aef87efc4e2b80c68a75bd69570e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:57.381019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abe33c-43f0-4337-b5e4-ba876a1f4b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:57.381809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abe33c-43f0-4337-b5e4-ba876a1f4b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:57.382161 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abe33c-43f0-4337-b5e4-ba876a1f4b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:57.382566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:57.382993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abe33c-43f0-4337-b5e4-ba876a1f4b5d admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:57.384296 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abe33c-43f0-4337-b5e4-ba876a1f4b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:57.386489 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abe33c-43f0-4337-b5e4-ba876a1f4b5d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:57.406575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1172/2339] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:17:57 2022] DELETE /identity/v3/users/dc01aef87efc4e2b80c68a75bd69570e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:57.462472 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1168/2340] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:17:57 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:17:57.463691 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:57.465539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:57.620425 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db83d-861d-44fe-bf53-f3b51a758b8a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:57.625518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab8c12-9002-47aa-b0df-f4afd8bb3339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:57.626516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8c12-9002-47aa-b0df-f4afd8bb3339 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:57.626965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8c12-9002-47aa-b0df-f4afd8bb3339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:57.627252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8c12-9002-47aa-b0df-f4afd8bb3339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:57.628012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab8c12-9002-47aa-b0df-f4afd8bb3339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:57.629949 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab8c12-9002-47aa-b0df-f4afd8bb3339 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:57.645263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1173/2341] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:17:57.649383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abe33c-43f0-4337-b5e4-ba876a1f4b5d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:57.660456 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abe33c-43f0-4337-b5e4-ba876a1f4b5d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:57.665484 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8d5d7-db2e-4d05-9644-f41eef718645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:57.666320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8d5d7-db2e-4d05-9644-f41eef718645 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:57.666501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8d5d7-db2e-4d05-9644-f41eef718645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:57.666709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8d5d7-db2e-4d05-9644-f41eef718645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:57.667693 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8d5d7-db2e-4d05-9644-f41eef718645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:57.669219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8d5d7-db2e-4d05-9644-f41eef718645 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:57.686643 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1169/2342] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:17:57.688684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab8c12-9002-47aa-b0df-f4afd8bb3339 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:57.706221 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab8c12-9002-47aa-b0df-f4afd8bb3339 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:57.725869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7458b-f53e-4736-a3d1-bbfd17c7bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:57.726930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7458b-f53e-4736-a3d1-bbfd17c7bd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:57.727214 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7458b-f53e-4736-a3d1-bbfd17c7bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:57.727577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7458b-f53e-4736-a3d1-bbfd17c7bd31 admin admin] PATH_INFO: `/v3/projects/d67f425c020241f3bfdba682390d0863/users/6b572987586b4ed29a81fe93a054e6d1/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:57.746557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7458b-f53e-4736-a3d1-bbfd17c7bd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67f425c020241f3bfdba682390d0863, user_id=6b572987586b4ed29a81fe93a054e6d1, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:57.751210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7458b-f53e-4736-a3d1-bbfd17c7bd31 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:57.774190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1174/2343] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:17:57 2022] PUT /identity/v3/projects/d67f425c020241f3bfdba682390d0863/users/6b572987586b4ed29a81fe93a054e6d1/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:57.785923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1afbd-e635-4e4f-a2ce-5eb08a3ba26a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:57.786389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1afbd-e635-4e4f-a2ce-5eb08a3ba26a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:57.786686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1afbd-e635-4e4f-a2ce-5eb08a3ba26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:57.829710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-38f1afbd-e635-4e4f-a2ce-5eb08a3ba26a None None] MFA Rules not processed for user `6b572987586b4ed29a81fe93a054e6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:57.831840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-38f1afbd-e635-4e4f-a2ce-5eb08a3ba26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:57.983459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1170/2344] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:57.994951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7458b-f53e-4736-a3d1-bbfd17c7bd31 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:57.997144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-15d7458b-f53e-4736-a3d1-bbfd17c7bd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:58.098792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1afbd-e635-4e4f-a2ce-5eb08a3ba26a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:58.100499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-38f1afbd-e635-4e4f-a2ce-5eb08a3ba26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:58.168561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7458b-f53e-4736-a3d1-bbfd17c7bd31 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:58.187230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ff652-c16f-437e-a1fd-0380688a741c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31a233e2fc784b01a3a8a24599f3c1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:58.191095 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff652-c16f-437e-a1fd-0380688a741c service glance] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:58.193814 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff652-c16f-437e-a1fd-0380688a741c service glance] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:58.196970 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff652-c16f-437e-a1fd-0380688a741c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:58.238055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:58.239080 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ff652-c16f-437e-a1fd-0380688a741c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:58.244208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ff652-c16f-437e-a1fd-0380688a741c service glance] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:58.280792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1175/2345] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:17:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:17:58.321878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1afbd-e635-4e4f-a2ce-5eb08a3ba26a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:58.366791 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c53135-4dca-4109-ad96-dd557a1c23a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:58.373426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c53135-4dca-4109-ad96-dd557a1c23a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:58.374948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c53135-4dca-4109-ad96-dd557a1c23a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:58.382152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c53135-4dca-4109-ad96-dd557a1c23a6 admin admin] PATH_INFO: `/v3/projects/a955774d48a64a749fa84e6035d0e4d3` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:58.386105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c53135-4dca-4109-ad96-dd557a1c23a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a955774d48a64a749fa84e6035d0e4d3)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:58.388375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c53135-4dca-4109-ad96-dd557a1c23a6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:58.517694 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a1c53135-4dca-4109-ad96-dd557a1c23a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a955774d48a64a749fa84e6035d0e4d3', 'request_id': 'req-a1c53135-4dca-4109-ad96-dd557a1c23a6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:58.535989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a1c53135-4dca-4109-ad96-dd557a1c23a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a955774d48a64a749fa84e6035d0e4d3', 'request_id': 'req-a1c53135-4dca-4109-ad96-dd557a1c23a6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:58.545534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a1c53135-4dca-4109-ad96-dd557a1c23a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a955774d48a64a749fa84e6035d0e4d3', 'request_id': 'req-a1c53135-4dca-4109-ad96-dd557a1c23a6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:58.571364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a1c53135-4dca-4109-ad96-dd557a1c23a6 admin admin] The token cache is being invalidate because project a955774d48a64a749fa84e6035d0e4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:17:58.574040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a1c53135-4dca-4109-ad96-dd557a1c23a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:58.574607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a1c53135-4dca-4109-ad96-dd557a1c23a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:17:58.576967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1171/2346] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:17:58 2022] DELETE /identity/v3/projects/a955774d48a64a749fa84e6035d0e4d3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:17:58.581776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50f150-d6f8-4db6-a9e5-d815c19836cc None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:58.582070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50f150-d6f8-4db6-a9e5-d815c19836cc None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:58.582347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50f150-d6f8-4db6-a9e5-d815c19836cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:58.627482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-2a50f150-d6f8-4db6-a9e5-d815c19836cc None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:58.630483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2a50f150-d6f8-4db6-a9e5-d815c19836cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:58.747034 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1176/2347] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:58.756385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30615d-0d16-49b8-adf5-ecdb225cc3b2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:58.756675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30615d-0d16-49b8-adf5-ecdb225cc3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:58.756967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30615d-0d16-49b8-adf5-ecdb225cc3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:58.782881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-5a30615d-0d16-49b8-adf5-ecdb225cc3b2 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:58.785213 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5a30615d-0d16-49b8-adf5-ecdb225cc3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:58.796089 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1172/2348] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:58.802262 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50f150-d6f8-4db6-a9e5-d815c19836cc None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:58.813864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50f150-d6f8-4db6-a9e5-d815c19836cc None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:58.819875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f167879-fc70-4d5d-b11a-b6eb773b0f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:58.820623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f167879-fc70-4d5d-b11a-b6eb773b0f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:58.821140 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f167879-fc70-4d5d-b11a-b6eb773b0f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:58.821695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f167879-fc70-4d5d-b11a-b6eb773b0f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:58.822545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f167879-fc70-4d5d-b11a-b6eb773b0f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:17:58.822936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f167879-fc70-4d5d-b11a-b6eb773b0f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:58.824825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f167879-fc70-4d5d-b11a-b6eb773b0f00 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:58.829521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:58.842901 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1177/2349] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:17:58.848048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30615d-0d16-49b8-adf5-ecdb225cc3b2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:58.868619 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30615d-0d16-49b8-adf5-ecdb225cc3b2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:58.873912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28431bd9-852a-4ba9-97c1-369ec16fee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:58.875049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431bd9-852a-4ba9-97c1-369ec16fee23 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:58.875425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431bd9-852a-4ba9-97c1-369ec16fee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:58.875713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431bd9-852a-4ba9-97c1-369ec16fee23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:58.877458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28431bd9-852a-4ba9-97c1-369ec16fee23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:58.881510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28431bd9-852a-4ba9-97c1-369ec16fee23 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:58.915566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1173/2350] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:17:58 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:58.917173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f167879-fc70-4d5d-b11a-b6eb773b0f00 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:58.931483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f167879-fc70-4d5d-b11a-b6eb773b0f00 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:59.096831 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa86bf-5c15-4cc6-9eeb-fd3d0d482838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:59.097529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa86bf-5c15-4cc6-9eeb-fd3d0d482838 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:59.097822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa86bf-5c15-4cc6-9eeb-fd3d0d482838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:59.098095 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa86bf-5c15-4cc6-9eeb-fd3d0d482838 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:59.103687 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa86bf-5c15-4cc6-9eeb-fd3d0d482838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:59.105980 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa86bf-5c15-4cc6-9eeb-fd3d0d482838 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:59.144625 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1178/2351] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:17:58 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:17:59.148861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28431bd9-852a-4ba9-97c1-369ec16fee23 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:59.180040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28431bd9-852a-4ba9-97c1-369ec16fee23 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:59.185226 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba127e43-9cf1-4aaf-a552-56bb4d517a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:59.185975 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba127e43-9cf1-4aaf-a552-56bb4d517a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:59.186597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba127e43-9cf1-4aaf-a552-56bb4d517a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:59.187100 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba127e43-9cf1-4aaf-a552-56bb4d517a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:59.187896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba127e43-9cf1-4aaf-a552-56bb4d517a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:59.189840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba127e43-9cf1-4aaf-a552-56bb4d517a20 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:59.227012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1174/2352] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:17:59.236291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa86bf-5c15-4cc6-9eeb-fd3d0d482838 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:59.247254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa86bf-5c15-4cc6-9eeb-fd3d0d482838 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:59.253698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14eb25-6bf8-4384-ad9b-f5e592c75331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:59.254513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14eb25-6bf8-4384-ad9b-f5e592c75331 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:59.254990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14eb25-6bf8-4384-ad9b-f5e592c75331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:59.255282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14eb25-6bf8-4384-ad9b-f5e592c75331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:59.256214 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14eb25-6bf8-4384-ad9b-f5e592c75331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:59.258107 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14eb25-6bf8-4384-ad9b-f5e592c75331 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:59.271053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1179/2353] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:17:59.275433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba127e43-9cf1-4aaf-a552-56bb4d517a20 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:59.286747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba127e43-9cf1-4aaf-a552-56bb4d517a20 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:59.293385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2e225-cdb6-4fce-803b-7a593009ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:59.294302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2e225-cdb6-4fce-803b-7a593009ebb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:59.294593 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2e225-cdb6-4fce-803b-7a593009ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:59.294900 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2e225-cdb6-4fce-803b-7a593009ebb0 admin admin] PATH_INFO: `/v3/projects/9f03ce63407e4fbfbaa6ad3f938092e3/users/8685cd2e153049d3afce15fa2c807db1/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:59.312952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2e225-cdb6-4fce-803b-7a593009ebb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f03ce63407e4fbfbaa6ad3f938092e3, user_id=8685cd2e153049d3afce15fa2c807db1, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:59.317816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2e225-cdb6-4fce-803b-7a593009ebb0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:59.336221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1175/2354] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:17:59 2022] PUT /identity/v3/projects/9f03ce63407e4fbfbaa6ad3f938092e3/users/8685cd2e153049d3afce15fa2c807db1/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:17:59.348278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b8449-6de9-46b3-8679-93744a147226 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:59.348568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b8449-6de9-46b3-8679-93744a147226 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:59.348848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b8449-6de9-46b3-8679-93744a147226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:59.390078 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d14b8449-6de9-46b3-8679-93744a147226 None None] MFA Rules not processed for user `8685cd2e153049d3afce15fa2c807db1`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:17:59.391426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d14b8449-6de9-46b3-8679-93744a147226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:17:59.517231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1180/2355] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:17:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:17:59.521956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2e225-cdb6-4fce-803b-7a593009ebb0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:59.660572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2e225-cdb6-4fce-803b-7a593009ebb0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:59.671285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80766ab9-67d3-44fc-b582-3664669d801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:59.671858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80766ab9-67d3-44fc-b582-3664669d801a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:59.672120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80766ab9-67d3-44fc-b582-3664669d801a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:59.672528 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80766ab9-67d3-44fc-b582-3664669d801a admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:59.673315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80766ab9-67d3-44fc-b582-3664669d801a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:59.675729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80766ab9-67d3-44fc-b582-3664669d801a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:59.685034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:59.770069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1176/2356] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:17:59 2022] POST /identity/v3/projects => generated 389 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:59.771617 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b8449-6de9-46b3-8679-93744a147226 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:17:59.787070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b8449-6de9-46b3-8679-93744a147226 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:17:59.918565 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded93fb6-8bd0-4261-b05c-5c6118e5b731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:17:59.920709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded93fb6-8bd0-4261-b05c-5c6118e5b731 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:17:59.921148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded93fb6-8bd0-4261-b05c-5c6118e5b731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:17:59.921529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded93fb6-8bd0-4261-b05c-5c6118e5b731 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:17:59.922361 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded93fb6-8bd0-4261-b05c-5c6118e5b731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:17:59.926260 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded93fb6-8bd0-4261-b05c-5c6118e5b731 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:17:59.937678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:17:59.971993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1181/2357] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:17:59 2022] POST /identity/v3/users => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:17:59.982342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80766ab9-67d3-44fc-b582-3664669d801a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:00.005350 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80766ab9-67d3-44fc-b582-3664669d801a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:00.026788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8e03-2243-4e68-9fa2-fabbd6075ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:00.028262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8e03-2243-4e68-9fa2-fabbd6075ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:00.028701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8e03-2243-4e68-9fa2-fabbd6075ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:00.029123 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8e03-2243-4e68-9fa2-fabbd6075ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:00.030268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f8e03-2243-4e68-9fa2-fabbd6075ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:00.033806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f8e03-2243-4e68-9fa2-fabbd6075ea0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:00.055179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1177/2358] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:18:00.059625 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded93fb6-8bd0-4261-b05c-5c6118e5b731 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:00.087643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded93fb6-8bd0-4261-b05c-5c6118e5b731 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:00.093645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef750-2afb-44aa-806a-d949762cc0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:00.095237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef750-2afb-44aa-806a-d949762cc0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:00.097113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef750-2afb-44aa-806a-d949762cc0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:00.099179 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef750-2afb-44aa-806a-d949762cc0e0 admin admin] PATH_INFO: `/v3/projects/d0c1d6b24a744531a7b17220f6bb9f44/users/0277da7af39e4bf58bcd2d355b4fbbc8/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:00.122267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ef750-2afb-44aa-806a-d949762cc0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c1d6b24a744531a7b17220f6bb9f44, user_id=0277da7af39e4bf58bcd2d355b4fbbc8, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:00.125557 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ef750-2afb-44aa-806a-d949762cc0e0 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:00.156899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1182/2359] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:18:00 2022] PUT /identity/v3/projects/d0c1d6b24a744531a7b17220f6bb9f44/users/0277da7af39e4bf58bcd2d355b4fbbc8/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:00.162409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8e03-2243-4e68-9fa2-fabbd6075ea0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:00.177999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8e03-2243-4e68-9fa2-fabbd6075ea0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:00.290749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c00389-9b17-4d36-9070-bf04d3d5598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:00.291674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c00389-9b17-4d36-9070-bf04d3d5598a admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:00.292020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c00389-9b17-4d36-9070-bf04d3d5598a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:00.292388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c00389-9b17-4d36-9070-bf04d3d5598a admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:00.293627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c00389-9b17-4d36-9070-bf04d3d5598a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:00.310591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c00389-9b17-4d36-9070-bf04d3d5598a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:00.348108 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1178/2360] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:18:00.354968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef750-2afb-44aa-806a-d949762cc0e0 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:00.382822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef750-2afb-44aa-806a-d949762cc0e0 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:00.400055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e02380-3fee-4b1c-9145-aa86181b8a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:00.400975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e02380-3fee-4b1c-9145-aa86181b8a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:00.401324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e02380-3fee-4b1c-9145-aa86181b8a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:00.401606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e02380-3fee-4b1c-9145-aa86181b8a7e admin admin] PATH_INFO: `/v3/projects/d0c1d6b24a744531a7b17220f6bb9f44/users/0277da7af39e4bf58bcd2d355b4fbbc8/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:00.404026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e02380-3fee-4b1c-9145-aa86181b8a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c1d6b24a744531a7b17220f6bb9f44, user_id=0277da7af39e4bf58bcd2d355b4fbbc8, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:00.408562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e02380-3fee-4b1c-9145-aa86181b8a7e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:00.422732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1183/2361] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:18:00 2022] PUT /identity/v3/projects/d0c1d6b24a744531a7b17220f6bb9f44/users/0277da7af39e4bf58bcd2d355b4fbbc8/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:00.436461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b43a3f-58d9-47ce-a3e2-d0a091794aff None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:00.436745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b43a3f-58d9-47ce-a3e2-d0a091794aff None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:00.437035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b43a3f-58d9-47ce-a3e2-d0a091794aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:00.482446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-25b43a3f-58d9-47ce-a3e2-d0a091794aff None None] MFA Rules not processed for user `0277da7af39e4bf58bcd2d355b4fbbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:00.491869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-25b43a3f-58d9-47ce-a3e2-d0a091794aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:00.632615 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1179/2362] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:18:00.653578 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e02380-3fee-4b1c-9145-aa86181b8a7e admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:00.656586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-92e02380-3fee-4b1c-9145-aa86181b8a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:00.751198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e02380-3fee-4b1c-9145-aa86181b8a7e admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:00.761275 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bec97-096f-4651-a84d-72ad8f12b6ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:00.761958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bec97-096f-4651-a84d-72ad8f12b6ee service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:00.762274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bec97-096f-4651-a84d-72ad8f12b6ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:00.762690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bec97-096f-4651-a84d-72ad8f12b6ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:00.775519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bec97-096f-4651-a84d-72ad8f12b6ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:00.777060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bec97-096f-4651-a84d-72ad8f12b6ee service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:00.799065 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1184/2363] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:18:00.946837 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b43a3f-58d9-47ce-a3e2-d0a091794aff None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:01.018766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:01.025516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b43a3f-58d9-47ce-a3e2-d0a091794aff None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:01.033602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:01.034477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:01.034801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:01.035076 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] PATH_INFO: `/v3/users/8685cd2e153049d3afce15fa2c807db1` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:01.036592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8685cd2e153049d3afce15fa2c807db1)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:01.038551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:01.138223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8685cd2e153049d3afce15fa2c807db1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:01.152375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8685cd2e153049d3afce15fa2c807db1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:01.174761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8685cd2e153049d3afce15fa2c807db1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:01.179440 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8685cd2e153049d3afce15fa2c807db1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:01.180380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8685cd2e153049d3afce15fa2c807db1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:01.221385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1180/2364] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:18:00 2022] DELETE /identity/v3/users/8685cd2e153049d3afce15fa2c807db1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:01.226284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4531a-32cd-4c49-b9f1-2226e4185478 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:01.227893 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4531a-32cd-4c49-b9f1-2226e4185478 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:01.228533 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4531a-32cd-4c49-b9f1-2226e4185478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:01.253464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-32d4531a-32cd-4c49-b9f1-2226e4185478 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:01.255360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-32d4531a-32cd-4c49-b9f1-2226e4185478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:01.362962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1185/2365] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:18:01.376571 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:01.378273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:01.451646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433bc41-10f6-429b-8e95-fa6ee6ba62a1 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:01.456064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287de64a-9b1f-4491-a54e-568f4808a3a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:01.456708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287de64a-9b1f-4491-a54e-568f4808a3a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:01.456993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287de64a-9b1f-4491-a54e-568f4808a3a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:01.457272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287de64a-9b1f-4491-a54e-568f4808a3a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:01.466941 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287de64a-9b1f-4491-a54e-568f4808a3a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:01.468458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287de64a-9b1f-4491-a54e-568f4808a3a3 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:01.479441 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1181/2366] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:18:01.942427 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4531a-32cd-4c49-b9f1-2226e4185478 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:01.944334 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-32d4531a-32cd-4c49-b9f1-2226e4185478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:01.964071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4531a-32cd-4c49-b9f1-2226e4185478 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:01.979357 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:01.980243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:01.980559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:01.980864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] PATH_INFO: `/v3/projects/9f03ce63407e4fbfbaa6ad3f938092e3` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:01.982120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f03ce63407e4fbfbaa6ad3f938092e3)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:01.984228 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:02.052310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f03ce63407e4fbfbaa6ad3f938092e3', 'request_id': 'req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.055894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:02.060252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f03ce63407e4fbfbaa6ad3f938092e3', 'request_id': 'req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.070279 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f03ce63407e4fbfbaa6ad3f938092e3', 'request_id': 'req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.083947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] The token cache is being invalidate because project 9f03ce63407e4fbfbaa6ad3f938092e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:18:02.084446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.085250 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.087129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1186/2367] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:18:01 2022] DELETE /identity/v3/projects/9f03ce63407e4fbfbaa6ad3f938092e3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:18:02.091445 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287de64a-9b1f-4491-a54e-568f4808a3a3 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:02.112600 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287de64a-9b1f-4491-a54e-568f4808a3a3 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:02.202914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f9a32-6d97-410c-8948-c41003dea636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:02.204302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f9a32-6d97-410c-8948-c41003dea636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:02.205248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f9a32-6d97-410c-8948-c41003dea636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:02.205544 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f9a32-6d97-410c-8948-c41003dea636 admin admin] PATH_INFO: `/v3/users/0277da7af39e4bf58bcd2d355b4fbbc8` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:02.207244 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f9a32-6d97-410c-8948-c41003dea636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0277da7af39e4bf58bcd2d355b4fbbc8)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:02.209432 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f9a32-6d97-410c-8948-c41003dea636 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:02.252926 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:02.301737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-db9f9a32-6d97-410c-8948-c41003dea636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0277da7af39e4bf58bcd2d355b4fbbc8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.309583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-db9f9a32-6d97-410c-8948-c41003dea636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0277da7af39e4bf58bcd2d355b4fbbc8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.320255 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-db9f9a32-6d97-410c-8948-c41003dea636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0277da7af39e4bf58bcd2d355b4fbbc8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.320967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-db9f9a32-6d97-410c-8948-c41003dea636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0277da7af39e4bf58bcd2d355b4fbbc8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.322354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-db9f9a32-6d97-410c-8948-c41003dea636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0277da7af39e4bf58bcd2d355b4fbbc8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.342493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1182/2368] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:18:02 2022] DELETE /identity/v3/users/0277da7af39e4bf58bcd2d355b4fbbc8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:02.746945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:02.748594 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:02.762563 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbf015-dcc0-49f0-9629-1e38b3a0ccd8 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:02.826277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904146c4-09fb-4e58-889f-be688c3249f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:02.827213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904146c4-09fb-4e58-889f-be688c3249f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:02.827496 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904146c4-09fb-4e58-889f-be688c3249f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:02.827792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904146c4-09fb-4e58-889f-be688c3249f9 admin admin] PATH_INFO: `/v3/projects/d0c1d6b24a744531a7b17220f6bb9f44` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:02.829035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904146c4-09fb-4e58-889f-be688c3249f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c1d6b24a744531a7b17220f6bb9f44)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:02.831199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904146c4-09fb-4e58-889f-be688c3249f9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:02.887987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-904146c4-09fb-4e58-889f-be688c3249f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c1d6b24a744531a7b17220f6bb9f44', 'request_id': 'req-904146c4-09fb-4e58-889f-be688c3249f9'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.897336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-904146c4-09fb-4e58-889f-be688c3249f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c1d6b24a744531a7b17220f6bb9f44', 'request_id': 'req-904146c4-09fb-4e58-889f-be688c3249f9'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.908982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-904146c4-09fb-4e58-889f-be688c3249f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c1d6b24a744531a7b17220f6bb9f44', 'request_id': 'req-904146c4-09fb-4e58-889f-be688c3249f9'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.920002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-904146c4-09fb-4e58-889f-be688c3249f9 admin admin] The token cache is being invalidate because project d0c1d6b24a744531a7b17220f6bb9f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:18:02.920306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-904146c4-09fb-4e58-889f-be688c3249f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.921145 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-904146c4-09fb-4e58-889f-be688c3249f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:02.926666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1187/2369] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:18:02 2022] DELETE /identity/v3/projects/d0c1d6b24a744531a7b17220f6bb9f44 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:18:02.930736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd816f3-3286-4a5b-a401-40b4141f48bc None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:02.930736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd816f3-3286-4a5b-a401-40b4141f48bc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:02.930736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd816f3-3286-4a5b-a401-40b4141f48bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:02.950192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0fd816f3-3286-4a5b-a401-40b4141f48bc None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:02.951516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0fd816f3-3286-4a5b-a401-40b4141f48bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:03.029004 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1183/2370] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:18:03.038120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ced31f-b45e-42a8-9bca-d6ffb15b3c67 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.038410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ced31f-b45e-42a8-9bca-d6ffb15b3c67 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.038730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ced31f-b45e-42a8-9bca-d6ffb15b3c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.057767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-66ced31f-b45e-42a8-9bca-d6ffb15b3c67 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:03.059004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-66ced31f-b45e-42a8-9bca-d6ffb15b3c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:03.068303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1188/2371] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:18:03.074251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd816f3-3286-4a5b-a401-40b4141f48bc None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:03.086040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd816f3-3286-4a5b-a401-40b4141f48bc None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:03.090698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d76b4-ab81-401c-b807-14f03f64dd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:03.091353 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d76b4-ab81-401c-b807-14f03f64dd91 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.091642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d76b4-ab81-401c-b807-14f03f64dd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.092225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d76b4-ab81-401c-b807-14f03f64dd91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.092638 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d76b4-ab81-401c-b807-14f03f64dd91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:18:03.092947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d76b4-ab81-401c-b807-14f03f64dd91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:03.095078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d76b4-ab81-401c-b807-14f03f64dd91 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:03.107060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1184/2372] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:18:03.111861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ced31f-b45e-42a8-9bca-d6ffb15b3c67 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:03.121150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ced31f-b45e-42a8-9bca-d6ffb15b3c67 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:03.126331 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbca00-1f7e-444c-b55c-5b5fd5684130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:03.127037 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbca00-1f7e-444c-b55c-5b5fd5684130 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.127317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbca00-1f7e-444c-b55c-5b5fd5684130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.127588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbca00-1f7e-444c-b55c-5b5fd5684130 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.128299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbca00-1f7e-444c-b55c-5b5fd5684130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:03.130213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbca00-1f7e-444c-b55c-5b5fd5684130 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:03.156681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1189/2373] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:18:03 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:18:03.161252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d76b4-ab81-401c-b807-14f03f64dd91 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:03.171195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d76b4-ab81-401c-b807-14f03f64dd91 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:03.230116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12891126-75e1-4d09-9415-37d01cd4c8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:03.231166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12891126-75e1-4d09-9415-37d01cd4c8de admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.231455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12891126-75e1-4d09-9415-37d01cd4c8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.231737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12891126-75e1-4d09-9415-37d01cd4c8de admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.232447 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12891126-75e1-4d09-9415-37d01cd4c8de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:03.234383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12891126-75e1-4d09-9415-37d01cd4c8de admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:03.259982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1185/2374] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:18:03 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:18:03.263875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbca00-1f7e-444c-b55c-5b5fd5684130 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:03.276689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbca00-1f7e-444c-b55c-5b5fd5684130 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:03.301881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bad8bc-d210-4d05-a61d-a4446577d70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:03.303559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bad8bc-d210-4d05-a61d-a4446577d70c admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.304230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bad8bc-d210-4d05-a61d-a4446577d70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.304747 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bad8bc-d210-4d05-a61d-a4446577d70c admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.305901 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bad8bc-d210-4d05-a61d-a4446577d70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:03.308146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bad8bc-d210-4d05-a61d-a4446577d70c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:03.325285 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1190/2375] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:18:03.330510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12891126-75e1-4d09-9415-37d01cd4c8de admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:03.367111 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12891126-75e1-4d09-9415-37d01cd4c8de admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:03.375203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f27b34-1267-4349-8ddc-030a734eaa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:03.376310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f27b34-1267-4349-8ddc-030a734eaa52 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.376733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f27b34-1267-4349-8ddc-030a734eaa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.377180 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f27b34-1267-4349-8ddc-030a734eaa52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.378500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f27b34-1267-4349-8ddc-030a734eaa52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:03.381359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f27b34-1267-4349-8ddc-030a734eaa52 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:03.393478 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1186/2376] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:18:03.397678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bad8bc-d210-4d05-a61d-a4446577d70c admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:03.409426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bad8bc-d210-4d05-a61d-a4446577d70c admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:03.414116 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb26847-91f7-48ab-bc5b-8b2499512bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:03.415045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb26847-91f7-48ab-bc5b-8b2499512bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.415342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb26847-91f7-48ab-bc5b-8b2499512bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.415609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb26847-91f7-48ab-bc5b-8b2499512bd5 admin admin] PATH_INFO: `/v3/projects/ea73e95e9c7d4f69a6b6e9787692c140/users/0194f9aa601140708f4dca81417976fd/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.431160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb26847-91f7-48ab-bc5b-8b2499512bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea73e95e9c7d4f69a6b6e9787692c140, user_id=0194f9aa601140708f4dca81417976fd, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:03.433851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb26847-91f7-48ab-bc5b-8b2499512bd5 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:03.447843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1191/2377] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:18:03 2022] PUT /identity/v3/projects/ea73e95e9c7d4f69a6b6e9787692c140/users/0194f9aa601140708f4dca81417976fd/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:18:03.458819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da33d7-0cd2-4449-a8df-18dbb1c91777 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.459116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da33d7-0cd2-4449-a8df-18dbb1c91777 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.459397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da33d7-0cd2-4449-a8df-18dbb1c91777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.465323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:03.488712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-73da33d7-0cd2-4449-a8df-18dbb1c91777 None None] MFA Rules not processed for user `0194f9aa601140708f4dca81417976fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:03.490004 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-73da33d7-0cd2-4449-a8df-18dbb1c91777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:03.556978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1187/2378] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:18:03.561423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb26847-91f7-48ab-bc5b-8b2499512bd5 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:03.571752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:03.628797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb26847-91f7-48ab-bc5b-8b2499512bd5 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:03.642322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccc97c-34a9-4e86-a61f-7b745ed125f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:03.643059 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccc97c-34a9-4e86-a61f-7b745ed125f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.643336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccc97c-34a9-4e86-a61f-7b745ed125f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.643609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccc97c-34a9-4e86-a61f-7b745ed125f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.644330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccc97c-34a9-4e86-a61f-7b745ed125f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:03.646256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccc97c-34a9-4e86-a61f-7b745ed125f1 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:03.683752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1192/2379] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:18:03 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:18:03.689455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da33d7-0cd2-4449-a8df-18dbb1c91777 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:03.701573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da33d7-0cd2-4449-a8df-18dbb1c91777 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:03.786251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442d52a-9d3f-422d-a321-d4b9f953c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:03.791018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442d52a-9d3f-422d-a321-d4b9f953c12f admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.791018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442d52a-9d3f-422d-a321-d4b9f953c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.791018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442d52a-9d3f-422d-a321-d4b9f953c12f admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.791018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442d52a-9d3f-422d-a321-d4b9f953c12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:03.791018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442d52a-9d3f-422d-a321-d4b9f953c12f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:03.818813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1188/2380] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:18:03 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:18:03.822845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccc97c-34a9-4e86-a61f-7b745ed125f1 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:03.834212 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccc97c-34a9-4e86-a61f-7b745ed125f1 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:03.839766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e08fc-a1e4-4cd9-a2c4-982604f779ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:03.840596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e08fc-a1e4-4cd9-a2c4-982604f779ec admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.841024 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e08fc-a1e4-4cd9-a2c4-982604f779ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.841417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e08fc-a1e4-4cd9-a2c4-982604f779ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.842293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e08fc-a1e4-4cd9-a2c4-982604f779ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:03.844030 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e08fc-a1e4-4cd9-a2c4-982604f779ec admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:03.856570 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1193/2381] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:18:03.861794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442d52a-9d3f-422d-a321-d4b9f953c12f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:03.879143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442d52a-9d3f-422d-a321-d4b9f953c12f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:03.884857 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7b583-5fab-4e01-abdb-4872dad83e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:03.885541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7b583-5fab-4e01-abdb-4872dad83e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.886149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7b583-5fab-4e01-abdb-4872dad83e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.886576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7b583-5fab-4e01-abdb-4872dad83e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.890482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7b583-5fab-4e01-abdb-4872dad83e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:03.892604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7b583-5fab-4e01-abdb-4872dad83e2b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:03.904831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1189/2382] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:18:03.909498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e08fc-a1e4-4cd9-a2c4-982604f779ec admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:03.919293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e08fc-a1e4-4cd9-a2c4-982604f779ec admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:03.924829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354816a-61a0-4ccd-a76b-008f7812e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:03.925700 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354816a-61a0-4ccd-a76b-008f7812e7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.925983 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354816a-61a0-4ccd-a76b-008f7812e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.926257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354816a-61a0-4ccd-a76b-008f7812e7ce admin admin] PATH_INFO: `/v3/projects/9a0af56e8f264452a6799fb0a6262a53/users/3a202d70eb064f3f935745fcff6a2d07/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:03.943420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354816a-61a0-4ccd-a76b-008f7812e7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0af56e8f264452a6799fb0a6262a53, user_id=3a202d70eb064f3f935745fcff6a2d07, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:03.946160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354816a-61a0-4ccd-a76b-008f7812e7ce admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:03.964003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1194/2383] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:18:03 2022] PUT /identity/v3/projects/9a0af56e8f264452a6799fb0a6262a53/users/3a202d70eb064f3f935745fcff6a2d07/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:03.975726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db986b8-7951-4a79-be9f-a28be58bf75c None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:03.976011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db986b8-7951-4a79-be9f-a28be58bf75c None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:03.976285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db986b8-7951-4a79-be9f-a28be58bf75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:04.017666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0db986b8-7951-4a79-be9f-a28be58bf75c None None] MFA Rules not processed for user `3a202d70eb064f3f935745fcff6a2d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:04.018910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0db986b8-7951-4a79-be9f-a28be58bf75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:04.098095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:04.100329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1190/2384] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:18:04.104671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354816a-61a0-4ccd-a76b-008f7812e7ce admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:04.193274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354816a-61a0-4ccd-a76b-008f7812e7ce admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:04.200469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c92fb-8a25-4810-8dfe-938c6d7413c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:04.201141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c92fb-8a25-4810-8dfe-938c6d7413c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:04.201425 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c92fb-8a25-4810-8dfe-938c6d7413c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:04.201703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c92fb-8a25-4810-8dfe-938c6d7413c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:04.202401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c92fb-8a25-4810-8dfe-938c6d7413c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:04.205019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c92fb-8a25-4810-8dfe-938c6d7413c9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:04.241756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1195/2385] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:18:04 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:18:04.245824 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db986b8-7951-4a79-be9f-a28be58bf75c None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:04.257009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db986b8-7951-4a79-be9f-a28be58bf75c None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:04.318904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c677a44-9e70-4f4a-88d1-53e97a058ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:04.319572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c677a44-9e70-4f4a-88d1-53e97a058ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:04.319856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c677a44-9e70-4f4a-88d1-53e97a058ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:04.320125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c677a44-9e70-4f4a-88d1-53e97a058ddc admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:04.320826 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c677a44-9e70-4f4a-88d1-53e97a058ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:04.322819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c677a44-9e70-4f4a-88d1-53e97a058ddc admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:04.348019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1191/2386] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:18:04 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:18:04.349370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c92fb-8a25-4810-8dfe-938c6d7413c9 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:04.361683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c92fb-8a25-4810-8dfe-938c6d7413c9 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:04.388721 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45209563-0477-41a3-9092-a1ffcfd01463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:04.389395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45209563-0477-41a3-9092-a1ffcfd01463 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:04.389678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45209563-0477-41a3-9092-a1ffcfd01463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:04.389953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45209563-0477-41a3-9092-a1ffcfd01463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:04.390810 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45209563-0477-41a3-9092-a1ffcfd01463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:04.397455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45209563-0477-41a3-9092-a1ffcfd01463 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:04.421978 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1196/2387] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:18:04.423029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c677a44-9e70-4f4a-88d1-53e97a058ddc admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:04.434196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c677a44-9e70-4f4a-88d1-53e97a058ddc admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:04.439252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704661f6-0204-44fa-a9ad-a003c7089779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:04.440308 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704661f6-0204-44fa-a9ad-a003c7089779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:04.440589 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704661f6-0204-44fa-a9ad-a003c7089779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:04.440864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704661f6-0204-44fa-a9ad-a003c7089779 admin admin] PATH_INFO: `/v3/projects/dda722c14c8b4c47bab9516adc6793f2/users/b6c30aa306004c319291485dfd7c1d34/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:04.464902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704661f6-0204-44fa-a9ad-a003c7089779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda722c14c8b4c47bab9516adc6793f2, user_id=b6c30aa306004c319291485dfd7c1d34, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:04.474883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704661f6-0204-44fa-a9ad-a003c7089779 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:04.490271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1192/2388] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:18:04 2022] PUT /identity/v3/projects/dda722c14c8b4c47bab9516adc6793f2/users/b6c30aa306004c319291485dfd7c1d34/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:18:04.494289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45209563-0477-41a3-9092-a1ffcfd01463 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:04.506684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45209563-0477-41a3-9092-a1ffcfd01463 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:04.540840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:04.594771 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1590ba-4acc-4a42-91b4-9122c0fe745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:04.595265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1590ba-4acc-4a42-91b4-9122c0fe745b admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:04.595500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1590ba-4acc-4a42-91b4-9122c0fe745b admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:04.595781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1590ba-4acc-4a42-91b4-9122c0fe745b admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:04.596637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1590ba-4acc-4a42-91b4-9122c0fe745b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:04.598267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1590ba-4acc-4a42-91b4-9122c0fe745b admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:04.608750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1197/2389] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:18:04.613820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704661f6-0204-44fa-a9ad-a003c7089779 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:04.627269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704661f6-0204-44fa-a9ad-a003c7089779 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:04.632015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7409-f971-4c4a-9c70-22132852f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:04.632904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7409-f971-4c4a-9c70-22132852f25d admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:04.633190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7409-f971-4c4a-9c70-22132852f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:04.634101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7409-f971-4c4a-9c70-22132852f25d admin admin] PATH_INFO: `/v3/projects/dda722c14c8b4c47bab9516adc6793f2/users/b6c30aa306004c319291485dfd7c1d34/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:04.636356 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc7409-f971-4c4a-9c70-22132852f25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda722c14c8b4c47bab9516adc6793f2, user_id=b6c30aa306004c319291485dfd7c1d34, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:04.639043 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc7409-f971-4c4a-9c70-22132852f25d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:04.652369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1193/2390] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:18:04 2022] PUT /identity/v3/projects/dda722c14c8b4c47bab9516adc6793f2/users/b6c30aa306004c319291485dfd7c1d34/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:04.664421 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e600a-89f5-4827-9040-afdb30ea6395 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:04.664626 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e600a-89f5-4827-9040-afdb30ea6395 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:04.665120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e600a-89f5-4827-9040-afdb30ea6395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:04.692251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-834e600a-89f5-4827-9040-afdb30ea6395 None None] MFA Rules not processed for user `b6c30aa306004c319291485dfd7c1d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:04.693478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-834e600a-89f5-4827-9040-afdb30ea6395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:04.773362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1198/2391] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:18:04.785849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7409-f971-4c4a-9c70-22132852f25d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:04.787981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e9fc7409-f971-4c4a-9c70-22132852f25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:04.851119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7409-f971-4c4a-9c70-22132852f25d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:04.854903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b4c68-d162-4c0a-a59a-579e55b50ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:04.855554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4c68-d162-4c0a-a59a-579e55b50ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:04.855839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4c68-d162-4c0a-a59a-579e55b50ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:04.856122 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4c68-d162-4c0a-a59a-579e55b50ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:04.868177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b4c68-d162-4c0a-a59a-579e55b50ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:04.869659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b4c68-d162-4c0a-a59a-579e55b50ec6 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:04.882466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1194/2392] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:18:04.937032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e600a-89f5-4827-9040-afdb30ea6395 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:04.938950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-834e600a-89f5-4827-9040-afdb30ea6395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:04.960335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e600a-89f5-4827-9040-afdb30ea6395 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:04.968305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0942eb-84d0-4e5d-a19b-6e2961113600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:04.968305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0942eb-84d0-4e5d-a19b-6e2961113600 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:04.968305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0942eb-84d0-4e5d-a19b-6e2961113600 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:04.968305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0942eb-84d0-4e5d-a19b-6e2961113600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:05.048487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0942eb-84d0-4e5d-a19b-6e2961113600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:05.050005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0942eb-84d0-4e5d-a19b-6e2961113600 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:05.059886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1199/2393] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:18:08.367438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b4c68-d162-4c0a-a59a-579e55b50ec6 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:08.432594 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:08.440800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b4c68-d162-4c0a-a59a-579e55b50ec6 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:08.450025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:08.451021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:08.452220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:08.452220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] PATH_INFO: `/v3/users/0194f9aa601140708f4dca81417976fd` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:08.452965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0194f9aa601140708f4dca81417976fd)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:08.457030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:08.521898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0194f9aa601140708f4dca81417976fd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:08.531948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0194f9aa601140708f4dca81417976fd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:08.542373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0194f9aa601140708f4dca81417976fd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:08.543474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0194f9aa601140708f4dca81417976fd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:08.544110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0194f9aa601140708f4dca81417976fd'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:08.571214 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1195/2394] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:18:08 2022] DELETE /identity/v3/users/0194f9aa601140708f4dca81417976fd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:08.572304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2da716-cce9-4111-928b-b1166c16860e None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:08.573133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2da716-cce9-4111-928b-b1166c16860e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:08.574324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2da716-cce9-4111-928b-b1166c16860e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:08.600346 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-dd2da716-cce9-4111-928b-b1166c16860e None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:08.601585 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-dd2da716-cce9-4111-928b-b1166c16860e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:08.666754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:08.680308 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1200/2395] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:18:08.699376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:08.701550 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:08.827650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb75eb-de6b-42de-9f75-4016e81d4eeb admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:08.831586 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20734f1b-0047-4c99-973a-d057f8bfce82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:08.832537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20734f1b-0047-4c99-973a-d057f8bfce82 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:08.832824 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20734f1b-0047-4c99-973a-d057f8bfce82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:08.833160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20734f1b-0047-4c99-973a-d057f8bfce82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:08.843370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20734f1b-0047-4c99-973a-d057f8bfce82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:08.844957 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20734f1b-0047-4c99-973a-d057f8bfce82 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:08.857380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1196/2396] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:18:09.499568 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2da716-cce9-4111-928b-b1166c16860e None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:09.502609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-dd2da716-cce9-4111-928b-b1166c16860e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:09.537971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2da716-cce9-4111-928b-b1166c16860e None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:09.551119 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:09.552878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:09.563878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:09.564674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad admin admin] PATH_INFO: `/v3/projects/ea73e95e9c7d4f69a6b6e9787692c140` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:09.583996 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea73e95e9c7d4f69a6b6e9787692c140)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:09.585967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:09.669613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea73e95e9c7d4f69a6b6e9787692c140', 'request_id': 'req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:09.682344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea73e95e9c7d4f69a6b6e9787692c140', 'request_id': 'req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:09.693315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea73e95e9c7d4f69a6b6e9787692c140', 'request_id': 'req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:09.706324 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad admin admin] The token cache is being invalidate because project ea73e95e9c7d4f69a6b6e9787692c140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:18:09.707202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:09.708232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-f14ad1f5-8ca7-42a6-b66e-fc6b88d512ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:09.713848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1201/2397] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:18:09 2022] DELETE /identity/v3/projects/ea73e95e9c7d4f69a6b6e9787692c140 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:09.717750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20734f1b-0047-4c99-973a-d057f8bfce82 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:09.738029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20734f1b-0047-4c99-973a-d057f8bfce82 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:09.827305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:09.828249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:09.828583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:09.828896 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] PATH_INFO: `/v3/users/3a202d70eb064f3f935745fcff6a2d07` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:09.831125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a202d70eb064f3f935745fcff6a2d07)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:09.834606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:09.854727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d6c37-b577-4928-9765-09598ba0f825 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:09.855305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d6c37-b577-4928-9765-09598ba0f825 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:09.855760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d6c37-b577-4928-9765-09598ba0f825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:09.879446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:09.880104 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-747d6c37-b577-4928-9765-09598ba0f825 None None] MFA Rules not processed for user `771f36afce0a4dd8897bb22f3c330856`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:09.881862 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-747d6c37-b577-4928-9765-09598ba0f825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:09.910285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a202d70eb064f3f935745fcff6a2d07'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:09.918383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a202d70eb064f3f935745fcff6a2d07'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:09.929364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a202d70eb064f3f935745fcff6a2d07'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:09.930476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a202d70eb064f3f935745fcff6a2d07'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:09.931475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a202d70eb064f3f935745fcff6a2d07'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:09.952502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1197/2398] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:18:09 2022] DELETE /identity/v3/users/3a202d70eb064f3f935745fcff6a2d07 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:09.965425 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1202/2399] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:18:10.494500 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:10.496039 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:10.593696 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b68a3-2c81-4d32-baf5-45e0098e7e91 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:10.599177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:10.600096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:10.600455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:10.600737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] PATH_INFO: `/v3/projects/9a0af56e8f264452a6799fb0a6262a53` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:10.602727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0af56e8f264452a6799fb0a6262a53)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:10.604766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:10.666258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0af56e8f264452a6799fb0a6262a53', 'request_id': 'req-7b166a59-c704-4ded-b2e6-4a64079c2828'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:10.672945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0af56e8f264452a6799fb0a6262a53', 'request_id': 'req-7b166a59-c704-4ded-b2e6-4a64079c2828'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:10.680681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0af56e8f264452a6799fb0a6262a53', 'request_id': 'req-7b166a59-c704-4ded-b2e6-4a64079c2828'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:10.704986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] The token cache is being invalidate because project 9a0af56e8f264452a6799fb0a6262a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:18:10.705314 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:10.705956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:10.711310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1198/2400] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:18:10 2022] DELETE /identity/v3/projects/9a0af56e8f264452a6799fb0a6262a53 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:10.711909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d6c37-b577-4928-9765-09598ba0f825 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:10.724413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d6c37-b577-4928-9765-09598ba0f825 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:10.809876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c7610-0454-42aa-92e3-4ac20c19b5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:10.810955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c7610-0454-42aa-92e3-4ac20c19b5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:10.811440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c7610-0454-42aa-92e3-4ac20c19b5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:10.811932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c7610-0454-42aa-92e3-4ac20c19b5f1 admin admin] PATH_INFO: `/v3/users/b6c30aa306004c319291485dfd7c1d34` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:10.814675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c7610-0454-42aa-92e3-4ac20c19b5f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c30aa306004c319291485dfd7c1d34)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:10.816775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c7610-0454-42aa-92e3-4ac20c19b5f1 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:10.849203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:10.893893 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ce4c7610-0454-42aa-92e3-4ac20c19b5f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c30aa306004c319291485dfd7c1d34'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:10.902157 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ce4c7610-0454-42aa-92e3-4ac20c19b5f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c30aa306004c319291485dfd7c1d34'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:10.902894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ce4c7610-0454-42aa-92e3-4ac20c19b5f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c30aa306004c319291485dfd7c1d34'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:10.903664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ce4c7610-0454-42aa-92e3-4ac20c19b5f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c30aa306004c319291485dfd7c1d34'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:10.919220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-ce4c7610-0454-42aa-92e3-4ac20c19b5f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c30aa306004c319291485dfd7c1d34'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:10.943273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1203/2401] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:18:10 2022] DELETE /identity/v3/users/b6c30aa306004c319291485dfd7c1d34 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:18:11.358019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:11.377074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:11.408954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b166a59-c704-4ded-b2e6-4a64079c2828 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:11.437199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:11.482332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:11.483175 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:11.483463 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:11.483741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815 admin admin] PATH_INFO: `/v3/projects/dda722c14c8b4c47bab9516adc6793f2` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:11.486423 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda722c14c8b4c47bab9516adc6793f2)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:11.488400 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:11.548097 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda722c14c8b4c47bab9516adc6793f2', 'request_id': 'req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:11.556021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda722c14c8b4c47bab9516adc6793f2', 'request_id': 'req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:11.561914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda722c14c8b4c47bab9516adc6793f2', 'request_id': 'req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:11.577376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815 admin admin] The token cache is being invalidate because project dda722c14c8b4c47bab9516adc6793f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:18:11.577878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:11.578525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-0cbc5b73-e482-4b66-b62a-b71d4a0fa815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:11.580310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1199/2402] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:18:11 2022] DELETE /identity/v3/projects/dda722c14c8b4c47bab9516adc6793f2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:11.586487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0910b90-a976-438f-9728-851c0e1fd750 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:11.586904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0910b90-a976-438f-9728-851c0e1fd750 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:11.587275 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0910b90-a976-438f-9728-851c0e1fd750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:11.618784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f0910b90-a976-438f-9728-851c0e1fd750 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:11.620043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f0910b90-a976-438f-9728-851c0e1fd750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:11.685597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1204/2403] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:18:11.695405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b4ad-2420-4bf5-8221-19a43326614d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:11.695696 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b4ad-2420-4bf5-8221-19a43326614d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:11.695973 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b4ad-2420-4bf5-8221-19a43326614d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:11.714136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-fa18b4ad-2420-4bf5-8221-19a43326614d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:11.715378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fa18b4ad-2420-4bf5-8221-19a43326614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:11.723632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1200/2404] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:18:11.727705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0910b90-a976-438f-9728-851c0e1fd750 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:11.737983 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0910b90-a976-438f-9728-851c0e1fd750 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:11.742773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05418cfb-5cc0-411e-a945-da2bc0e42e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:11.743432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05418cfb-5cc0-411e-a945-da2bc0e42e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:11.743723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05418cfb-5cc0-411e-a945-da2bc0e42e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:11.743998 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05418cfb-5cc0-411e-a945-da2bc0e42e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:11.744738 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05418cfb-5cc0-411e-a945-da2bc0e42e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:18:11.745046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05418cfb-5cc0-411e-a945-da2bc0e42e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:11.746728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05418cfb-5cc0-411e-a945-da2bc0e42e8d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:11.760053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1205/2405] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:18:11.764280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18b4ad-2420-4bf5-8221-19a43326614d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:11.773771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18b4ad-2420-4bf5-8221-19a43326614d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:11.778499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b0218-c8bb-4485-9f57-a7f21b0e8517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:11.779175 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b0218-c8bb-4485-9f57-a7f21b0e8517 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:11.779461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b0218-c8bb-4485-9f57-a7f21b0e8517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:11.779736 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b0218-c8bb-4485-9f57-a7f21b0e8517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:11.780414 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b0218-c8bb-4485-9f57-a7f21b0e8517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:11.782476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b0218-c8bb-4485-9f57-a7f21b0e8517 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:11.807589 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1201/2406] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:18:11 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:18:11.811627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05418cfb-5cc0-411e-a945-da2bc0e42e8d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:11.822111 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05418cfb-5cc0-411e-a945-da2bc0e42e8d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:11.878476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0c5b-5338-4ced-86cd-b81e50c77262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:11.879175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0c5b-5338-4ced-86cd-b81e50c77262 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:11.879462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0c5b-5338-4ced-86cd-b81e50c77262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:11.879740 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0c5b-5338-4ced-86cd-b81e50c77262 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:11.880430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0c5b-5338-4ced-86cd-b81e50c77262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:11.882349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0c5b-5338-4ced-86cd-b81e50c77262 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:11.902930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1206/2407] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:18:11 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:18:11.907283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b0218-c8bb-4485-9f57-a7f21b0e8517 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:11.919302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b0218-c8bb-4485-9f57-a7f21b0e8517 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:11.924562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a00d53-1987-45cd-8b82-481eb7cbd521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:11.925228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a00d53-1987-45cd-8b82-481eb7cbd521 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:11.925514 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a00d53-1987-45cd-8b82-481eb7cbd521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:11.925791 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a00d53-1987-45cd-8b82-481eb7cbd521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:11.926517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a00d53-1987-45cd-8b82-481eb7cbd521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:11.928147 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a00d53-1987-45cd-8b82-481eb7cbd521 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:11.939728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1202/2408] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:18:11.944097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0c5b-5338-4ced-86cd-b81e50c77262 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:11.954410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0c5b-5338-4ced-86cd-b81e50c77262 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:11.959243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7a0ee-b1b0-4b2f-9167-0ec41aee55a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:11.959924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7a0ee-b1b0-4b2f-9167-0ec41aee55a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:11.960202 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7a0ee-b1b0-4b2f-9167-0ec41aee55a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:11.960482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7a0ee-b1b0-4b2f-9167-0ec41aee55a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:11.961668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7a0ee-b1b0-4b2f-9167-0ec41aee55a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:11.962846 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7a0ee-b1b0-4b2f-9167-0ec41aee55a6 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:11.965232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:11.977113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1207/2409] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:18:11.981225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a00d53-1987-45cd-8b82-481eb7cbd521 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:11.993689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a00d53-1987-45cd-8b82-481eb7cbd521 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:12.004855 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd7278-f54c-490f-a3a8-638bd783408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:12.006279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd7278-f54c-490f-a3a8-638bd783408a admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:12.006953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd7278-f54c-490f-a3a8-638bd783408a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:12.007542 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd7278-f54c-490f-a3a8-638bd783408a admin admin] PATH_INFO: `/v3/projects/5b992e14e0194ff38a5fcc41c6a4ad65/users/e644a21e9440461f8128df6be70c681a/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:12.035503 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd7278-f54c-490f-a3a8-638bd783408a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b992e14e0194ff38a5fcc41c6a4ad65, user_id=e644a21e9440461f8128df6be70c681a, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:12.038313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd7278-f54c-490f-a3a8-638bd783408a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:12.059380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1203/2410] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:18:11 2022] PUT /identity/v3/projects/5b992e14e0194ff38a5fcc41c6a4ad65/users/e644a21e9440461f8128df6be70c681a/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:12.071071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3a38c-dcf6-4e68-8478-5d13d36236dc None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:12.072604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3a38c-dcf6-4e68-8478-5d13d36236dc None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:12.072604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3a38c-dcf6-4e68-8478-5d13d36236dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:12.116164 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-b7c3a38c-dcf6-4e68-8478-5d13d36236dc None None] MFA Rules not processed for user `e644a21e9440461f8128df6be70c681a`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:12.117586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b7c3a38c-dcf6-4e68-8478-5d13d36236dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:12.236772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1208/2411] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:18:12.241002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd7278-f54c-490f-a3a8-638bd783408a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:12.320674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:12.338176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd7278-f54c-490f-a3a8-638bd783408a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:12.342973 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec3f47-eaf9-4a71-8567-b61bb81b0f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:12.343649 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec3f47-eaf9-4a71-8567-b61bb81b0f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:12.343939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec3f47-eaf9-4a71-8567-b61bb81b0f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:12.345397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec3f47-eaf9-4a71-8567-b61bb81b0f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:12.346143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec3f47-eaf9-4a71-8567-b61bb81b0f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:12.348125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec3f47-eaf9-4a71-8567-b61bb81b0f9c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:12.378177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1204/2412] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:18:12 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:18:12.381848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3a38c-dcf6-4e68-8478-5d13d36236dc None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:12.393573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3a38c-dcf6-4e68-8478-5d13d36236dc None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:12.465505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739d1e1-3563-4d60-b7d8-90d0b9afccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:12.466328 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739d1e1-3563-4d60-b7d8-90d0b9afccbf admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:12.466645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739d1e1-3563-4d60-b7d8-90d0b9afccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:12.467067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739d1e1-3563-4d60-b7d8-90d0b9afccbf admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:12.468138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739d1e1-3563-4d60-b7d8-90d0b9afccbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:12.471665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739d1e1-3563-4d60-b7d8-90d0b9afccbf admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:12.495993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1209/2413] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:18:12 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:18:12.501623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec3f47-eaf9-4a71-8567-b61bb81b0f9c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:12.514410 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec3f47-eaf9-4a71-8567-b61bb81b0f9c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:12.520067 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c7373-2a06-4837-874d-06c295f98509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:12.520873 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c7373-2a06-4837-874d-06c295f98509 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:12.521257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c7373-2a06-4837-874d-06c295f98509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:12.521655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c7373-2a06-4837-874d-06c295f98509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:12.532865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c7373-2a06-4837-874d-06c295f98509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:12.534667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c7373-2a06-4837-874d-06c295f98509 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:12.556686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1205/2414] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:18:12.560876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739d1e1-3563-4d60-b7d8-90d0b9afccbf admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:12.588077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739d1e1-3563-4d60-b7d8-90d0b9afccbf admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:12.593205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5829cd-e018-4ba2-b5fa-3baee7331b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:12.594097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5829cd-e018-4ba2-b5fa-3baee7331b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:12.595743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5829cd-e018-4ba2-b5fa-3baee7331b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:12.596037 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5829cd-e018-4ba2-b5fa-3baee7331b50 admin admin] PATH_INFO: `/v3/projects/335b6cc08a78486e8eb85fe6228cae86/users/b837e454c006438b84add9a1edda466c/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:12.614548 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5829cd-e018-4ba2-b5fa-3baee7331b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=335b6cc08a78486e8eb85fe6228cae86, user_id=b837e454c006438b84add9a1edda466c, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:12.617275 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5829cd-e018-4ba2-b5fa-3baee7331b50 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:12.638295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1210/2415] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:18:12 2022] PUT /identity/v3/projects/335b6cc08a78486e8eb85fe6228cae86/users/b837e454c006438b84add9a1edda466c/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:12.639578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c7373-2a06-4837-874d-06c295f98509 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:12.652413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c7373-2a06-4837-874d-06c295f98509 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:12.758562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2fd97-4ee2-4f52-9efc-d822f221e397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:12.759220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2fd97-4ee2-4f52-9efc-d822f221e397 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:12.759502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2fd97-4ee2-4f52-9efc-d822f221e397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:12.759774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2fd97-4ee2-4f52-9efc-d822f221e397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:12.760498 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2fd97-4ee2-4f52-9efc-d822f221e397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:12.762097 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2fd97-4ee2-4f52-9efc-d822f221e397 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:12.778654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1206/2416] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:18:12.781383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5829cd-e018-4ba2-b5fa-3baee7331b50 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:12.794544 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5829cd-e018-4ba2-b5fa-3baee7331b50 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:12.803265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a6c57-46ad-4a39-a897-81ddb93a00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:12.804220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a6c57-46ad-4a39-a897-81ddb93a00b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:12.804696 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a6c57-46ad-4a39-a897-81ddb93a00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:12.804968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a6c57-46ad-4a39-a897-81ddb93a00b0 admin admin] PATH_INFO: `/v3/projects/335b6cc08a78486e8eb85fe6228cae86/users/b837e454c006438b84add9a1edda466c/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:12.807423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a6c57-46ad-4a39-a897-81ddb93a00b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=335b6cc08a78486e8eb85fe6228cae86, user_id=b837e454c006438b84add9a1edda466c, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:12.810364 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a6c57-46ad-4a39-a897-81ddb93a00b0 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:12.823061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1211/2417] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:18:12 2022] PUT /identity/v3/projects/335b6cc08a78486e8eb85fe6228cae86/users/b837e454c006438b84add9a1edda466c/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:18:12.833739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67532b-314d-459b-933c-72287e887ac6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:12.834031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67532b-314d-459b-933c-72287e887ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:12.834305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67532b-314d-459b-933c-72287e887ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:12.877474 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7c67532b-314d-459b-933c-72287e887ac6 None None] MFA Rules not processed for user `b837e454c006438b84add9a1edda466c`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:12.878779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7c67532b-314d-459b-933c-72287e887ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:12.953280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1207/2418] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:18:12.965743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a6c57-46ad-4a39-a897-81ddb93a00b0 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:12.967741 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d78a6c57-46ad-4a39-a897-81ddb93a00b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:13.015189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:13.030995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a6c57-46ad-4a39-a897-81ddb93a00b0 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:13.035167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8478a97-0296-4f7b-b34a-f998bbc6c995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:13.035833 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8478a97-0296-4f7b-b34a-f998bbc6c995 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:13.036089 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8478a97-0296-4f7b-b34a-f998bbc6c995 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:13.036364 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8478a97-0296-4f7b-b34a-f998bbc6c995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:13.047068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8478a97-0296-4f7b-b34a-f998bbc6c995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:13.049710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8478a97-0296-4f7b-b34a-f998bbc6c995 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:13.060550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1212/2419] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:18:13.141123 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67532b-314d-459b-933c-72287e887ac6 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:13.151283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67532b-314d-459b-933c-72287e887ac6 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:13.155015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e0a37-9698-4e15-8296-ad0faaacc498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:13.155659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e0a37-9698-4e15-8296-ad0faaacc498 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:13.155945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e0a37-9698-4e15-8296-ad0faaacc498 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:13.156223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e0a37-9698-4e15-8296-ad0faaacc498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:13.206688 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:13.223596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e0a37-9698-4e15-8296-ad0faaacc498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:13.225105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e0a37-9698-4e15-8296-ad0faaacc498 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:13.236347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1208/2420] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:18:18.086722 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8478a97-0296-4f7b-b34a-f998bbc6c995 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:18.151362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8478a97-0296-4f7b-b34a-f998bbc6c995 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:18.156517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:18.157419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:18.157733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:18.158014 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] PATH_INFO: `/v3/users/e644a21e9440461f8128df6be70c681a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:18.159438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e644a21e9440461f8128df6be70c681a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:18.161553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:18.211567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e644a21e9440461f8128df6be70c681a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.218466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e644a21e9440461f8128df6be70c681a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.219185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e644a21e9440461f8128df6be70c681a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.219801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e644a21e9440461f8128df6be70c681a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.236876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e644a21e9440461f8128df6be70c681a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.249852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1213/2421] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:18:18 2022] DELETE /identity/v3/users/e644a21e9440461f8128df6be70c681a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:18.255384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5b763-91bc-4aa1-a5f9-bae7593d7dea None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:18.255849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5b763-91bc-4aa1-a5f9-bae7593d7dea None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:18.255960 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5b763-91bc-4aa1-a5f9-bae7593d7dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:18.273565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-11c5b763-91bc-4aa1-a5f9-bae7593d7dea None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:18.274975 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-11c5b763-91bc-4aa1-a5f9-bae7593d7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:18.333160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1209/2422] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:18:18.343003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:18.344385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:18.406547 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5f65f-f4e0-4aec-8f00-cf1ec7f3cc86 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:18.410510 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be54894-353d-4871-94d6-addef4759b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:18.411178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be54894-353d-4871-94d6-addef4759b15 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:18.411457 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be54894-353d-4871-94d6-addef4759b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:18.411728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be54894-353d-4871-94d6-addef4759b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:18.420641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be54894-353d-4871-94d6-addef4759b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:18.422219 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be54894-353d-4871-94d6-addef4759b15 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:18.432191 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1214/2423] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:18:18.736227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5b763-91bc-4aa1-a5f9-bae7593d7dea None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:18.738369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-11c5b763-91bc-4aa1-a5f9-bae7593d7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:18.752378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5b763-91bc-4aa1-a5f9-bae7593d7dea None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:18.757188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:18.758052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:18.758335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:18.758609 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] PATH_INFO: `/v3/projects/5b992e14e0194ff38a5fcc41c6a4ad65` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:18.761181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b992e14e0194ff38a5fcc41c6a4ad65)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:18.763203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:18.811715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b992e14e0194ff38a5fcc41c6a4ad65', 'request_id': 'req-47139263-be36-4a73-bcef-8ff3110f65a5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.818295 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b992e14e0194ff38a5fcc41c6a4ad65', 'request_id': 'req-47139263-be36-4a73-bcef-8ff3110f65a5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.825516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b992e14e0194ff38a5fcc41c6a4ad65', 'request_id': 'req-47139263-be36-4a73-bcef-8ff3110f65a5'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.840098 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] The token cache is being invalidate because project 5b992e14e0194ff38a5fcc41c6a4ad65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:18:18.840408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.841046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.842688 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1210/2424] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:18:18 2022] DELETE /identity/v3/projects/5b992e14e0194ff38a5fcc41c6a4ad65 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:18.847196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be54894-353d-4871-94d6-addef4759b15 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:18.853516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:18.857297 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be54894-353d-4871-94d6-addef4759b15 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:18.916945 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:18.917804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:18.918088 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:18.918495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] PATH_INFO: `/v3/users/b837e454c006438b84add9a1edda466c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:18.919793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b837e454c006438b84add9a1edda466c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:18.921983 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:18.968040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b837e454c006438b84add9a1edda466c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.976088 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b837e454c006438b84add9a1edda466c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.976815 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b837e454c006438b84add9a1edda466c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.977427 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b837e454c006438b84add9a1edda466c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:18.990033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b837e454c006438b84add9a1edda466c'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:19.004655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1215/2425] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:18:18 2022] DELETE /identity/v3/users/b837e454c006438b84add9a1edda466c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:19.623283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:19.624704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:19.638102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47139263-be36-4a73-bcef-8ff3110f65a5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:19.700551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62b055-b44d-4c13-8316-02a429444eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:19.701418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62b055-b44d-4c13-8316-02a429444eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:19.701724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62b055-b44d-4c13-8316-02a429444eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:19.702105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62b055-b44d-4c13-8316-02a429444eb8 admin admin] PATH_INFO: `/v3/projects/335b6cc08a78486e8eb85fe6228cae86` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:19.703327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62b055-b44d-4c13-8316-02a429444eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=335b6cc08a78486e8eb85fe6228cae86)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:19.705246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62b055-b44d-4c13-8316-02a429444eb8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:19.717285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:19.758976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6d62b055-b44d-4c13-8316-02a429444eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335b6cc08a78486e8eb85fe6228cae86', 'request_id': 'req-6d62b055-b44d-4c13-8316-02a429444eb8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:19.765415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6d62b055-b44d-4c13-8316-02a429444eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335b6cc08a78486e8eb85fe6228cae86', 'request_id': 'req-6d62b055-b44d-4c13-8316-02a429444eb8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:19.771886 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6d62b055-b44d-4c13-8316-02a429444eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335b6cc08a78486e8eb85fe6228cae86', 'request_id': 'req-6d62b055-b44d-4c13-8316-02a429444eb8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:19.784733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6d62b055-b44d-4c13-8316-02a429444eb8 admin admin] The token cache is being invalidate because project 335b6cc08a78486e8eb85fe6228cae86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:18:19.785060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6d62b055-b44d-4c13-8316-02a429444eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:19.785708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-6d62b055-b44d-4c13-8316-02a429444eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:19.787317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1211/2426] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:18:19 2022] DELETE /identity/v3/projects/335b6cc08a78486e8eb85fe6228cae86 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:29.000437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:29.781233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:38.127812 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:38.129463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:38.142405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982ac51-15ff-48c4-8562-f89688c5deec admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:38.210098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:38.210990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:38.211269 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:38.211543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] PATH_INFO: `/v3/users/6b572987586b4ed29a81fe93a054e6d1` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:38.213031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b572987586b4ed29a81fe93a054e6d1)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:38.214675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:38.260104 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b572987586b4ed29a81fe93a054e6d1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:38.266887 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b572987586b4ed29a81fe93a054e6d1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:38.267529 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b572987586b4ed29a81fe93a054e6d1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:38.268123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b572987586b4ed29a81fe93a054e6d1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:38.280397 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b572987586b4ed29a81fe93a054e6d1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:38.293045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1216/2427] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:18:38 2022] DELETE /identity/v3/users/6b572987586b4ed29a81fe93a054e6d1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:38.297533 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c8226-4619-4bed-83f8-39c28113ade5 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:38.298042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c8226-4619-4bed-83f8-39c28113ade5 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:38.298158 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c8226-4619-4bed-83f8-39c28113ade5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:38.315569 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6b5c8226-4619-4bed-83f8-39c28113ade5 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:38.317276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6b5c8226-4619-4bed-83f8-39c28113ade5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:38.376054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1212/2428] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:18:38.386090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:38.387638 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:38.447224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a5977-e970-46e4-a498-8eb88f04fff7 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:38.456381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a66248-a63d-443d-a2f1-e1e67b8c9fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:38.457072 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a66248-a63d-443d-a2f1-e1e67b8c9fec service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:38.457349 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a66248-a63d-443d-a2f1-e1e67b8c9fec service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:38.457621 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a66248-a63d-443d-a2f1-e1e67b8c9fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:38.468044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a66248-a63d-443d-a2f1-e1e67b8c9fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:38.469578 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a66248-a63d-443d-a2f1-e1e67b8c9fec service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:38.480449 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1217/2429] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:18:38.757573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c8226-4619-4bed-83f8-39c28113ade5 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:38.759171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6b5c8226-4619-4bed-83f8-39c28113ade5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:38.772396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c8226-4619-4bed-83f8-39c28113ade5 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:38.778893 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac6796-ad36-478d-8965-b33c600bbe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:38.780129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac6796-ad36-478d-8965-b33c600bbe58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:38.780476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac6796-ad36-478d-8965-b33c600bbe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:38.780751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac6796-ad36-478d-8965-b33c600bbe58 admin admin] PATH_INFO: `/v3/projects/d67f425c020241f3bfdba682390d0863` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:38.782004 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac6796-ad36-478d-8965-b33c600bbe58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67f425c020241f3bfdba682390d0863)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:38.784012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac6796-ad36-478d-8965-b33c600bbe58 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:38.842925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f2ac6796-ad36-478d-8965-b33c600bbe58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67f425c020241f3bfdba682390d0863', 'request_id': 'req-f2ac6796-ad36-478d-8965-b33c600bbe58'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:38.851945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f2ac6796-ad36-478d-8965-b33c600bbe58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67f425c020241f3bfdba682390d0863', 'request_id': 'req-f2ac6796-ad36-478d-8965-b33c600bbe58'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:38.858372 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f2ac6796-ad36-478d-8965-b33c600bbe58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67f425c020241f3bfdba682390d0863', 'request_id': 'req-f2ac6796-ad36-478d-8965-b33c600bbe58'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:38.871421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f2ac6796-ad36-478d-8965-b33c600bbe58 admin admin] The token cache is being invalidate because project d67f425c020241f3bfdba682390d0863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:18:38.871712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f2ac6796-ad36-478d-8965-b33c600bbe58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:38.872391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f2ac6796-ad36-478d-8965-b33c600bbe58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:18:38.873939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1213/2430] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:18:38 2022] DELETE /identity/v3/projects/d67f425c020241f3bfdba682390d0863 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:18:38.879817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14eec5-571f-43ae-af7e-4abd50ad0add None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:38.880101 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14eec5-571f-43ae-af7e-4abd50ad0add None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:38.880448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14eec5-571f-43ae-af7e-4abd50ad0add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:38.898900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-9e14eec5-571f-43ae-af7e-4abd50ad0add None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:38.900103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9e14eec5-571f-43ae-af7e-4abd50ad0add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:38.921498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:38.965043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1218/2431] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:18:38.972310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74113c-66fb-48ca-abae-1c63b2374025 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:38.973234 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74113c-66fb-48ca-abae-1c63b2374025 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:38.973524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74113c-66fb-48ca-abae-1c63b2374025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:38.992829 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2c74113c-66fb-48ca-abae-1c63b2374025 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:38.994030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2c74113c-66fb-48ca-abae-1c63b2374025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:39.002411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1214/2432] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:18:39.007210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14eec5-571f-43ae-af7e-4abd50ad0add None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:39.018956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14eec5-571f-43ae-af7e-4abd50ad0add None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:39.024070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f53038-cafe-45d0-8efa-7331e42d24e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:39.024713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f53038-cafe-45d0-8efa-7331e42d24e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:39.024992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f53038-cafe-45d0-8efa-7331e42d24e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:39.025263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f53038-cafe-45d0-8efa-7331e42d24e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:39.025984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f53038-cafe-45d0-8efa-7331e42d24e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:18:39.026285 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f53038-cafe-45d0-8efa-7331e42d24e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:39.027897 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f53038-cafe-45d0-8efa-7331e42d24e4 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:39.039687 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1219/2433] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:18:39.043884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74113c-66fb-48ca-abae-1c63b2374025 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:39.053151 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74113c-66fb-48ca-abae-1c63b2374025 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:39.057821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8545e-d00a-422e-9a3f-8a233f8be9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:39.058462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8545e-d00a-422e-9a3f-8a233f8be9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:39.058796 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8545e-d00a-422e-9a3f-8a233f8be9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:39.059073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8545e-d00a-422e-9a3f-8a233f8be9a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:39.059759 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8545e-d00a-422e-9a3f-8a233f8be9a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:39.061676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8545e-d00a-422e-9a3f-8a233f8be9a9 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:39.087295 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1215/2434] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:18:39 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:18:39.091372 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f53038-cafe-45d0-8efa-7331e42d24e4 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:39.101713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f53038-cafe-45d0-8efa-7331e42d24e4 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:39.169134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b622a-5a1c-44b2-aff8-96730eaa1d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:39.170161 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b622a-5a1c-44b2-aff8-96730eaa1d62 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:39.170481 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b622a-5a1c-44b2-aff8-96730eaa1d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:39.170975 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b622a-5a1c-44b2-aff8-96730eaa1d62 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:39.171844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b622a-5a1c-44b2-aff8-96730eaa1d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:39.173888 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b622a-5a1c-44b2-aff8-96730eaa1d62 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:39.193939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1220/2435] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:18:39 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:18:39.198015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8545e-d00a-422e-9a3f-8a233f8be9a9 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:39.209300 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8545e-d00a-422e-9a3f-8a233f8be9a9 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:39.213951 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c1f2c-f060-40be-aaf7-e5ff6e5a573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:39.214683 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1f2c-f060-40be-aaf7-e5ff6e5a573d admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:39.214969 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1f2c-f060-40be-aaf7-e5ff6e5a573d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:39.215246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1f2c-f060-40be-aaf7-e5ff6e5a573d admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:39.215967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c1f2c-f060-40be-aaf7-e5ff6e5a573d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:39.217556 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c1f2c-f060-40be-aaf7-e5ff6e5a573d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:39.228669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1216/2436] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:18:39.232450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b622a-5a1c-44b2-aff8-96730eaa1d62 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:39.242925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b622a-5a1c-44b2-aff8-96730eaa1d62 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:39.247664 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43296d3-4617-427c-982b-487022ef81e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:39.248321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43296d3-4617-427c-982b-487022ef81e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:39.248608 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43296d3-4617-427c-982b-487022ef81e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:39.248888 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43296d3-4617-427c-982b-487022ef81e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:39.249613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43296d3-4617-427c-982b-487022ef81e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:39.251504 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43296d3-4617-427c-982b-487022ef81e2 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:39.262326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1221/2437] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:18:39.266412 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c1f2c-f060-40be-aaf7-e5ff6e5a573d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:39.277363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c1f2c-f060-40be-aaf7-e5ff6e5a573d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:39.281964 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a03641-177d-4311-b407-9e6f6f95e80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:39.282867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a03641-177d-4311-b407-9e6f6f95e80a admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:39.283148 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a03641-177d-4311-b407-9e6f6f95e80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:39.283421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a03641-177d-4311-b407-9e6f6f95e80a admin admin] PATH_INFO: `/v3/projects/777dcae921534602988301776b6b6059/users/ed4ece8f397f4615b387f11224d51c0a/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:39.298159 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a03641-177d-4311-b407-9e6f6f95e80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=777dcae921534602988301776b6b6059, user_id=ed4ece8f397f4615b387f11224d51c0a, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:39.301119 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a03641-177d-4311-b407-9e6f6f95e80a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:39.314828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1217/2438] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:18:39 2022] PUT /identity/v3/projects/777dcae921534602988301776b6b6059/users/ed4ece8f397f4615b387f11224d51c0a/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:18:39.325387 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c456d3d-8ed1-4ed4-9068-df326384cd92 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:39.325679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c456d3d-8ed1-4ed4-9068-df326384cd92 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:39.325961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c456d3d-8ed1-4ed4-9068-df326384cd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:39.353758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-5c456d3d-8ed1-4ed4-9068-df326384cd92 None None] MFA Rules not processed for user `ed4ece8f397f4615b387f11224d51c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:18:39.355108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-5c456d3d-8ed1-4ed4-9068-df326384cd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:39.422816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1222/2439] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:18:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:18:39.433754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a03641-177d-4311-b407-9e6f6f95e80a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:39.435517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-84a03641-177d-4311-b407-9e6f6f95e80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:39.459981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:39.515548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a03641-177d-4311-b407-9e6f6f95e80a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:39.519230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14a2da-2bf4-46dc-af13-8051cacc26e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:39.520348 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14a2da-2bf4-46dc-af13-8051cacc26e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:39.520629 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14a2da-2bf4-46dc-af13-8051cacc26e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:39.520902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14a2da-2bf4-46dc-af13-8051cacc26e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:39.529068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14a2da-2bf4-46dc-af13-8051cacc26e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:39.530493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14a2da-2bf4-46dc-af13-8051cacc26e3 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:39.539911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1218/2440] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:39 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:18:43.927554 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c456d3d-8ed1-4ed4-9068-df326384cd92 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:43.928971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-5c456d3d-8ed1-4ed4-9068-df326384cd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:43.950593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:18:44.034150 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c456d3d-8ed1-4ed4-9068-df326384cd92 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:44.040232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a6770-4b6a-4264-9809-85c9ba60cfd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:44.040905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a6770-4b6a-4264-9809-85c9ba60cfd0 service placement] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:44.041190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a6770-4b6a-4264-9809-85c9ba60cfd0 service placement] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:44.041528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a6770-4b6a-4264-9809-85c9ba60cfd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:44.043667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d31a6770-4b6a-4264-9809-85c9ba60cfd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:44.056997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a6770-4b6a-4264-9809-85c9ba60cfd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:44.058609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a6770-4b6a-4264-9809-85c9ba60cfd0 service placement] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:44.068835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1223/2441] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:18:48.316101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14a2da-2bf4-46dc-af13-8051cacc26e3 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:48.317985 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3f14a2da-2bf4-46dc-af13-8051cacc26e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:48.374881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14a2da-2bf4-46dc-af13-8051cacc26e3 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:48.379526 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca25e9e-0909-4796-b296-e19597d110ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:48.380160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca25e9e-0909-4796-b296-e19597d110ba service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:48.380438 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca25e9e-0909-4796-b296-e19597d110ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:48.380712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca25e9e-0909-4796-b296-e19597d110ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:48.382466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2ca25e9e-0909-4796-b296-e19597d110ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:48.443721 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca25e9e-0909-4796-b296-e19597d110ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:48.445145 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca25e9e-0909-4796-b296-e19597d110ba service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:48.454575 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1219/2442] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:18:52.297499 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a6770-4b6a-4264-9809-85c9ba60cfd0 service placement] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:18:52.299028 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d31a6770-4b6a-4264-9809-85c9ba60cfd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:52.312679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a6770-4b6a-4264-9809-85c9ba60cfd0 service placement] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:18:52.317265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a08069-2447-4678-acf2-a1a3e5c129c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:18:52.317919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a08069-2447-4678-acf2-a1a3e5c129c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:18:52.318203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a08069-2447-4678-acf2-a1a3e5c129c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:18:52.318481 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a08069-2447-4678-acf2-a1a3e5c129c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:18:52.320296 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d8a08069-2447-4678-acf2-a1a3e5c129c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:18:52.417474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a08069-2447-4678-acf2-a1a3e5c129c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:18:52.418994 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a08069-2447-4678-acf2-a1a3e5c129c8 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:18:52.429867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1224/2443] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:18:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:18:58.450269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=76 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:02.424702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=63 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:05.312043 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7a14f-63ee-46d1-b4e9-efb6537d03af None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:05.312576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7a14f-63ee-46d1-b4e9-efb6537d03af None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:05.312576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7a14f-63ee-46d1-b4e9-efb6537d03af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:05.330965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d1d7a14f-63ee-46d1-b4e9-efb6537d03af None None] MFA Rules not processed for user `de0dccd8f960443894a99baa79198005`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:19:05.332366 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d1d7a14f-63ee-46d1-b4e9-efb6537d03af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:19:05.401794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1220/2444] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:19:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:19:15.394011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=25 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:18.346853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a08069-2447-4678-acf2-a1a3e5c129c8 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:18.417814 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a08069-2447-4678-acf2-a1a3e5c129c8 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:18.423806 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:18.424676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:18.424955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:18.425231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] PATH_INFO: `/v3/users/ed4ece8f397f4615b387f11224d51c0a` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:18.426534 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4ece8f397f4615b387f11224d51c0a)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:18.429713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:18.485877 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4ece8f397f4615b387f11224d51c0a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:18.494671 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4ece8f397f4615b387f11224d51c0a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:18.495389 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4ece8f397f4615b387f11224d51c0a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:18.496006 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4ece8f397f4615b387f11224d51c0a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:18.512242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4ece8f397f4615b387f11224d51c0a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:18.530556 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1225/2445] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:19:18 2022] DELETE /identity/v3/users/ed4ece8f397f4615b387f11224d51c0a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:19:18.534767 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923e90-6c39-40a7-ace0-591a427a4034 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:18.535245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923e90-6c39-40a7-ace0-591a427a4034 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:18.535452 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923e90-6c39-40a7-ace0-591a427a4034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:18.554266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2b923e90-6c39-40a7-ace0-591a427a4034 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:19:18.555630 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2b923e90-6c39-40a7-ace0-591a427a4034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:19:18.634844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1221/2446] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:19:18.644197 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:18.645756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:19:18.712187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d160bd-1d06-49aa-8263-56cdc9422baa admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:18.716579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dc0ed-0107-4f65-b8c9-57a4cf6e7924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:18.717260 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dc0ed-0107-4f65-b8c9-57a4cf6e7924 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:18.717545 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dc0ed-0107-4f65-b8c9-57a4cf6e7924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:18.717852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dc0ed-0107-4f65-b8c9-57a4cf6e7924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:18.727574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dc0ed-0107-4f65-b8c9-57a4cf6e7924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:18.729087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dc0ed-0107-4f65-b8c9-57a4cf6e7924 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:18.739242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1226/2447] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:19:19.029095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b923e90-6c39-40a7-ace0-591a427a4034 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:19.030768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2b923e90-6c39-40a7-ace0-591a427a4034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:19:19.045840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b923e90-6c39-40a7-ace0-591a427a4034 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:19.051028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632f20-f050-49c8-a4c8-beb16ae2a8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:19.052384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632f20-f050-49c8-a4c8-beb16ae2a8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:19.052948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632f20-f050-49c8-a4c8-beb16ae2a8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:19.053335 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632f20-f050-49c8-a4c8-beb16ae2a8e6 admin admin] PATH_INFO: `/v3/projects/777dcae921534602988301776b6b6059` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:19.054706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632f20-f050-49c8-a4c8-beb16ae2a8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777dcae921534602988301776b6b6059)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:19.056948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632f20-f050-49c8-a4c8-beb16ae2a8e6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:19.111691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-40632f20-f050-49c8-a4c8-beb16ae2a8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777dcae921534602988301776b6b6059', 'request_id': 'req-40632f20-f050-49c8-a4c8-beb16ae2a8e6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:19.118490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-40632f20-f050-49c8-a4c8-beb16ae2a8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777dcae921534602988301776b6b6059', 'request_id': 'req-40632f20-f050-49c8-a4c8-beb16ae2a8e6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:19.125890 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-40632f20-f050-49c8-a4c8-beb16ae2a8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777dcae921534602988301776b6b6059', 'request_id': 'req-40632f20-f050-49c8-a4c8-beb16ae2a8e6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:19.140384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-40632f20-f050-49c8-a4c8-beb16ae2a8e6 admin admin] The token cache is being invalidate because project 777dcae921534602988301776b6b6059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:19:19.140618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-40632f20-f050-49c8-a4c8-beb16ae2a8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:19.141245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-40632f20-f050-49c8-a4c8-beb16ae2a8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:19.142927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1222/2448] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:19:19 2022] DELETE /identity/v3/projects/777dcae921534602988301776b6b6059 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:19:19.148809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77f03b-7e78-4115-a9a7-3e58fe2e31f3 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:19.149148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77f03b-7e78-4115-a9a7-3e58fe2e31f3 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:19.149422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77f03b-7e78-4115-a9a7-3e58fe2e31f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:19.166564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-3a77f03b-7e78-4115-a9a7-3e58fe2e31f3 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:19:19.167782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-3a77f03b-7e78-4115-a9a7-3e58fe2e31f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:19:19.184027 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:19.226836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1227/2449] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:19:19.234447 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e25bf7-a646-4835-9ef1-6977e76102ac None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:19.234774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e25bf7-a646-4835-9ef1-6977e76102ac None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:19.235054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e25bf7-a646-4835-9ef1-6977e76102ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:19.253765 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d7e25bf7-a646-4835-9ef1-6977e76102ac None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:19:19.254984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d7e25bf7-a646-4835-9ef1-6977e76102ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:19:19.263522 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1223/2450] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:19:19.267613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77f03b-7e78-4115-a9a7-3e58fe2e31f3 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:19.277955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77f03b-7e78-4115-a9a7-3e58fe2e31f3 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:19.282460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d105c0-63c0-4ea8-8da5-b7a9d65ffd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:19.283142 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d105c0-63c0-4ea8-8da5-b7a9d65ffd73 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:19.283429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d105c0-63c0-4ea8-8da5-b7a9d65ffd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:19.283705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d105c0-63c0-4ea8-8da5-b7a9d65ffd73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:19.284450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d105c0-63c0-4ea8-8da5-b7a9d65ffd73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:19:19.284755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d105c0-63c0-4ea8-8da5-b7a9d65ffd73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:19.286343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d105c0-63c0-4ea8-8da5-b7a9d65ffd73 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:19.297932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1228/2451] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:19:19.302133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e25bf7-a646-4835-9ef1-6977e76102ac None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:19.311251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e25bf7-a646-4835-9ef1-6977e76102ac None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:19.315986 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99c09-0427-41a1-9153-5348e999153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:19.316664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99c09-0427-41a1-9153-5348e999153c admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:19.316954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99c09-0427-41a1-9153-5348e999153c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:19.317236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99c09-0427-41a1-9153-5348e999153c admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:19.317935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f99c09-0427-41a1-9153-5348e999153c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:19.320550 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f99c09-0427-41a1-9153-5348e999153c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:19.347166 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1224/2452] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:19:19 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:19:19.351280 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d105c0-63c0-4ea8-8da5-b7a9d65ffd73 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:19.361247 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d105c0-63c0-4ea8-8da5-b7a9d65ffd73 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:19.418097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de84de4-480b-4856-9d90-55c3cda7ae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:19.418710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de84de4-480b-4856-9d90-55c3cda7ae98 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:19.418999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de84de4-480b-4856-9d90-55c3cda7ae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:19.419408 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de84de4-480b-4856-9d90-55c3cda7ae98 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:19.420094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de84de4-480b-4856-9d90-55c3cda7ae98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:19.422021 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de84de4-480b-4856-9d90-55c3cda7ae98 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:19.441829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1229/2453] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:19:19 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:19:19.447058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99c09-0427-41a1-9153-5348e999153c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:19.457184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f99c09-0427-41a1-9153-5348e999153c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:19.461943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ecc1f-9750-46a1-b366-daf38906fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:19.462584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ecc1f-9750-46a1-b366-daf38906fad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:19.462890 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ecc1f-9750-46a1-b366-daf38906fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:19.463164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ecc1f-9750-46a1-b366-daf38906fad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:19.463871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ecc1f-9750-46a1-b366-daf38906fad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:19.465457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ecc1f-9750-46a1-b366-daf38906fad1 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:19.476216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1225/2454] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:19:19.480025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de84de4-480b-4856-9d90-55c3cda7ae98 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:19.489944 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de84de4-480b-4856-9d90-55c3cda7ae98 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:19.495518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead71a8-49cf-4530-b723-3d66909a8ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:19.496161 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead71a8-49cf-4530-b723-3d66909a8ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:19.496444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead71a8-49cf-4530-b723-3d66909a8ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:19.496719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead71a8-49cf-4530-b723-3d66909a8ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:19.497442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead71a8-49cf-4530-b723-3d66909a8ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:19.499062 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead71a8-49cf-4530-b723-3d66909a8ec9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:19.509440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1230/2455] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:19:19.513490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ecc1f-9750-46a1-b366-daf38906fad1 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:19.523901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ecc1f-9750-46a1-b366-daf38906fad1 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:19.528682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2c117-0d24-42f7-8fc5-89b81428a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:19.529538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2c117-0d24-42f7-8fc5-89b81428a273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:19.529815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2c117-0d24-42f7-8fc5-89b81428a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:19.530083 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2c117-0d24-42f7-8fc5-89b81428a273 admin admin] PATH_INFO: `/v3/projects/1d6458e051044bf595e1e162659d7aa7/users/83dab3b7dcd94a80a0d20dfa9b960024/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:19.545313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2c117-0d24-42f7-8fc5-89b81428a273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6458e051044bf595e1e162659d7aa7, user_id=83dab3b7dcd94a80a0d20dfa9b960024, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:19.548108 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2c117-0d24-42f7-8fc5-89b81428a273 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:19.560706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1226/2456] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:19:19 2022] PUT /identity/v3/projects/1d6458e051044bf595e1e162659d7aa7/users/83dab3b7dcd94a80a0d20dfa9b960024/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:19:19.571056 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b828032-e7d7-4921-aeaa-6f929015cd6f None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:19.571577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b828032-e7d7-4921-aeaa-6f929015cd6f None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:19.571865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b828032-e7d7-4921-aeaa-6f929015cd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:19.599253 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-0b828032-e7d7-4921-aeaa-6f929015cd6f None None] MFA Rules not processed for user `83dab3b7dcd94a80a0d20dfa9b960024`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:19:19.601526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0b828032-e7d7-4921-aeaa-6f929015cd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:19:19.665117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1231/2457] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:19:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:19:19.676721 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2c117-0d24-42f7-8fc5-89b81428a273 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:19.678410 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-78a2c117-0d24-42f7-8fc5-89b81428a273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:19:19.702385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:19.741237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2c117-0d24-42f7-8fc5-89b81428a273 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:19.744998 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238cb56-98fc-4d84-a9f6-dc91296d36da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:19.745645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238cb56-98fc-4d84-a9f6-dc91296d36da service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:19.745934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238cb56-98fc-4d84-a9f6-dc91296d36da service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:19.746217 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238cb56-98fc-4d84-a9f6-dc91296d36da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:19.755333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238cb56-98fc-4d84-a9f6-dc91296d36da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:19.756872 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238cb56-98fc-4d84-a9f6-dc91296d36da service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:19.767260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1227/2458] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:19:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:19:29.661539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:29.761938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=17 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:29.792415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b828032-e7d7-4921-aeaa-6f929015cd6f None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:29.854261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b828032-e7d7-4921-aeaa-6f929015cd6f None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:29.858728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:29.859582 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:29.859864 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:29.860136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] PATH_INFO: `/v3/users/83dab3b7dcd94a80a0d20dfa9b960024` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:29.861426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=83dab3b7dcd94a80a0d20dfa9b960024)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:29.863376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:29.909403 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83dab3b7dcd94a80a0d20dfa9b960024'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:29.916218 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83dab3b7dcd94a80a0d20dfa9b960024'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:29.916856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83dab3b7dcd94a80a0d20dfa9b960024'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:29.917448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83dab3b7dcd94a80a0d20dfa9b960024'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:29.928908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83dab3b7dcd94a80a0d20dfa9b960024'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:29.941566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1232/2459] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:19:29 2022] DELETE /identity/v3/users/83dab3b7dcd94a80a0d20dfa9b960024 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:19:29.946831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d588e-913a-4bfe-9f2b-ed6e07f0fdbc None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:29.947269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d588e-913a-4bfe-9f2b-ed6e07f0fdbc None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:29.947553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d588e-913a-4bfe-9f2b-ed6e07f0fdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:29.964840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ae1d588e-913a-4bfe-9f2b-ed6e07f0fdbc None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:19:29.966049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ae1d588e-913a-4bfe-9f2b-ed6e07f0fdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:19:30.024876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1228/2460] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:19:30.034505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:30.035938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:19:30.093011 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bca315-57b7-4de3-b364-4d1702118d3a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:30.096580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528d8e-c84d-42bf-bb5d-30602e91ac57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:30.097213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528d8e-c84d-42bf-bb5d-30602e91ac57 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:30.097492 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528d8e-c84d-42bf-bb5d-30602e91ac57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:30.097779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528d8e-c84d-42bf-bb5d-30602e91ac57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:30.106866 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d528d8e-c84d-42bf-bb5d-30602e91ac57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:30.108239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d528d8e-c84d-42bf-bb5d-30602e91ac57 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:30.117533 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1233/2461] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:19:30.380517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d588e-913a-4bfe-9f2b-ed6e07f0fdbc None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:19:30.382050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ae1d588e-913a-4bfe-9f2b-ed6e07f0fdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:19:30.395257 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d588e-913a-4bfe-9f2b-ed6e07f0fdbc None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:19:30.400074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:19:30.400920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:30.401205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:30.401489 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] PATH_INFO: `/v3/projects/1d6458e051044bf595e1e162659d7aa7` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:30.402709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6458e051044bf595e1e162659d7aa7)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:19:30.404636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:19:30.451250 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6458e051044bf595e1e162659d7aa7', 'request_id': 'req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:30.457241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6458e051044bf595e1e162659d7aa7', 'request_id': 'req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:30.463494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6458e051044bf595e1e162659d7aa7', 'request_id': 'req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:30.475966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] The token cache is being invalidate because project 1d6458e051044bf595e1e162659d7aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:19:30.476253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:30.476875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:19:30.479002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1229/2462] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:19:30 2022] DELETE /identity/v3/projects/1d6458e051044bf595e1e162659d7aa7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:19:40.113414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:40.472936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:19:59.835355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cbc74-0ad1-414c-8d27-664889066652 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:19:59.835897 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cbc74-0ad1-414c-8d27-664889066652 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:19:59.836004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cbc74-0ad1-414c-8d27-664889066652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:19:59.854642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-be5cbc74-0ad1-414c-8d27-664889066652 None None] MFA Rules not processed for user `771f36afce0a4dd8897bb22f3c330856`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:19:59.855839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-be5cbc74-0ad1-414c-8d27-664889066652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:19:59.910222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1234/2463] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:19:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:20:09.903484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=25 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:15.485836 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:15.488323 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:15.550252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f8380-ed98-49d7-88d4-ec96e5ad6d5e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:15.554018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8549951-49e5-443e-a767-f2f2c6b771cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:15.554739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8549951-49e5-443e-a767-f2f2c6b771cd service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:15.555025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8549951-49e5-443e-a767-f2f2c6b771cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:15.555304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8549951-49e5-443e-a767-f2f2c6b771cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:15.557897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b8549951-49e5-443e-a767-f2f2c6b771cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:15.654817 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8549951-49e5-443e-a767-f2f2c6b771cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:15.656184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8549951-49e5-443e-a767-f2f2c6b771cd service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:15.677397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1230/2464] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:20:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:20:17.172179 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90a18-d015-4c65-9938-d7982bd02b9e None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:17.172709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90a18-d015-4c65-9938-d7982bd02b9e None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:17.172709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90a18-d015-4c65-9938-d7982bd02b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:17.237083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-bbf90a18-d015-4c65-9938-d7982bd02b9e None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:20:17.238581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-bbf90a18-d015-4c65-9938-d7982bd02b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:17.304085 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1235/2465] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 21 08:20:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:20:17.348839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8549951-49e5-443e-a767-f2f2c6b771cd service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:17.350315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b8549951-49e5-443e-a767-f2f2c6b771cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:17.437595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:17.454203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8549951-49e5-443e-a767-f2f2c6b771cd service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:17.459720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655e9e4-69bb-419b-a9bc-3283a7029350 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:17.460378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655e9e4-69bb-419b-a9bc-3283a7029350 service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:17.460664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655e9e4-69bb-419b-a9bc-3283a7029350 service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:17.461031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655e9e4-69bb-419b-a9bc-3283a7029350 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:17.470068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655e9e4-69bb-419b-a9bc-3283a7029350 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:17.471882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655e9e4-69bb-419b-a9bc-3283a7029350 service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:17.481397 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1231/2466] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:20:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:20:20.268209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faafb8-cbe0-4ca3-9ce8-56838d6eb6b5 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:20.268667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faafb8-cbe0-4ca3-9ce8-56838d6eb6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:20.268942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faafb8-cbe0-4ca3-9ce8-56838d6eb6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:20.299453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-b6faafb8-cbe0-4ca3-9ce8-56838d6eb6b5 None None] MFA Rules not processed for user `de0dccd8f960443894a99baa79198005`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:20:20.301080 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b6faafb8-cbe0-4ca3-9ce8-56838d6eb6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:20.404130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1236/2467] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:20:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:20:20.457132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655e9e4-69bb-419b-a9bc-3283a7029350 service swift] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:20.458644 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2655e9e4-69bb-419b-a9bc-3283a7029350 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:20.549854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655e9e4-69bb-419b-a9bc-3283a7029350 service swift] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:20.553502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d490f-01b4-49d8-9f40-58549764eeaa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31a233e2fc784b01a3a8a24599f3c1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:20.554143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d490f-01b4-49d8-9f40-58549764eeaa service glance] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:20.554426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d490f-01b4-49d8-9f40-58549764eeaa service glance] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:20.554734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d490f-01b4-49d8-9f40-58549764eeaa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:20.556518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-700d490f-01b4-49d8-9f40-58549764eeaa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:20.571617 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d490f-01b4-49d8-9f40-58549764eeaa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:20.573337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d490f-01b4-49d8-9f40-58549764eeaa service glance] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:20.586537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1232/2468] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:20:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:20:25.033403 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faafb8-cbe0-4ca3-9ce8-56838d6eb6b5 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:25.035170 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b6faafb8-cbe0-4ca3-9ce8-56838d6eb6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:25.095379 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d490f-01b4-49d8-9f40-58549764eeaa service glance] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:25.100715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-700d490f-01b4-49d8-9f40-58549764eeaa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:25.141027 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faafb8-cbe0-4ca3-9ce8-56838d6eb6b5 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:25.146714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e3615-6ab6-44af-afc9-abf6d8c55aab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:25.147536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e3615-6ab6-44af-afc9-abf6d8c55aab service placement] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:25.148752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e3615-6ab6-44af-afc9-abf6d8c55aab service placement] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:25.149114 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e3615-6ab6-44af-afc9-abf6d8c55aab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:25.151861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-826e3615-6ab6-44af-afc9-abf6d8c55aab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:25.172946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e3615-6ab6-44af-afc9-abf6d8c55aab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:25.175363 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e3615-6ab6-44af-afc9-abf6d8c55aab service placement] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:25.180984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=100 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:25.188590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1237/2469] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:20:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:20:25.194146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d490f-01b4-49d8-9f40-58549764eeaa service glance] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:25.200848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:25.202053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:25.202339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:25.202827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] PATH_INFO: `/v3/users/0143621344994e29b232c9e35c25d427` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:25.204087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0143621344994e29b232c9e35c25d427)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:25.211107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:25.265484 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0143621344994e29b232c9e35c25d427'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.272408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0143621344994e29b232c9e35c25d427'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.280681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0143621344994e29b232c9e35c25d427'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.281449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0143621344994e29b232c9e35c25d427'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.282114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0143621344994e29b232c9e35c25d427'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.287579 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:25.304930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1233/2470] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:20:25 2022] DELETE /identity/v3/users/0143621344994e29b232c9e35c25d427 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:20:25.486943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e3615-6ab6-44af-afc9-abf6d8c55aab service placement] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:25.500748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e3615-6ab6-44af-afc9-abf6d8c55aab service placement] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:25.560595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:25.561456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:25.561742 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:25.562022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] PATH_INFO: `/v3/projects/054a41c637b243f180a79969432bb3f8` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:25.563243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] RBAC: Authorizing `identity:delete_project(project_id=054a41c637b243f180a79969432bb3f8)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:25.565178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:25.628302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054a41c637b243f180a79969432bb3f8', 'request_id': 'req-247547f7-b85b-4931-a4ff-e6cb03f4944e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.638252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054a41c637b243f180a79969432bb3f8', 'request_id': 'req-247547f7-b85b-4931-a4ff-e6cb03f4944e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.645280 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054a41c637b243f180a79969432bb3f8', 'request_id': 'req-247547f7-b85b-4931-a4ff-e6cb03f4944e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.659044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] The token cache is being invalidate because project 054a41c637b243f180a79969432bb3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:20:25.659342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.660089 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.661645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1238/2471] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:20:25 2022] DELETE /identity/v3/projects/054a41c637b243f180a79969432bb3f8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:20:25.665554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:25.668067 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:25.682352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929bc61-5350-47c4-bda4-53030780ef57 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:25.741903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:25.742795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:25.743074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:25.743344 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] PATH_INFO: `/v3/users/648ee78be0c446bbbe02163298297aa1` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:25.745174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=648ee78be0c446bbbe02163298297aa1)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:25.747216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:25.796246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648ee78be0c446bbbe02163298297aa1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.806447 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648ee78be0c446bbbe02163298297aa1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.817009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648ee78be0c446bbbe02163298297aa1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.817897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648ee78be0c446bbbe02163298297aa1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.818777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648ee78be0c446bbbe02163298297aa1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:25.839252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1234/2472] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:20:25 2022] DELETE /identity/v3/users/648ee78be0c446bbbe02163298297aa1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:20:26.018638 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:26.018638 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:26.031277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247547f7-b85b-4931-a4ff-e6cb03f4944e admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:26.091395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:26.092263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:26.092546 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:26.092823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] PATH_INFO: `/v3/projects/f3022549ca964c5898ee77721e436521` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:26.094358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3022549ca964c5898ee77721e436521)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:26.096738 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:26.138404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:26.153836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3022549ca964c5898ee77721e436521', 'request_id': 'req-9c119f6a-2115-40e0-9e12-2ef40cd53db4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:26.164795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3022549ca964c5898ee77721e436521', 'request_id': 'req-9c119f6a-2115-40e0-9e12-2ef40cd53db4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:26.172640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3022549ca964c5898ee77721e436521', 'request_id': 'req-9c119f6a-2115-40e0-9e12-2ef40cd53db4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:26.183407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] The token cache is being invalidate because project f3022549ca964c5898ee77721e436521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:20:26.183693 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:26.184329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:20:26.185859 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1239/2473] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:20:26 2022] DELETE /identity/v3/projects/f3022549ca964c5898ee77721e436521 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:20:27.610529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:27.611981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:27.680447 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:27.685396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53efcca-33a3-478d-a001-f15676247521 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:27.750543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504a832-ebc1-40bb-9e84-e8abc5cba992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:27.751220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504a832-ebc1-40bb-9e84-e8abc5cba992 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:27.751761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504a832-ebc1-40bb-9e84-e8abc5cba992 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:27.752040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504a832-ebc1-40bb-9e84-e8abc5cba992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:27.753814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e504a832-ebc1-40bb-9e84-e8abc5cba992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:27.811881 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504a832-ebc1-40bb-9e84-e8abc5cba992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:27.813469 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504a832-ebc1-40bb-9e84-e8abc5cba992 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:27.822704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1235/2474] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:20:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:20:33.411224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:33.412615 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:33.471682 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c119f6a-2115-40e0-9e12-2ef40cd53db4 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:33.475245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80620-e09a-4283-9b56-4a031d9d31c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:33.475894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80620-e09a-4283-9b56-4a031d9d31c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:33.476181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80620-e09a-4283-9b56-4a031d9d31c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:33.476463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80620-e09a-4283-9b56-4a031d9d31c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:33.478286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1af80620-e09a-4283-9b56-4a031d9d31c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:33.542729 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80620-e09a-4283-9b56-4a031d9d31c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:33.544220 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80620-e09a-4283-9b56-4a031d9d31c3 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:33.553988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1240/2475] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:20:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:20:37.818369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=54 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:40.328785 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9f8e8-be50-4cd7-87fc-9b7394bb1e9d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:40.329437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9f8e8-be50-4cd7-87fc-9b7394bb1e9d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:40.329437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9f8e8-be50-4cd7-87fc-9b7394bb1e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:40.347073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-fac9f8e8-be50-4cd7-87fc-9b7394bb1e9d None None] MFA Rules not processed for user `62c0039007d641c0aedaa781acaa0abe`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:20:40.348274 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fac9f8e8-be50-4cd7-87fc-9b7394bb1e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:40.355846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1236/2476] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:20:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:20:40.654519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80620-e09a-4283-9b56-4a031d9d31c3 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:40.656009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1af80620-e09a-4283-9b56-4a031d9d31c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:40.714148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80620-e09a-4283-9b56-4a031d9d31c3 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:40.717767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c431e-8742-45a7-b988-4be63590edde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:40.718327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c431e-8742-45a7-b988-4be63590edde service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:40.718605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c431e-8742-45a7-b988-4be63590edde service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:40.718907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c431e-8742-45a7-b988-4be63590edde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:40.720629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4f9c431e-8742-45a7-b988-4be63590edde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:40.731276 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c431e-8742-45a7-b988-4be63590edde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:40.732690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c431e-8742-45a7-b988-4be63590edde service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:40.740633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1241/2477] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:20:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:20:41.060362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9f8e8-be50-4cd7-87fc-9b7394bb1e9d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:41.061888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fac9f8e8-be50-4cd7-87fc-9b7394bb1e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:41.142779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9f8e8-be50-4cd7-87fc-9b7394bb1e9d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:41.147856 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8507730-a5b0-4358-9993-ba61eaac0bbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:41.148513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8507730-a5b0-4358-9993-ba61eaac0bbf service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:41.148826 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8507730-a5b0-4358-9993-ba61eaac0bbf service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:41.149097 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8507730-a5b0-4358-9993-ba61eaac0bbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:41.151663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b8507730-a5b0-4358-9993-ba61eaac0bbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:41.169130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8507730-a5b0-4358-9993-ba61eaac0bbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:41.170369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8507730-a5b0-4358-9993-ba61eaac0bbf service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:41.180692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1237/2478] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:20:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:20:41.504495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c431e-8742-45a7-b988-4be63590edde service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:41.516935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c431e-8742-45a7-b988-4be63590edde service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:41.521629 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62337c76-40af-4ef4-8cc0-cc9ff40f3204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:41.522278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62337c76-40af-4ef4-8cc0-cc9ff40f3204 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:41.522562 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62337c76-40af-4ef4-8cc0-cc9ff40f3204 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:41.522898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62337c76-40af-4ef4-8cc0-cc9ff40f3204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:41.524670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-62337c76-40af-4ef4-8cc0-cc9ff40f3204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:41.538837 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:41.596963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62337c76-40af-4ef4-8cc0-cc9ff40f3204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:41.598543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62337c76-40af-4ef4-8cc0-cc9ff40f3204 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:41.608197 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1242/2479] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:20:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:20:46.456185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8507730-a5b0-4358-9993-ba61eaac0bbf service placement] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:46.457638 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b8507730-a5b0-4358-9993-ba61eaac0bbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:46.469399 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8507730-a5b0-4358-9993-ba61eaac0bbf service placement] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:46.473185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf011f0c-204e-463a-b0ac-4d2dde65f58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:46.473815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf011f0c-204e-463a-b0ac-4d2dde65f58b service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:46.474091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf011f0c-204e-463a-b0ac-4d2dde65f58b service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:46.474362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf011f0c-204e-463a-b0ac-4d2dde65f58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:46.476177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cf011f0c-204e-463a-b0ac-4d2dde65f58b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:46.486053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf011f0c-204e-463a-b0ac-4d2dde65f58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:46.487505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf011f0c-204e-463a-b0ac-4d2dde65f58b service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:46.496164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1238/2480] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:20:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:20:51.603905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=21 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:56.491965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=41 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:20:57.760135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62337c76-40af-4ef4-8cc0-cc9ff40f3204 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:20:57.761763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-62337c76-40af-4ef4-8cc0-cc9ff40f3204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:57.778313 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62337c76-40af-4ef4-8cc0-cc9ff40f3204 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:20:57.783969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1595c4d-4535-44d9-91da-3a494c64621a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:20:57.784717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1595c4d-4535-44d9-91da-3a494c64621a service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:20:57.785073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1595c4d-4535-44d9-91da-3a494c64621a service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:20:57.785417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1595c4d-4535-44d9-91da-3a494c64621a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:20:57.787353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b1595c4d-4535-44d9-91da-3a494c64621a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:20:57.800444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1595c4d-4535-44d9-91da-3a494c64621a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:20:57.802029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1595c4d-4535-44d9-91da-3a494c64621a service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:20:57.812646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1243/2481] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:20:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:01.924321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf011f0c-204e-463a-b0ac-4d2dde65f58b service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:01.932833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf011f0c-204e-463a-b0ac-4d2dde65f58b service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:01.936366 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e26f9d-41f6-40d3-99ac-97bf4834a999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:01.936988 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e26f9d-41f6-40d3-99ac-97bf4834a999 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:01.937268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e26f9d-41f6-40d3-99ac-97bf4834a999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:01.937540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e26f9d-41f6-40d3-99ac-97bf4834a999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:01.939272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d1e26f9d-41f6-40d3-99ac-97bf4834a999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:02.005566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e26f9d-41f6-40d3-99ac-97bf4834a999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:02.006644 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e26f9d-41f6-40d3-99ac-97bf4834a999 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:02.017807 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1239/2482] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:05.038490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1595c4d-4535-44d9-91da-3a494c64621a service nova] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:05.040026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b1595c4d-4535-44d9-91da-3a494c64621a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:05.053561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1595c4d-4535-44d9-91da-3a494c64621a service nova] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:05.059283 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0f08f-a0ea-42eb-9a4e-c830527bd7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:05.060181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0f08f-a0ea-42eb-9a4e-c830527bd7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:05.060461 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0f08f-a0ea-42eb-9a4e-c830527bd7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:05.060737 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0f08f-a0ea-42eb-9a4e-c830527bd7e8 admin admin] PATH_INFO: `/v3/users/771f36afce0a4dd8897bb22f3c330856` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:05.061935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0f08f-a0ea-42eb-9a4e-c830527bd7e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771f36afce0a4dd8897bb22f3c330856)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:05.064312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0f08f-a0ea-42eb-9a4e-c830527bd7e8 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:05.113951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bac0f08f-a0ea-42eb-9a4e-c830527bd7e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771f36afce0a4dd8897bb22f3c330856'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:05.121675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bac0f08f-a0ea-42eb-9a4e-c830527bd7e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771f36afce0a4dd8897bb22f3c330856'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:05.122330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bac0f08f-a0ea-42eb-9a4e-c830527bd7e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771f36afce0a4dd8897bb22f3c330856'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:05.122943 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bac0f08f-a0ea-42eb-9a4e-c830527bd7e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771f36afce0a4dd8897bb22f3c330856'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:05.134924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-bac0f08f-a0ea-42eb-9a4e-c830527bd7e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771f36afce0a4dd8897bb22f3c330856'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:05.148187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1244/2483] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:21:05 2022] DELETE /identity/v3/users/771f36afce0a4dd8897bb22f3c330856 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:05.324731 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e26f9d-41f6-40d3-99ac-97bf4834a999 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:05.335647 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e26f9d-41f6-40d3-99ac-97bf4834a999 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:05.394518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070b099-c6a6-4174-b856-6dd5f663caa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:05.395395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070b099-c6a6-4174-b856-6dd5f663caa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:05.395674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070b099-c6a6-4174-b856-6dd5f663caa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:05.395949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070b099-c6a6-4174-b856-6dd5f663caa8 admin admin] PATH_INFO: `/v3/projects/2001b029fae0472d8ef7b6fd658ad191` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:05.397103 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070b099-c6a6-4174-b856-6dd5f663caa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2001b029fae0472d8ef7b6fd658ad191)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:05.399060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070b099-c6a6-4174-b856-6dd5f663caa8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:05.444596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1070b099-c6a6-4174-b856-6dd5f663caa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2001b029fae0472d8ef7b6fd658ad191', 'request_id': 'req-1070b099-c6a6-4174-b856-6dd5f663caa8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:05.450525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1070b099-c6a6-4174-b856-6dd5f663caa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2001b029fae0472d8ef7b6fd658ad191', 'request_id': 'req-1070b099-c6a6-4174-b856-6dd5f663caa8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:05.455895 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1070b099-c6a6-4174-b856-6dd5f663caa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2001b029fae0472d8ef7b6fd658ad191', 'request_id': 'req-1070b099-c6a6-4174-b856-6dd5f663caa8'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:05.468983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1070b099-c6a6-4174-b856-6dd5f663caa8 admin admin] The token cache is being invalidate because project 2001b029fae0472d8ef7b6fd658ad191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:21:05.469300 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1070b099-c6a6-4174-b856-6dd5f663caa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:05.470008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1070b099-c6a6-4174-b856-6dd5f663caa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:05.471816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1240/2484] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:21:05 2022] DELETE /identity/v3/projects/2001b029fae0472d8ef7b6fd658ad191 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:05.477007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6985e-f284-4771-a9ec-1b77eeb56a19 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:05.477302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6985e-f284-4771-a9ec-1b77eeb56a19 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:05.477581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6985e-f284-4771-a9ec-1b77eeb56a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:05.497419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-85d6985e-f284-4771-a9ec-1b77eeb56a19 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:05.498765 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-85d6985e-f284-4771-a9ec-1b77eeb56a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:05.557674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1245/2485] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:05.565081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e59fbb-94e4-4919-b200-c87278770798 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:05.565566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e59fbb-94e4-4919-b200-c87278770798 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:05.565845 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e59fbb-94e4-4919-b200-c87278770798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:05.587467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-47e59fbb-94e4-4919-b200-c87278770798 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:05.588715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-47e59fbb-94e4-4919-b200-c87278770798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:05.597499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1241/2486] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:05.601869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6985e-f284-4771-a9ec-1b77eeb56a19 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:05.611802 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6985e-f284-4771-a9ec-1b77eeb56a19 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:05.616482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a229-28d8-45ed-bfbb-8825b6a7403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:05.617136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a229-28d8-45ed-bfbb-8825b6a7403f admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:05.617422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a229-28d8-45ed-bfbb-8825b6a7403f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:05.617701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456a229-28d8-45ed-bfbb-8825b6a7403f admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:05.618429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456a229-28d8-45ed-bfbb-8825b6a7403f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:21:05.619031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456a229-28d8-45ed-bfbb-8825b6a7403f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:05.620357 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456a229-28d8-45ed-bfbb-8825b6a7403f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:05.632903 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1246/2487] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:21:05.637956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e59fbb-94e4-4919-b200-c87278770798 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:05.647496 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e59fbb-94e4-4919-b200-c87278770798 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:05.653619 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e7864-5be2-4147-9f21-929843d2fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:05.654288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e7864-5be2-4147-9f21-929843d2fed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:05.654570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e7864-5be2-4147-9f21-929843d2fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:05.654876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e7864-5be2-4147-9f21-929843d2fed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:05.655772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e7864-5be2-4147-9f21-929843d2fed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:05.657916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e7864-5be2-4147-9f21-929843d2fed3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:05.673648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:05.688626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1242/2488] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:21:05 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:05.692904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a229-28d8-45ed-bfbb-8825b6a7403f admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:05.703665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456a229-28d8-45ed-bfbb-8825b6a7403f admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:05.748913 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:05.764651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df2696-f53b-4869-b211-341306aac030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:05.765328 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df2696-f53b-4869-b211-341306aac030 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:05.765619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df2696-f53b-4869-b211-341306aac030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:05.765900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df2696-f53b-4869-b211-341306aac030 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:05.766607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df2696-f53b-4869-b211-341306aac030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:05.768613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df2696-f53b-4869-b211-341306aac030 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:05.796043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1247/2489] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:21:05 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:05.800099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e7864-5be2-4147-9f21-929843d2fed3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:05.810404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e7864-5be2-4147-9f21-929843d2fed3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:05.814940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e3222-0770-4192-9882-a4ee130e609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:05.815583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e3222-0770-4192-9882-a4ee130e609e admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:05.815860 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e3222-0770-4192-9882-a4ee130e609e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:05.816133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e3222-0770-4192-9882-a4ee130e609e admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:05.816839 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e3222-0770-4192-9882-a4ee130e609e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:05.818415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e3222-0770-4192-9882-a4ee130e609e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:05.829127 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1243/2490] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:05.832919 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df2696-f53b-4869-b211-341306aac030 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:05.843632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df2696-f53b-4869-b211-341306aac030 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:05.848242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0440e2-1e8a-4f59-a799-d2f78845f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:05.848883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0440e2-1e8a-4f59-a799-d2f78845f842 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:05.849167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0440e2-1e8a-4f59-a799-d2f78845f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:05.849441 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0440e2-1e8a-4f59-a799-d2f78845f842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:05.850155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0440e2-1e8a-4f59-a799-d2f78845f842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:05.851777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0440e2-1e8a-4f59-a799-d2f78845f842 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:05.861792 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1248/2491] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:05.865751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e3222-0770-4192-9882-a4ee130e609e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:05.875901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e3222-0770-4192-9882-a4ee130e609e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:05.881011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7a5ad-e12d-41f8-a69b-594a90caf4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:05.881891 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7a5ad-e12d-41f8-a69b-594a90caf4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:05.882173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7a5ad-e12d-41f8-a69b-594a90caf4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:05.882497 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7a5ad-e12d-41f8-a69b-594a90caf4cf admin admin] PATH_INFO: `/v3/projects/df68cafb6dcd4a8c9e9593d3f13500f0/users/2bc6e732127845a6be56f9b8be728f14/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:05.897533 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7a5ad-e12d-41f8-a69b-594a90caf4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=df68cafb6dcd4a8c9e9593d3f13500f0, user_id=2bc6e732127845a6be56f9b8be728f14, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:05.900359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7a5ad-e12d-41f8-a69b-594a90caf4cf admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:05.915405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1244/2492] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:05 2022] PUT /identity/v3/projects/df68cafb6dcd4a8c9e9593d3f13500f0/users/2bc6e732127845a6be56f9b8be728f14/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:05.920790 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a5be1-4af4-48c7-ae12-3d6c51cf449a None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:05.921086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a5be1-4af4-48c7-ae12-3d6c51cf449a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:05.921390 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a5be1-4af4-48c7-ae12-3d6c51cf449a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:05.939587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d11a5be1-4af4-48c7-ae12-3d6c51cf449a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:05.940891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d11a5be1-4af4-48c7-ae12-3d6c51cf449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:05.999890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1249/2493] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:06.009673 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7a5ad-e12d-41f8-a69b-594a90caf4cf admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:06.012353 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a0c7a5ad-e12d-41f8-a69b-594a90caf4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:06.071327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7a5ad-e12d-41f8-a69b-594a90caf4cf admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:06.075534 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ac363-99a2-4d4e-b310-1c1802435840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:06.076176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ac363-99a2-4d4e-b310-1c1802435840 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:06.076465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ac363-99a2-4d4e-b310-1c1802435840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:06.076741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ac363-99a2-4d4e-b310-1c1802435840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:06.086266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ac363-99a2-4d4e-b310-1c1802435840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:06.089573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ac363-99a2-4d4e-b310-1c1802435840 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:06.102934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1245/2494] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:10.143099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50b5be-44d5-4f3d-9701-d300b3bbc47d None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:10.143540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50b5be-44d5-4f3d-9701-d300b3bbc47d None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:10.143684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50b5be-44d5-4f3d-9701-d300b3bbc47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:10.181805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-0e50b5be-44d5-4f3d-9701-d300b3bbc47d None None] MFA Rules not processed for user `2bc6e732127845a6be56f9b8be728f14`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:10.186690 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0e50b5be-44d5-4f3d-9701-d300b3bbc47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:10.277800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1250/2495] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:10.305182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ac363-99a2-4d4e-b310-1c1802435840 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:10.307505 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-971ac363-99a2-4d4e-b310-1c1802435840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:10.431886 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ac363-99a2-4d4e-b310-1c1802435840 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:10.438224 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8332a-1da6-4aa6-a6dd-6fece028dd5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:10.438933 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8332a-1da6-4aa6-a6dd-6fece028dd5a service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:10.439219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8332a-1da6-4aa6-a6dd-6fece028dd5a service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:10.439595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8332a-1da6-4aa6-a6dd-6fece028dd5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:10.454989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8332a-1da6-4aa6-a6dd-6fece028dd5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:10.457106 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8332a-1da6-4aa6-a6dd-6fece028dd5a service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:10.467659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1246/2496] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:21:12.288828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745b094-c072-4c2b-8597-5b96551ce6ab None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:12.289696 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745b094-c072-4c2b-8597-5b96551ce6ab None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:12.290171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745b094-c072-4c2b-8597-5b96551ce6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:12.316962 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d745b094-c072-4c2b-8597-5b96551ce6ab None None] MFA Rules not processed for user `2bc6e732127845a6be56f9b8be728f14`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:12.318188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d745b094-c072-4c2b-8597-5b96551ce6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:12.327883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1251/2497] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:18.259192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3ec7e-5746-4919-bfab-d4d829ee8d8e None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:18.259782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3ec7e-5746-4919-bfab-d4d829ee8d8e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:18.259782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3ec7e-5746-4919-bfab-d4d829ee8d8e None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:18.261766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1247/2498] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:21:18.267939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84ebc9-17ec-486e-a225-207b1c91f866 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:18.268409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84ebc9-17ec-486e-a225-207b1c91f866 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:18.268537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84ebc9-17ec-486e-a225-207b1c91f866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:18.287356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-cc84ebc9-17ec-486e-a225-207b1c91f866 None None] MFA Rules not processed for user `cdac6ddece434ed7abddcffe841476ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:18.288625 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-cc84ebc9-17ec-486e-a225-207b1c91f866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:18.295345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1252/2499] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:21:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:18.308696 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3ec7e-5746-4919-bfab-d4d829ee8d8e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:18.319796 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3ec7e-5746-4919-bfab-d4d829ee8d8e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:18.323894 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dce34-7979-4f8e-8e46-5b09de9e00b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:18.324527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dce34-7979-4f8e-8e46-5b09de9e00b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:18.324805 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dce34-7979-4f8e-8e46-5b09de9e00b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:18.325077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dce34-7979-4f8e-8e46-5b09de9e00b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:18.332560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dce34-7979-4f8e-8e46-5b09de9e00b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:18.333974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dce34-7979-4f8e-8e46-5b09de9e00b8 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:18.342733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1248/2500] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:18.426915 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3669b-fdef-4fde-a3b1-978046167e56 None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:18.427207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3669b-fdef-4fde-a3b1-978046167e56 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:18.427483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3669b-fdef-4fde-a3b1-978046167e56 None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:18.428851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1253/2501] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:21:18.433712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bb855-8a37-4be5-8760-81cb6a19debf None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:18.434005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bb855-8a37-4be5-8760-81cb6a19debf None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:18.434314 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bb855-8a37-4be5-8760-81cb6a19debf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:18.469866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-861bb855-8a37-4be5-8760-81cb6a19debf None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:18.471154 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-861bb855-8a37-4be5-8760-81cb6a19debf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:18.480940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1249/2502] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:21:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:18.491630 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3669b-fdef-4fde-a3b1-978046167e56 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:18.504483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3669b-fdef-4fde-a3b1-978046167e56 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:18.508130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f32e0-3841-4f43-b671-f9891e37a5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:18.508752 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f32e0-3841-4f43-b671-f9891e37a5ca service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:18.509033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f32e0-3841-4f43-b671-f9891e37a5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:18.509308 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f32e0-3841-4f43-b671-f9891e37a5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:18.520156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f32e0-3841-4f43-b671-f9891e37a5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:18.521587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f32e0-3841-4f43-b671-f9891e37a5ca service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:18.533090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1254/2503] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:23.138678 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bb855-8a37-4be5-8760-81cb6a19debf None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:23.151570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bb855-8a37-4be5-8760-81cb6a19debf None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:23.157393 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36531962-dab5-45f2-b727-71fee6bca1c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:23.158045 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36531962-dab5-45f2-b727-71fee6bca1c8 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:23.158332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36531962-dab5-45f2-b727-71fee6bca1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:23.158608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36531962-dab5-45f2-b727-71fee6bca1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:23.160426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-36531962-dab5-45f2-b727-71fee6bca1c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:23.176221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36531962-dab5-45f2-b727-71fee6bca1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:23.177764 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36531962-dab5-45f2-b727-71fee6bca1c8 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:23.189768 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1250/2504] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:28.528251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:30.978028 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f32e0-3841-4f43-b671-f9891e37a5ca service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:30.987482 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f32e0-3841-4f43-b671-f9891e37a5ca service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:30.991302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec35a71-b4e9-4a43-88d3-7fb0b901fba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:30.991941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec35a71-b4e9-4a43-88d3-7fb0b901fba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:30.992253 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec35a71-b4e9-4a43-88d3-7fb0b901fba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:30.992553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec35a71-b4e9-4a43-88d3-7fb0b901fba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:30.994381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1ec35a71-b4e9-4a43-88d3-7fb0b901fba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:31.007350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec35a71-b4e9-4a43-88d3-7fb0b901fba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:31.008820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec35a71-b4e9-4a43-88d3-7fb0b901fba8 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:31.019405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1255/2505] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:33.184981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:34.111913 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36531962-dab5-45f2-b727-71fee6bca1c8 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:34.113662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-36531962-dab5-45f2-b727-71fee6bca1c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:34.133791 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36531962-dab5-45f2-b727-71fee6bca1c8 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:34.140782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b243a9-5039-4ec1-bbaa-c9fc1043053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:34.143599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b243a9-5039-4ec1-bbaa-c9fc1043053d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:34.144125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b243a9-5039-4ec1-bbaa-c9fc1043053d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:34.144897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b243a9-5039-4ec1-bbaa-c9fc1043053d admin admin] PATH_INFO: `/v3/users/de0dccd8f960443894a99baa79198005` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:34.155375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b243a9-5039-4ec1-bbaa-c9fc1043053d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0dccd8f960443894a99baa79198005)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:34.157346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b243a9-5039-4ec1-bbaa-c9fc1043053d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:34.246689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-54b243a9-5039-4ec1-bbaa-c9fc1043053d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0dccd8f960443894a99baa79198005'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:34.254888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-54b243a9-5039-4ec1-bbaa-c9fc1043053d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0dccd8f960443894a99baa79198005'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:34.263570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-54b243a9-5039-4ec1-bbaa-c9fc1043053d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0dccd8f960443894a99baa79198005'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:34.264623 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-54b243a9-5039-4ec1-bbaa-c9fc1043053d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0dccd8f960443894a99baa79198005'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:34.265390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-54b243a9-5039-4ec1-bbaa-c9fc1043053d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0dccd8f960443894a99baa79198005'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:34.300788 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1251/2506] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:21:34 2022] DELETE /identity/v3/users/de0dccd8f960443894a99baa79198005 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:34.482856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec35a71-b4e9-4a43-88d3-7fb0b901fba8 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:34.493116 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec35a71-b4e9-4a43-88d3-7fb0b901fba8 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:34.552906 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153fbb8-ce76-4cc1-9d74-cd43bd920720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:34.553762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153fbb8-ce76-4cc1-9d74-cd43bd920720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:34.554088 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153fbb8-ce76-4cc1-9d74-cd43bd920720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:34.554451 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153fbb8-ce76-4cc1-9d74-cd43bd920720 admin admin] PATH_INFO: `/v3/projects/d1a4467fae7e4bdea5a1e00c0379c326` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:34.555659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153fbb8-ce76-4cc1-9d74-cd43bd920720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a4467fae7e4bdea5a1e00c0379c326)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:34.558889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153fbb8-ce76-4cc1-9d74-cd43bd920720 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:34.606223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e153fbb8-ce76-4cc1-9d74-cd43bd920720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a4467fae7e4bdea5a1e00c0379c326', 'request_id': 'req-e153fbb8-ce76-4cc1-9d74-cd43bd920720'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:34.613477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e153fbb8-ce76-4cc1-9d74-cd43bd920720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a4467fae7e4bdea5a1e00c0379c326', 'request_id': 'req-e153fbb8-ce76-4cc1-9d74-cd43bd920720'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:34.620364 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e153fbb8-ce76-4cc1-9d74-cd43bd920720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a4467fae7e4bdea5a1e00c0379c326', 'request_id': 'req-e153fbb8-ce76-4cc1-9d74-cd43bd920720'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:34.631144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e153fbb8-ce76-4cc1-9d74-cd43bd920720 admin admin] The token cache is being invalidate because project d1a4467fae7e4bdea5a1e00c0379c326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:21:34.631425 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e153fbb8-ce76-4cc1-9d74-cd43bd920720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:34.632072 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-e153fbb8-ce76-4cc1-9d74-cd43bd920720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:34.633591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1256/2507] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:21:34 2022] DELETE /identity/v3/projects/d1a4467fae7e4bdea5a1e00c0379c326 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:34.638815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ecb23-9120-4320-9fd1-de7e33ac799f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:34.639103 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ecb23-9120-4320-9fd1-de7e33ac799f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:34.639378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ecb23-9120-4320-9fd1-de7e33ac799f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:34.657705 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-4a0ecb23-9120-4320-9fd1-de7e33ac799f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:34.658919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4a0ecb23-9120-4320-9fd1-de7e33ac799f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:34.715990 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1252/2508] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:34.723649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ac104-51ad-48fe-99e2-5ee49bde8431 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:34.723934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ac104-51ad-48fe-99e2-5ee49bde8431 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:34.724260 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ac104-51ad-48fe-99e2-5ee49bde8431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:34.743423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-461ac104-51ad-48fe-99e2-5ee49bde8431 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:34.744698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-461ac104-51ad-48fe-99e2-5ee49bde8431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:34.752901 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1257/2509] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:34.756992 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ecb23-9120-4320-9fd1-de7e33ac799f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:34.766568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ecb23-9120-4320-9fd1-de7e33ac799f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:34.771199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6da77f-7ad1-4fce-bf75-ca45e5b72fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:34.771844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6da77f-7ad1-4fce-bf75-ca45e5b72fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:34.772125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6da77f-7ad1-4fce-bf75-ca45e5b72fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:34.772399 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6da77f-7ad1-4fce-bf75-ca45e5b72fa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:34.773123 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6da77f-7ad1-4fce-bf75-ca45e5b72fa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:21:34.773425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6da77f-7ad1-4fce-bf75-ca45e5b72fa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:34.775054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6da77f-7ad1-4fce-bf75-ca45e5b72fa7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:34.787403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1253/2510] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:21:34.792059 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ac104-51ad-48fe-99e2-5ee49bde8431 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:34.801369 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ac104-51ad-48fe-99e2-5ee49bde8431 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:34.806168 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e840a3-a5f0-43bd-b1c5-a0d1005ad119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:34.806791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e840a3-a5f0-43bd-b1c5-a0d1005ad119 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:34.807077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e840a3-a5f0-43bd-b1c5-a0d1005ad119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:34.807354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e840a3-a5f0-43bd-b1c5-a0d1005ad119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:34.808053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e840a3-a5f0-43bd-b1c5-a0d1005ad119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:34.809957 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e840a3-a5f0-43bd-b1c5-a0d1005ad119 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:34.834992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1258/2511] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:21:34 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:21:34.839704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6da77f-7ad1-4fce-bf75-ca45e5b72fa7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:34.849513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6da77f-7ad1-4fce-bf75-ca45e5b72fa7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:34.907671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d1f5e-ecea-4909-b8f4-9358548f482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:34.908336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d1f5e-ecea-4909-b8f4-9358548f482e admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:34.908615 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d1f5e-ecea-4909-b8f4-9358548f482e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:34.908888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d1f5e-ecea-4909-b8f4-9358548f482e admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:34.909584 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d1f5e-ecea-4909-b8f4-9358548f482e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:34.911533 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d1f5e-ecea-4909-b8f4-9358548f482e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:34.918418 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:34.933596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1254/2512] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:21:34 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:34.937745 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e840a3-a5f0-43bd-b1c5-a0d1005ad119 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:34.949396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e840a3-a5f0-43bd-b1c5-a0d1005ad119 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:34.954520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada6069-f95b-4db7-91e0-2453efa6c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:34.955242 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada6069-f95b-4db7-91e0-2453efa6c52d admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:34.955527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada6069-f95b-4db7-91e0-2453efa6c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:34.955804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada6069-f95b-4db7-91e0-2453efa6c52d admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:34.956527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada6069-f95b-4db7-91e0-2453efa6c52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:34.958121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada6069-f95b-4db7-91e0-2453efa6c52d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:34.968724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1259/2513] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:34.972727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d1f5e-ecea-4909-b8f4-9358548f482e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:34.982793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d1f5e-ecea-4909-b8f4-9358548f482e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:34.987378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaae303-811c-49ac-bd74-2a9f7e308cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:34.988016 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaae303-811c-49ac-bd74-2a9f7e308cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:34.988294 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaae303-811c-49ac-bd74-2a9f7e308cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:34.988565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaae303-811c-49ac-bd74-2a9f7e308cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:34.989279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaae303-811c-49ac-bd74-2a9f7e308cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:34.990886 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaae303-811c-49ac-bd74-2a9f7e308cb4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:35.001060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1255/2514] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:35.005332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada6069-f95b-4db7-91e0-2453efa6c52d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:35.016479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada6069-f95b-4db7-91e0-2453efa6c52d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:35.021319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca11ea-92bc-44e1-b7a8-22615d893d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:35.022236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca11ea-92bc-44e1-b7a8-22615d893d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:35.022542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca11ea-92bc-44e1-b7a8-22615d893d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:35.022845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca11ea-92bc-44e1-b7a8-22615d893d7d admin admin] PATH_INFO: `/v3/projects/129a8912c60045a7b0ba8db2c5bc60e8/users/d042543a0a924a5cafa9aa82c6cffd0e/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:35.037702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca11ea-92bc-44e1-b7a8-22615d893d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=129a8912c60045a7b0ba8db2c5bc60e8, user_id=d042543a0a924a5cafa9aa82c6cffd0e, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:35.040368 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca11ea-92bc-44e1-b7a8-22615d893d7d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:35.053597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1260/2515] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:35 2022] PUT /identity/v3/projects/129a8912c60045a7b0ba8db2c5bc60e8/users/d042543a0a924a5cafa9aa82c6cffd0e/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:21:35.064390 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010b572-c753-4ba0-98d7-610bb1fc9105 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:35.064621 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010b572-c753-4ba0-98d7-610bb1fc9105 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:35.064901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010b572-c753-4ba0-98d7-610bb1fc9105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:35.091973 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0010b572-c753-4ba0-98d7-610bb1fc9105 None None] MFA Rules not processed for user `d042543a0a924a5cafa9aa82c6cffd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:35.093193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0010b572-c753-4ba0-98d7-610bb1fc9105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:35.158968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1256/2516] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:35.163490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca11ea-92bc-44e1-b7a8-22615d893d7d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:35.177093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:35.228190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca11ea-92bc-44e1-b7a8-22615d893d7d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:35.233084 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3307ba-f9e3-421d-ba84-107741bfa9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:35.233743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3307ba-f9e3-421d-ba84-107741bfa9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:35.234030 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3307ba-f9e3-421d-ba84-107741bfa9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:35.234310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3307ba-f9e3-421d-ba84-107741bfa9d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:35.235044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3307ba-f9e3-421d-ba84-107741bfa9d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:35.236993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3307ba-f9e3-421d-ba84-107741bfa9d3 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:35.265783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1261/2517] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:21:35 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:35.269793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010b572-c753-4ba0-98d7-610bb1fc9105 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:35.281419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010b572-c753-4ba0-98d7-610bb1fc9105 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:35.337210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efe127-1152-4cdc-8cca-5a3364b2435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:35.338042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efe127-1152-4cdc-8cca-5a3364b2435d admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:35.338155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efe127-1152-4cdc-8cca-5a3364b2435d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:35.339022 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efe127-1152-4cdc-8cca-5a3364b2435d admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:35.349362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efe127-1152-4cdc-8cca-5a3364b2435d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:35.349362 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efe127-1152-4cdc-8cca-5a3364b2435d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:35.367293 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1257/2518] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:21:35 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:35.368841 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3307ba-f9e3-421d-ba84-107741bfa9d3 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:35.380948 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3307ba-f9e3-421d-ba84-107741bfa9d3 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:35.386676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843388c-b22b-4d08-80b2-d216ec9bca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:35.387332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843388c-b22b-4d08-80b2-d216ec9bca95 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:35.387610 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843388c-b22b-4d08-80b2-d216ec9bca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:35.387885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843388c-b22b-4d08-80b2-d216ec9bca95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:35.388608 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843388c-b22b-4d08-80b2-d216ec9bca95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:35.390198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843388c-b22b-4d08-80b2-d216ec9bca95 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:35.402015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1262/2519] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:35.406183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efe127-1152-4cdc-8cca-5a3364b2435d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:35.416691 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efe127-1152-4cdc-8cca-5a3364b2435d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:35.422164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b07136-13a9-4761-a517-c053f1e99401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:35.423179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b07136-13a9-4761-a517-c053f1e99401 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:35.423461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b07136-13a9-4761-a517-c053f1e99401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:35.423740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b07136-13a9-4761-a517-c053f1e99401 admin admin] PATH_INFO: `/v3/projects/63020c43360746de85a79909582e3c0b/users/2a72a26575bb4b18958fae19064bc17b/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:35.440432 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b07136-13a9-4761-a517-c053f1e99401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63020c43360746de85a79909582e3c0b, user_id=2a72a26575bb4b18958fae19064bc17b, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:35.443613 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b07136-13a9-4761-a517-c053f1e99401 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:35.457958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1258/2520] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:35 2022] PUT /identity/v3/projects/63020c43360746de85a79909582e3c0b/users/2a72a26575bb4b18958fae19064bc17b/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:35.461881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843388c-b22b-4d08-80b2-d216ec9bca95 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:35.472252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843388c-b22b-4d08-80b2-d216ec9bca95 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:35.540750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333f7a3-e3b6-4b57-9a14-fd31c8ab3ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:35.541488 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333f7a3-e3b6-4b57-9a14-fd31c8ab3ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:35.542033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333f7a3-e3b6-4b57-9a14-fd31c8ab3ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:35.542033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333f7a3-e3b6-4b57-9a14-fd31c8ab3ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:35.542963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333f7a3-e3b6-4b57-9a14-fd31c8ab3ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:35.544600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333f7a3-e3b6-4b57-9a14-fd31c8ab3ebd admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:35.556786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1263/2521] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:35.561774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b07136-13a9-4761-a517-c053f1e99401 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:35.575219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b07136-13a9-4761-a517-c053f1e99401 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:35.580044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9150ad2-1b4f-4b4e-bc9f-44cf61652659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:35.580954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9150ad2-1b4f-4b4e-bc9f-44cf61652659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:35.581237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9150ad2-1b4f-4b4e-bc9f-44cf61652659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:35.581512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9150ad2-1b4f-4b4e-bc9f-44cf61652659 admin admin] PATH_INFO: `/v3/projects/63020c43360746de85a79909582e3c0b/users/2a72a26575bb4b18958fae19064bc17b/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:35.583832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9150ad2-1b4f-4b4e-bc9f-44cf61652659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63020c43360746de85a79909582e3c0b, user_id=2a72a26575bb4b18958fae19064bc17b, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:35.586481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9150ad2-1b4f-4b4e-bc9f-44cf61652659 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:35.598457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1259/2522] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:35 2022] PUT /identity/v3/projects/63020c43360746de85a79909582e3c0b/users/2a72a26575bb4b18958fae19064bc17b/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:35.609754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e28ea-9475-4a55-aa1f-8516c762b320 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:35.610092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e28ea-9475-4a55-aa1f-8516c762b320 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:35.610389 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e28ea-9475-4a55-aa1f-8516c762b320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:35.639621 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-8a7e28ea-9475-4a55-aa1f-8516c762b320 None None] MFA Rules not processed for user `2a72a26575bb4b18958fae19064bc17b`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:35.640839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8a7e28ea-9475-4a55-aa1f-8516c762b320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:35.718048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1264/2523] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:35.729473 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9150ad2-1b4f-4b4e-bc9f-44cf61652659 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:35.731262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c9150ad2-1b4f-4b4e-bc9f-44cf61652659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:35.754144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:35.793027 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9150ad2-1b4f-4b4e-bc9f-44cf61652659 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:35.796747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127edd3f-4e17-47a3-8982-57ff1531f3a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:35.797376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127edd3f-4e17-47a3-8982-57ff1531f3a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:35.797658 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127edd3f-4e17-47a3-8982-57ff1531f3a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:35.797934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127edd3f-4e17-47a3-8982-57ff1531f3a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:35.806924 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127edd3f-4e17-47a3-8982-57ff1531f3a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:35.809048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127edd3f-4e17-47a3-8982-57ff1531f3a9 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:35.818313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1260/2524] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:36.191268 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e28ea-9475-4a55-aa1f-8516c762b320 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:36.201781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:36.255587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e28ea-9475-4a55-aa1f-8516c762b320 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:36.260035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:36.261823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:36.262143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:36.262377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] PATH_INFO: `/v3/users/d042543a0a924a5cafa9aa82c6cffd0e` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:36.263586 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d042543a0a924a5cafa9aa82c6cffd0e)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:36.265507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:36.316512 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd042543a0a924a5cafa9aa82c6cffd0e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:36.324284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd042543a0a924a5cafa9aa82c6cffd0e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:36.324947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd042543a0a924a5cafa9aa82c6cffd0e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:36.325542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd042543a0a924a5cafa9aa82c6cffd0e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:36.337386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd042543a0a924a5cafa9aa82c6cffd0e'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:36.350955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1265/2525] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:21:36 2022] DELETE /identity/v3/users/d042543a0a924a5cafa9aa82c6cffd0e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:36.356015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224e701-eaa8-4984-91ba-a9a99ed334f4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:36.356515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224e701-eaa8-4984-91ba-a9a99ed334f4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:36.356624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224e701-eaa8-4984-91ba-a9a99ed334f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:36.374688 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f224e701-eaa8-4984-91ba-a9a99ed334f4 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:36.375911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f224e701-eaa8-4984-91ba-a9a99ed334f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:36.436211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1261/2526] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:36.445651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:36.447058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:36.505717 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2e0a9-fa51-41f9-a0e7-8760c4f6485e admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:36.509500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c1e11-e150-47ca-873a-eb657e679f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:36.510148 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c1e11-e150-47ca-873a-eb657e679f25 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:36.511092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c1e11-e150-47ca-873a-eb657e679f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:36.511368 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c1e11-e150-47ca-873a-eb657e679f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:36.520391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c1e11-e150-47ca-873a-eb657e679f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:36.521815 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c1e11-e150-47ca-873a-eb657e679f25 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:36.531469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1266/2527] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:36.813317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224e701-eaa8-4984-91ba-a9a99ed334f4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:36.814805 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f224e701-eaa8-4984-91ba-a9a99ed334f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:36.827095 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224e701-eaa8-4984-91ba-a9a99ed334f4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:36.832190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:36.833054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:36.833337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:36.833614 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] PATH_INFO: `/v3/projects/129a8912c60045a7b0ba8db2c5bc60e8` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:36.835484 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=129a8912c60045a7b0ba8db2c5bc60e8)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:36.837777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:36.889225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129a8912c60045a7b0ba8db2c5bc60e8', 'request_id': 'req-1131b401-2c5c-4b2b-90b1-7b279058ca1d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:36.895334 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129a8912c60045a7b0ba8db2c5bc60e8', 'request_id': 'req-1131b401-2c5c-4b2b-90b1-7b279058ca1d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:36.901904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129a8912c60045a7b0ba8db2c5bc60e8', 'request_id': 'req-1131b401-2c5c-4b2b-90b1-7b279058ca1d'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:36.913251 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] The token cache is being invalidate because project 129a8912c60045a7b0ba8db2c5bc60e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:21:36.913540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:36.914162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:36.915758 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1262/2528] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:21:36 2022] DELETE /identity/v3/projects/129a8912c60045a7b0ba8db2c5bc60e8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:36.920458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c1e11-e150-47ca-873a-eb657e679f25 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:36.930050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c1e11-e150-47ca-873a-eb657e679f25 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:36.958606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:36.989571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061e724-ebc3-423a-bc96-15c5abd5f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:36.990453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061e724-ebc3-423a-bc96-15c5abd5f474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:36.990776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061e724-ebc3-423a-bc96-15c5abd5f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:36.991056 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061e724-ebc3-423a-bc96-15c5abd5f474 admin admin] PATH_INFO: `/v3/users/2a72a26575bb4b18958fae19064bc17b` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:36.992222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061e724-ebc3-423a-bc96-15c5abd5f474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a72a26575bb4b18958fae19064bc17b)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:36.994135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061e724-ebc3-423a-bc96-15c5abd5f474 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:37.039380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1061e724-ebc3-423a-bc96-15c5abd5f474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a72a26575bb4b18958fae19064bc17b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:37.046702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1061e724-ebc3-423a-bc96-15c5abd5f474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a72a26575bb4b18958fae19064bc17b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:37.047418 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1061e724-ebc3-423a-bc96-15c5abd5f474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a72a26575bb4b18958fae19064bc17b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:37.048005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1061e724-ebc3-423a-bc96-15c5abd5f474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a72a26575bb4b18958fae19064bc17b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:37.059788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1061e724-ebc3-423a-bc96-15c5abd5f474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a72a26575bb4b18958fae19064bc17b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:37.071983 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1267/2529] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:21:36 2022] DELETE /identity/v3/users/2a72a26575bb4b18958fae19064bc17b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:37.349515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:37.351048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:37.365217 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131b401-2c5c-4b2b-90b1-7b279058ca1d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:37.412413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:37.427313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f159d-d674-4fdb-add1-54b7549e218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:37.428103 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f159d-d674-4fdb-add1-54b7549e218b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:37.428389 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f159d-d674-4fdb-add1-54b7549e218b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:37.428664 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f159d-d674-4fdb-add1-54b7549e218b admin admin] PATH_INFO: `/v3/projects/63020c43360746de85a79909582e3c0b` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:37.429835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f159d-d674-4fdb-add1-54b7549e218b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63020c43360746de85a79909582e3c0b)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:37.431778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f159d-d674-4fdb-add1-54b7549e218b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:37.481279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7e2f159d-d674-4fdb-add1-54b7549e218b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63020c43360746de85a79909582e3c0b', 'request_id': 'req-7e2f159d-d674-4fdb-add1-54b7549e218b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:37.487426 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7e2f159d-d674-4fdb-add1-54b7549e218b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63020c43360746de85a79909582e3c0b', 'request_id': 'req-7e2f159d-d674-4fdb-add1-54b7549e218b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:37.493436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7e2f159d-d674-4fdb-add1-54b7549e218b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63020c43360746de85a79909582e3c0b', 'request_id': 'req-7e2f159d-d674-4fdb-add1-54b7549e218b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:37.507578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7e2f159d-d674-4fdb-add1-54b7549e218b admin admin] The token cache is being invalidate because project 63020c43360746de85a79909582e3c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:21:37.507988 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7e2f159d-d674-4fdb-add1-54b7549e218b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:37.508901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7e2f159d-d674-4fdb-add1-54b7549e218b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:37.511318 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1263/2530] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:21:37 2022] DELETE /identity/v3/projects/63020c43360746de85a79909582e3c0b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:37.516601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500bd5-2f9c-4817-8eb8-0455395baba9 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:37.516886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500bd5-2f9c-4817-8eb8-0455395baba9 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:37.517158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500bd5-2f9c-4817-8eb8-0455395baba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:37.536273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-c2500bd5-2f9c-4817-8eb8-0455395baba9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:37.537484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c2500bd5-2f9c-4817-8eb8-0455395baba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:37.598871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1268/2531] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:37.606479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93041e7-3cc7-469e-9e0c-a6951184c662 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:37.606804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93041e7-3cc7-469e-9e0c-a6951184c662 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:37.607088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93041e7-3cc7-469e-9e0c-a6951184c662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:37.625015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e93041e7-3cc7-469e-9e0c-a6951184c662 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:37.626208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e93041e7-3cc7-469e-9e0c-a6951184c662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:37.634291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1264/2532] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:37.639060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500bd5-2f9c-4817-8eb8-0455395baba9 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:37.648571 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500bd5-2f9c-4817-8eb8-0455395baba9 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:37.653735 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544520d-edc7-48db-aff8-f6ad01e0d1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:37.654371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544520d-edc7-48db-aff8-f6ad01e0d1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:37.654676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544520d-edc7-48db-aff8-f6ad01e0d1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:37.654954 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544520d-edc7-48db-aff8-f6ad01e0d1f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:37.655667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544520d-edc7-48db-aff8-f6ad01e0d1f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:21:37.655987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544520d-edc7-48db-aff8-f6ad01e0d1f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:37.657550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544520d-edc7-48db-aff8-f6ad01e0d1f8 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:37.669005 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1269/2533] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:21:37.673138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93041e7-3cc7-469e-9e0c-a6951184c662 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:37.682956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93041e7-3cc7-469e-9e0c-a6951184c662 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:37.687558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4604edb-76dc-43b4-b563-ce7a3903ca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:37.688189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604edb-76dc-43b4-b563-ce7a3903ca31 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:37.688470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604edb-76dc-43b4-b563-ce7a3903ca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:37.688743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604edb-76dc-43b4-b563-ce7a3903ca31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:37.689444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4604edb-76dc-43b4-b563-ce7a3903ca31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:37.691409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4604edb-76dc-43b4-b563-ce7a3903ca31 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:37.716866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1265/2534] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:21:37 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:21:37.720890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544520d-edc7-48db-aff8-f6ad01e0d1f8 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:37.730963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544520d-edc7-48db-aff8-f6ad01e0d1f8 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:37.766332 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:37.792840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3ab22-20d6-4074-829b-fa815cd42d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:37.793508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3ab22-20d6-4074-829b-fa815cd42d6f admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:37.793794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3ab22-20d6-4074-829b-fa815cd42d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:37.794070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3ab22-20d6-4074-829b-fa815cd42d6f admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:37.794795 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3ab22-20d6-4074-829b-fa815cd42d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:37.796725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3ab22-20d6-4074-829b-fa815cd42d6f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:37.816733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1270/2535] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:21:37 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:37.820732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4604edb-76dc-43b4-b563-ce7a3903ca31 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:37.831490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4604edb-76dc-43b4-b563-ce7a3903ca31 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:37.836025 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180e4a-207d-4468-bf08-9186d7658fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:37.836666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180e4a-207d-4468-bf08-9186d7658fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:37.836948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180e4a-207d-4468-bf08-9186d7658fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:37.837221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180e4a-207d-4468-bf08-9186d7658fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:37.837932 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff180e4a-207d-4468-bf08-9186d7658fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:37.839803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff180e4a-207d-4468-bf08-9186d7658fb1 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:37.850962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1266/2536] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:21:37.854687 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3ab22-20d6-4074-829b-fa815cd42d6f admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:37.866261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3ab22-20d6-4074-829b-fa815cd42d6f admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:37.874063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aff36a-b003-4891-89c2-7d1a6f487d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:37.874751 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aff36a-b003-4891-89c2-7d1a6f487d47 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:37.875656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aff36a-b003-4891-89c2-7d1a6f487d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:37.875933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aff36a-b003-4891-89c2-7d1a6f487d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:37.876723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aff36a-b003-4891-89c2-7d1a6f487d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:37.879215 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aff36a-b003-4891-89c2-7d1a6f487d47 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:37.891584 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1271/2537] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:37.895720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180e4a-207d-4468-bf08-9186d7658fb1 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:37.906427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180e4a-207d-4468-bf08-9186d7658fb1 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:37.911079 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebac21-02c9-441d-9acf-e7560f2f6638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:37.911950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebac21-02c9-441d-9acf-e7560f2f6638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:37.912227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebac21-02c9-441d-9acf-e7560f2f6638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:37.912499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebac21-02c9-441d-9acf-e7560f2f6638 admin admin] PATH_INFO: `/v3/projects/ef54dd003ec14a36858189d8d28caf00/users/75cd80a39fbc42bd8760a58a24b73a84/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:37.927777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebac21-02c9-441d-9acf-e7560f2f6638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef54dd003ec14a36858189d8d28caf00, user_id=75cd80a39fbc42bd8760a58a24b73a84, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:37.930415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebac21-02c9-441d-9acf-e7560f2f6638 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:37.943843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1267/2538] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:37 2022] PUT /identity/v3/projects/ef54dd003ec14a36858189d8d28caf00/users/75cd80a39fbc42bd8760a58a24b73a84/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:37.955009 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da255d1-82fa-4914-b491-266ff5d7a734 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:37.955496 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da255d1-82fa-4914-b491-266ff5d7a734 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:37.955607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da255d1-82fa-4914-b491-266ff5d7a734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:37.981126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-2da255d1-82fa-4914-b491-266ff5d7a734 None None] MFA Rules not processed for user `75cd80a39fbc42bd8760a58a24b73a84`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:37.982322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2da255d1-82fa-4914-b491-266ff5d7a734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:38.047486 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1272/2539] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:38.052051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebac21-02c9-441d-9acf-e7560f2f6638 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:38.114221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebac21-02c9-441d-9acf-e7560f2f6638 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:38.119052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a59dea-e9bb-419a-95bd-57421d3524dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:38.120470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a59dea-e9bb-419a-95bd-57421d3524dc admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:38.120967 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a59dea-e9bb-419a-95bd-57421d3524dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:38.121380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a59dea-e9bb-419a-95bd-57421d3524dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:38.122491 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a59dea-e9bb-419a-95bd-57421d3524dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:38.124424 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a59dea-e9bb-419a-95bd-57421d3524dc admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:38.147604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:38.159473 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1268/2540] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:21:38 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:38.160605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da255d1-82fa-4914-b491-266ff5d7a734 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:38.171882 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da255d1-82fa-4914-b491-266ff5d7a734 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:38.228621 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d669b-03eb-4863-9c66-23ff24208196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:38.229931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d669b-03eb-4863-9c66-23ff24208196 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:38.230206 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d669b-03eb-4863-9c66-23ff24208196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:38.230478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d669b-03eb-4863-9c66-23ff24208196 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:38.231185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d669b-03eb-4863-9c66-23ff24208196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:38.233100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d669b-03eb-4863-9c66-23ff24208196 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:38.253383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1273/2541] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:21:38 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:21:38.257465 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a59dea-e9bb-419a-95bd-57421d3524dc admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:38.267979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a59dea-e9bb-419a-95bd-57421d3524dc admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:38.272746 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0fc89-e264-4c7d-8561-8ce1fb2132d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:38.273425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0fc89-e264-4c7d-8561-8ce1fb2132d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:38.273707 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0fc89-e264-4c7d-8561-8ce1fb2132d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:38.273984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0fc89-e264-4c7d-8561-8ce1fb2132d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:38.274731 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0fc89-e264-4c7d-8561-8ce1fb2132d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:38.276628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0fc89-e264-4c7d-8561-8ce1fb2132d1 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:38.287066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1269/2542] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:38.291035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d669b-03eb-4863-9c66-23ff24208196 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:38.301384 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d669b-03eb-4863-9c66-23ff24208196 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:38.305971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad90c65-bee9-4974-9191-f634c05ed589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:38.306876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad90c65-bee9-4974-9191-f634c05ed589 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:38.307762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad90c65-bee9-4974-9191-f634c05ed589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:38.308042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad90c65-bee9-4974-9191-f634c05ed589 admin admin] PATH_INFO: `/v3/projects/31d8f71653be423097fb612a7631f94a/users/44e0d57fdf25454baa89389ce7ca82f9/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:38.323048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad90c65-bee9-4974-9191-f634c05ed589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d8f71653be423097fb612a7631f94a, user_id=44e0d57fdf25454baa89389ce7ca82f9, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:38.325739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad90c65-bee9-4974-9191-f634c05ed589 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:38.337930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1274/2543] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:38 2022] PUT /identity/v3/projects/31d8f71653be423097fb612a7631f94a/users/44e0d57fdf25454baa89389ce7ca82f9/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:21:38.341883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0fc89-e264-4c7d-8561-8ce1fb2132d1 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:38.353672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0fc89-e264-4c7d-8561-8ce1fb2132d1 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:38.411006 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a3ef-1fed-42ba-b3df-22317e4c97f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:38.411687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a3ef-1fed-42ba-b3df-22317e4c97f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:38.411935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a3ef-1fed-42ba-b3df-22317e4c97f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:38.412209 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a3ef-1fed-42ba-b3df-22317e4c97f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:38.412928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0a3ef-1fed-42ba-b3df-22317e4c97f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:38.414508 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0a3ef-1fed-42ba-b3df-22317e4c97f3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:38.424631 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1270/2544] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:38.428697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad90c65-bee9-4974-9191-f634c05ed589 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:38.439821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad90c65-bee9-4974-9191-f634c05ed589 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:38.444407 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f64b61-62a6-4e02-b7a8-de20d0cd207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:38.445267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f64b61-62a6-4e02-b7a8-de20d0cd207e admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:38.445546 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f64b61-62a6-4e02-b7a8-de20d0cd207e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:38.445819 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f64b61-62a6-4e02-b7a8-de20d0cd207e admin admin] PATH_INFO: `/v3/projects/31d8f71653be423097fb612a7631f94a/users/44e0d57fdf25454baa89389ce7ca82f9/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:38.448955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f64b61-62a6-4e02-b7a8-de20d0cd207e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d8f71653be423097fb612a7631f94a, user_id=44e0d57fdf25454baa89389ce7ca82f9, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:38.451642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f64b61-62a6-4e02-b7a8-de20d0cd207e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:38.457039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:38.462670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1275/2545] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:38 2022] PUT /identity/v3/projects/31d8f71653be423097fb612a7631f94a/users/44e0d57fdf25454baa89389ce7ca82f9/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:38.474197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea1be-a122-4298-970d-b92ecaba0dd0 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:38.474483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea1be-a122-4298-970d-b92ecaba0dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:38.474811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ea1be-a122-4298-970d-b92ecaba0dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:38.501531 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b38ea1be-a122-4298-970d-b92ecaba0dd0 None None] MFA Rules not processed for user `44e0d57fdf25454baa89389ce7ca82f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:38.502981 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b38ea1be-a122-4298-970d-b92ecaba0dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:38.572709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1271/2546] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:38.584646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f64b61-62a6-4e02-b7a8-de20d0cd207e admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:38.586336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-43f64b61-62a6-4e02-b7a8-de20d0cd207e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:38.645779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f64b61-62a6-4e02-b7a8-de20d0cd207e admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:38.649423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177afab-daec-461a-9a7b-0f55c87c45d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:38.650056 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177afab-daec-461a-9a7b-0f55c87c45d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:38.650341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177afab-daec-461a-9a7b-0f55c87c45d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:38.650645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177afab-daec-461a-9a7b-0f55c87c45d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:38.659781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177afab-daec-461a-9a7b-0f55c87c45d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:38.661214 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177afab-daec-461a-9a7b-0f55c87c45d4 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:38.670649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1276/2547] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:38.738878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea1be-a122-4298-970d-b92ecaba0dd0 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:38.748944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ea1be-a122-4298-970d-b92ecaba0dd0 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:38.752864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd5463-ffcd-4005-9f63-bd173f59cd11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:38.753433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5463-ffcd-4005-9f63-bd173f59cd11 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:38.753710 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5463-ffcd-4005-9f63-bd173f59cd11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:38.753982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5463-ffcd-4005-9f63-bd173f59cd11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:38.811184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd5463-ffcd-4005-9f63-bd173f59cd11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:38.812618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd5463-ffcd-4005-9f63-bd173f59cd11 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:38.822056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1272/2548] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:47.912920 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177afab-daec-461a-9a7b-0f55c87c45d4 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:47.974566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177afab-daec-461a-9a7b-0f55c87c45d4 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:47.979061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:47.980026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:47.980315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:47.981090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] PATH_INFO: `/v3/users/75cd80a39fbc42bd8760a58a24b73a84` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:47.982366 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=75cd80a39fbc42bd8760a58a24b73a84)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:47.984401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:48.032550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75cd80a39fbc42bd8760a58a24b73a84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.039643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75cd80a39fbc42bd8760a58a24b73a84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.040305 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75cd80a39fbc42bd8760a58a24b73a84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.040912 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75cd80a39fbc42bd8760a58a24b73a84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.053315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75cd80a39fbc42bd8760a58a24b73a84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.065694 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1277/2549] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:21:47 2022] DELETE /identity/v3/users/75cd80a39fbc42bd8760a58a24b73a84 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:48.070220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44417599-be33-43a0-8b07-ca43cd9e369d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:48.070695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44417599-be33-43a0-8b07-ca43cd9e369d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:48.070952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44417599-be33-43a0-8b07-ca43cd9e369d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:48.082940 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:48.089049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-44417599-be33-43a0-8b07-ca43cd9e369d None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:48.090814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-44417599-be33-43a0-8b07-ca43cd9e369d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:48.149084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1273/2550] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:21:48.158787 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:48.160171 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:48.181965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:48.219225 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5744f-298a-4ef2-af54-9773db183d6b admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:48.222873 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa2a71-f125-45ff-ad35-a4a4a63db491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:48.223507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa2a71-f125-45ff-ad35-a4a4a63db491 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:48.223789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa2a71-f125-45ff-ad35-a4a4a63db491 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:48.224061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa2a71-f125-45ff-ad35-a4a4a63db491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:48.233605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa2a71-f125-45ff-ad35-a4a4a63db491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:48.235176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa2a71-f125-45ff-ad35-a4a4a63db491 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:48.244635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1278/2551] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:48.515035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44417599-be33-43a0-8b07-ca43cd9e369d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:48.516704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-44417599-be33-43a0-8b07-ca43cd9e369d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:48.535642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44417599-be33-43a0-8b07-ca43cd9e369d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:48.540994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:48.542186 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:48.542568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:48.543351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] PATH_INFO: `/v3/projects/ef54dd003ec14a36858189d8d28caf00` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:48.545016 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef54dd003ec14a36858189d8d28caf00)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:48.548792 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:48.600493 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef54dd003ec14a36858189d8d28caf00', 'request_id': 'req-06896c43-1709-451d-8f66-c5e812a14ee7'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.606611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef54dd003ec14a36858189d8d28caf00', 'request_id': 'req-06896c43-1709-451d-8f66-c5e812a14ee7'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.612125 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef54dd003ec14a36858189d8d28caf00', 'request_id': 'req-06896c43-1709-451d-8f66-c5e812a14ee7'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.623582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] The token cache is being invalidate because project ef54dd003ec14a36858189d8d28caf00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:21:48.623868 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.624480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.626091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1274/2552] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:21:48 2022] DELETE /identity/v3/projects/ef54dd003ec14a36858189d8d28caf00 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:48.630327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa2a71-f125-45ff-ad35-a4a4a63db491 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:48.640453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa2a71-f125-45ff-ad35-a4a4a63db491 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:48.695058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f774b-d60a-4a99-90df-f932b00d3c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:48.695904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f774b-d60a-4a99-90df-f932b00d3c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:48.696181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f774b-d60a-4a99-90df-f932b00d3c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:48.696453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f774b-d60a-4a99-90df-f932b00d3c87 admin admin] PATH_INFO: `/v3/users/44e0d57fdf25454baa89389ce7ca82f9` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:48.697617 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f774b-d60a-4a99-90df-f932b00d3c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e0d57fdf25454baa89389ce7ca82f9)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:48.700107 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f774b-d60a-4a99-90df-f932b00d3c87 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:48.744025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-005f774b-d60a-4a99-90df-f932b00d3c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e0d57fdf25454baa89389ce7ca82f9'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.752785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-005f774b-d60a-4a99-90df-f932b00d3c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e0d57fdf25454baa89389ce7ca82f9'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.753483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-005f774b-d60a-4a99-90df-f932b00d3c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e0d57fdf25454baa89389ce7ca82f9'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.754090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-005f774b-d60a-4a99-90df-f932b00d3c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e0d57fdf25454baa89389ce7ca82f9'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.767459 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-005f774b-d60a-4a99-90df-f932b00d3c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e0d57fdf25454baa89389ce7ca82f9'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:48.780299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1279/2553] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:21:48 2022] DELETE /identity/v3/users/44e0d57fdf25454baa89389ce7ca82f9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:49.053828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:49.055263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:49.068302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06896c43-1709-451d-8f66-c5e812a14ee7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:49.125018 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b9e60-e147-43b6-9996-cb77245c5962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:49.125926 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9e60-e147-43b6-9996-cb77245c5962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.126263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9e60-e147-43b6-9996-cb77245c5962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.126487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9e60-e147-43b6-9996-cb77245c5962 admin admin] PATH_INFO: `/v3/projects/31d8f71653be423097fb612a7631f94a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.128027 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b9e60-e147-43b6-9996-cb77245c5962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d8f71653be423097fb612a7631f94a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:49.129947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b9e60-e147-43b6-9996-cb77245c5962 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:49.165634 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:49.179615 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d74b9e60-e147-43b6-9996-cb77245c5962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d8f71653be423097fb612a7631f94a', 'request_id': 'req-d74b9e60-e147-43b6-9996-cb77245c5962'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:49.186135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d74b9e60-e147-43b6-9996-cb77245c5962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d8f71653be423097fb612a7631f94a', 'request_id': 'req-d74b9e60-e147-43b6-9996-cb77245c5962'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:49.191566 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d74b9e60-e147-43b6-9996-cb77245c5962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d8f71653be423097fb612a7631f94a', 'request_id': 'req-d74b9e60-e147-43b6-9996-cb77245c5962'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:49.204091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d74b9e60-e147-43b6-9996-cb77245c5962 admin admin] The token cache is being invalidate because project 31d8f71653be423097fb612a7631f94a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:21:49.204376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d74b9e60-e147-43b6-9996-cb77245c5962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:49.205042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d74b9e60-e147-43b6-9996-cb77245c5962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:49.206636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1275/2554] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:21:49 2022] DELETE /identity/v3/projects/31d8f71653be423097fb612a7631f94a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:49.211492 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bae17b-0da8-4b70-962e-7730979d28c1 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.211968 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bae17b-0da8-4b70-962e-7730979d28c1 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.212063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bae17b-0da8-4b70-962e-7730979d28c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.230023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-41bae17b-0da8-4b70-962e-7730979d28c1 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:49.231861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-41bae17b-0da8-4b70-962e-7730979d28c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:49.270336 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:49.294047 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1280/2555] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:49.301795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e34ac-c06c-4d2e-9e44-abd29faeb675 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.302081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e34ac-c06c-4d2e-9e44-abd29faeb675 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.302355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e34ac-c06c-4d2e-9e44-abd29faeb675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.320771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-714e34ac-c06c-4d2e-9e44-abd29faeb675 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:49.321956 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-714e34ac-c06c-4d2e-9e44-abd29faeb675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:49.329816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1276/2556] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:49.333921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bae17b-0da8-4b70-962e-7730979d28c1 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:49.344200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bae17b-0da8-4b70-962e-7730979d28c1 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:49.348703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15250a1f-71c9-4c36-a0d4-b21483dbff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:49.349346 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15250a1f-71c9-4c36-a0d4-b21483dbff86 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.349624 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15250a1f-71c9-4c36-a0d4-b21483dbff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.349898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15250a1f-71c9-4c36-a0d4-b21483dbff86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.350642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15250a1f-71c9-4c36-a0d4-b21483dbff86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:21:49.350985 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15250a1f-71c9-4c36-a0d4-b21483dbff86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:49.352569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15250a1f-71c9-4c36-a0d4-b21483dbff86 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:49.364530 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1281/2557] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:21:49.368580 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e34ac-c06c-4d2e-9e44-abd29faeb675 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:49.378865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e34ac-c06c-4d2e-9e44-abd29faeb675 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:49.383485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e14b93-14fb-484b-8cca-0d513faa87ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:49.384140 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e14b93-14fb-484b-8cca-0d513faa87ea admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.384590 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e14b93-14fb-484b-8cca-0d513faa87ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.384864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e14b93-14fb-484b-8cca-0d513faa87ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.385380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e14b93-14fb-484b-8cca-0d513faa87ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:49.387851 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e14b93-14fb-484b-8cca-0d513faa87ea admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:49.422219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1277/2558] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:21:49 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:49.426413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15250a1f-71c9-4c36-a0d4-b21483dbff86 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:49.437106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15250a1f-71c9-4c36-a0d4-b21483dbff86 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:49.491890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383d456-45bd-4edd-8be5-5a6f66917b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:49.492542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383d456-45bd-4edd-8be5-5a6f66917b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.492821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383d456-45bd-4edd-8be5-5a6f66917b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.493094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383d456-45bd-4edd-8be5-5a6f66917b52 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.493776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383d456-45bd-4edd-8be5-5a6f66917b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:49.495713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383d456-45bd-4edd-8be5-5a6f66917b52 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:49.516674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1282/2559] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:21:49 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:49.520820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e14b93-14fb-484b-8cca-0d513faa87ea admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:49.531574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e14b93-14fb-484b-8cca-0d513faa87ea admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:49.536165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf23d25-cc6e-43da-b528-94fde6af41fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:49.536803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf23d25-cc6e-43da-b528-94fde6af41fe admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.537080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf23d25-cc6e-43da-b528-94fde6af41fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.537348 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf23d25-cc6e-43da-b528-94fde6af41fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.538091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf23d25-cc6e-43da-b528-94fde6af41fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:49.539690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf23d25-cc6e-43da-b528-94fde6af41fe admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:49.549992 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1278/2560] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:49.553753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383d456-45bd-4edd-8be5-5a6f66917b52 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:49.564218 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383d456-45bd-4edd-8be5-5a6f66917b52 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:49.568818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a7141-6d24-4bb9-b011-0375bcc6bdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:49.569502 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7141-6d24-4bb9-b011-0375bcc6bdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.569787 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7141-6d24-4bb9-b011-0375bcc6bdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.570061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7141-6d24-4bb9-b011-0375bcc6bdc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.570819 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a7141-6d24-4bb9-b011-0375bcc6bdc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:49.572412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a7141-6d24-4bb9-b011-0375bcc6bdc6 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:49.583217 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1283/2561] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:49.587268 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf23d25-cc6e-43da-b528-94fde6af41fe admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:49.597825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf23d25-cc6e-43da-b528-94fde6af41fe admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:49.602499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932a05c-849e-40fc-a213-f9b61abb5e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:49.603402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932a05c-849e-40fc-a213-f9b61abb5e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.603684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932a05c-849e-40fc-a213-f9b61abb5e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.603962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932a05c-849e-40fc-a213-f9b61abb5e6f admin admin] PATH_INFO: `/v3/projects/9122e690b9a94815b5439501b3839b77/users/bb481836d8ce4b7a9f7c7e0171383733/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.619188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932a05c-849e-40fc-a213-f9b61abb5e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9122e690b9a94815b5439501b3839b77, user_id=bb481836d8ce4b7a9f7c7e0171383733, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:49.622250 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932a05c-849e-40fc-a213-f9b61abb5e6f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:49.636035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1279/2562] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:49 2022] PUT /identity/v3/projects/9122e690b9a94815b5439501b3839b77/users/bb481836d8ce4b7a9f7c7e0171383733/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:49.646228 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e969c-78a5-4c0d-8d54-73fe7b00a811 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.646543 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e969c-78a5-4c0d-8d54-73fe7b00a811 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.646859 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e969c-78a5-4c0d-8d54-73fe7b00a811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.673858 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-1b8e969c-78a5-4c0d-8d54-73fe7b00a811 None None] MFA Rules not processed for user `bb481836d8ce4b7a9f7c7e0171383733`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:49.675126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1b8e969c-78a5-4c0d-8d54-73fe7b00a811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:49.744182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1284/2563] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:21:49.748902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932a05c-849e-40fc-a213-f9b61abb5e6f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:49.809599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932a05c-849e-40fc-a213-f9b61abb5e6f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:49.814310 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e73b7-66e3-4ce5-b544-9b4eab2b5eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:49.814991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e73b7-66e3-4ce5-b544-9b4eab2b5eac admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.815279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e73b7-66e3-4ce5-b544-9b4eab2b5eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.815558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e73b7-66e3-4ce5-b544-9b4eab2b5eac admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.816237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e73b7-66e3-4ce5-b544-9b4eab2b5eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:49.818140 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e73b7-66e3-4ce5-b544-9b4eab2b5eac admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:49.842933 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1280/2564] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:21:49 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:49.847020 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e969c-78a5-4c0d-8d54-73fe7b00a811 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:49.858208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e969c-78a5-4c0d-8d54-73fe7b00a811 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:49.894030 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:49.918896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394fef1-a601-4bc9-b34d-d45212e7a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:49.919565 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394fef1-a601-4bc9-b34d-d45212e7a606 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.919858 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394fef1-a601-4bc9-b34d-d45212e7a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.920138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394fef1-a601-4bc9-b34d-d45212e7a606 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.920824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394fef1-a601-4bc9-b34d-d45212e7a606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:49.922773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394fef1-a601-4bc9-b34d-d45212e7a606 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:49.941656 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1285/2565] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:21:49 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:49.945551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e73b7-66e3-4ce5-b544-9b4eab2b5eac admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:49.956079 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e73b7-66e3-4ce5-b544-9b4eab2b5eac admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:49.960749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f20e9-f406-4bd0-9354-aad2a39bc77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:49.961402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f20e9-f406-4bd0-9354-aad2a39bc77b admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.961689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f20e9-f406-4bd0-9354-aad2a39bc77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.961968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f20e9-f406-4bd0-9354-aad2a39bc77b admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:49.962727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f20e9-f406-4bd0-9354-aad2a39bc77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:49.964325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f20e9-f406-4bd0-9354-aad2a39bc77b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:49.975522 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1281/2566] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:49.979525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394fef1-a601-4bc9-b34d-d45212e7a606 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:49.990108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394fef1-a601-4bc9-b34d-d45212e7a606 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:49.994597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b73b6c-9691-42fe-902f-053b3212148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:49.995477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b73b6c-9691-42fe-902f-053b3212148d admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:49.995758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b73b6c-9691-42fe-902f-053b3212148d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:49.996039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b73b6c-9691-42fe-902f-053b3212148d admin admin] PATH_INFO: `/v3/projects/645258b0c9a342218fbaf87050806162/users/9cda02ec4eae4879906e946a1932cfbb/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:50.013035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b73b6c-9691-42fe-902f-053b3212148d admin admin] RBAC: Authorizing `identity:create_grant(project_id=645258b0c9a342218fbaf87050806162, user_id=9cda02ec4eae4879906e946a1932cfbb, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:50.015699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b73b6c-9691-42fe-902f-053b3212148d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:50.028824 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1286/2567] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:49 2022] PUT /identity/v3/projects/645258b0c9a342218fbaf87050806162/users/9cda02ec4eae4879906e946a1932cfbb/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:50.032739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f20e9-f406-4bd0-9354-aad2a39bc77b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:50.043129 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f20e9-f406-4bd0-9354-aad2a39bc77b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:50.064416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:50.103690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a7a8c-8abe-4ba0-9aaa-ecf03ac65099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:50.104348 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a7a8c-8abe-4ba0-9aaa-ecf03ac65099 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:50.104626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a7a8c-8abe-4ba0-9aaa-ecf03ac65099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:50.104898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a7a8c-8abe-4ba0-9aaa-ecf03ac65099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:50.105997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a7a8c-8abe-4ba0-9aaa-ecf03ac65099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:50.107735 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a7a8c-8abe-4ba0-9aaa-ecf03ac65099 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:50.117866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1282/2568] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:21:50.122267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b73b6c-9691-42fe-902f-053b3212148d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:50.132814 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b73b6c-9691-42fe-902f-053b3212148d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:50.138180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115b25b-9485-47a6-8220-e7e29bc1144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:50.139154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115b25b-9485-47a6-8220-e7e29bc1144a admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:50.139391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115b25b-9485-47a6-8220-e7e29bc1144a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:50.139660 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115b25b-9485-47a6-8220-e7e29bc1144a admin admin] PATH_INFO: `/v3/projects/645258b0c9a342218fbaf87050806162/users/9cda02ec4eae4879906e946a1932cfbb/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:50.141588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115b25b-9485-47a6-8220-e7e29bc1144a admin admin] RBAC: Authorizing `identity:create_grant(project_id=645258b0c9a342218fbaf87050806162, user_id=9cda02ec4eae4879906e946a1932cfbb, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:50.144535 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115b25b-9485-47a6-8220-e7e29bc1144a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:50.155655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1287/2569] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:50 2022] PUT /identity/v3/projects/645258b0c9a342218fbaf87050806162/users/9cda02ec4eae4879906e946a1932cfbb/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:50.166660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c064b-b0f2-488c-82d7-162736cdf167 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:50.167186 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c064b-b0f2-488c-82d7-162736cdf167 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:50.167307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c064b-b0f2-488c-82d7-162736cdf167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:50.193118 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b99c064b-b0f2-488c-82d7-162736cdf167 None None] MFA Rules not processed for user `9cda02ec4eae4879906e946a1932cfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:50.194302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b99c064b-b0f2-488c-82d7-162736cdf167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:50.262893 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1283/2570] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:50.274293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115b25b-9485-47a6-8220-e7e29bc1144a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:50.276108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d115b25b-9485-47a6-8220-e7e29bc1144a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:50.338263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115b25b-9485-47a6-8220-e7e29bc1144a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:50.343224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38e97a-0bbb-40f7-8c49-77463f69be38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:50.343861 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e97a-0bbb-40f7-8c49-77463f69be38 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:50.344143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e97a-0bbb-40f7-8c49-77463f69be38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:50.344419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e97a-0bbb-40f7-8c49-77463f69be38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:50.353392 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38e97a-0bbb-40f7-8c49-77463f69be38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:50.354844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38e97a-0bbb-40f7-8c49-77463f69be38 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:50.364294 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1288/2571] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:50.394535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c064b-b0f2-488c-82d7-162736cdf167 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:50.457727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c064b-b0f2-488c-82d7-162736cdf167 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:50.462331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:50.463223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:50.463507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:50.463783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] PATH_INFO: `/v3/users/bb481836d8ce4b7a9f7c7e0171383733` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:50.465091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb481836d8ce4b7a9f7c7e0171383733)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:50.467197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:50.511615 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:50.514661 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb481836d8ce4b7a9f7c7e0171383733'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:50.522750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb481836d8ce4b7a9f7c7e0171383733'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:50.529893 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb481836d8ce4b7a9f7c7e0171383733'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:50.530599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb481836d8ce4b7a9f7c7e0171383733'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:50.531279 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb481836d8ce4b7a9f7c7e0171383733'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:50.548774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1284/2572] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:21:50 2022] DELETE /identity/v3/users/bb481836d8ce4b7a9f7c7e0171383733 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:50.553208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6b875-e235-4f46-8440-32b44a0a7cb0 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:50.553499 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6b875-e235-4f46-8440-32b44a0a7cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:50.553780 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6b875-e235-4f46-8440-32b44a0a7cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:50.572876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-41d6b875-e235-4f46-8440-32b44a0a7cb0 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:50.574093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-41d6b875-e235-4f46-8440-32b44a0a7cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:50.638001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1289/2573] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:50.647742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:50.649420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:50.706975 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa63e16-5f05-46c7-b6a2-c9bd1d370576 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:50.710645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578537-18a8-4da2-b55e-b2aa09775cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:50.711297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578537-18a8-4da2-b55e-b2aa09775cba service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:50.711581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578537-18a8-4da2-b55e-b2aa09775cba service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:50.711861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578537-18a8-4da2-b55e-b2aa09775cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:50.721230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578537-18a8-4da2-b55e-b2aa09775cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:50.722690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578537-18a8-4da2-b55e-b2aa09775cba service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:50.732722 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1285/2574] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:50.998606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6b875-e235-4f46-8440-32b44a0a7cb0 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:51.000203 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-41d6b875-e235-4f46-8440-32b44a0a7cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:51.013323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6b875-e235-4f46-8440-32b44a0a7cb0 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:51.018434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:51.019317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:51.019596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:51.019869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] PATH_INFO: `/v3/projects/9122e690b9a94815b5439501b3839b77` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:51.021067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] RBAC: Authorizing `identity:delete_project(project_id=9122e690b9a94815b5439501b3839b77)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:51.023155 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:51.060156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:51.076604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9122e690b9a94815b5439501b3839b77', 'request_id': 'req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.084199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9122e690b9a94815b5439501b3839b77', 'request_id': 'req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.091144 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9122e690b9a94815b5439501b3839b77', 'request_id': 'req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.101448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] The token cache is being invalidate because project 9122e690b9a94815b5439501b3839b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:21:51.101733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.102434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.104001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1290/2575] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:21:50 2022] DELETE /identity/v3/projects/9122e690b9a94815b5439501b3839b77 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:51.108492 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578537-18a8-4da2-b55e-b2aa09775cba service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:51.119657 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578537-18a8-4da2-b55e-b2aa09775cba service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:51.181581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d47d4-ec36-47f1-a5d4-52667ce97259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:51.182358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d47d4-ec36-47f1-a5d4-52667ce97259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:51.182659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d47d4-ec36-47f1-a5d4-52667ce97259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:51.182936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d47d4-ec36-47f1-a5d4-52667ce97259 admin admin] PATH_INFO: `/v3/users/9cda02ec4eae4879906e946a1932cfbb` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:51.184187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d47d4-ec36-47f1-a5d4-52667ce97259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cda02ec4eae4879906e946a1932cfbb)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:51.186079 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d47d4-ec36-47f1-a5d4-52667ce97259 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:51.232648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-405d47d4-ec36-47f1-a5d4-52667ce97259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cda02ec4eae4879906e946a1932cfbb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.239602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-405d47d4-ec36-47f1-a5d4-52667ce97259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cda02ec4eae4879906e946a1932cfbb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.246921 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-405d47d4-ec36-47f1-a5d4-52667ce97259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cda02ec4eae4879906e946a1932cfbb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.247538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-405d47d4-ec36-47f1-a5d4-52667ce97259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cda02ec4eae4879906e946a1932cfbb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.248153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-405d47d4-ec36-47f1-a5d4-52667ce97259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cda02ec4eae4879906e946a1932cfbb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.252939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:51.268027 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1286/2576] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:21:51 2022] DELETE /identity/v3/users/9cda02ec4eae4879906e946a1932cfbb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:51.542503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:51.544266 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:51.557259 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377607f-caa4-4e8e-bbdf-b2d97d00f2de admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:51.621232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf58393-4da3-4606-af41-a659ae8aaea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:51.623937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf58393-4da3-4606-af41-a659ae8aaea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:51.624225 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf58393-4da3-4606-af41-a659ae8aaea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:51.624507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf58393-4da3-4606-af41-a659ae8aaea0 admin admin] PATH_INFO: `/v3/projects/645258b0c9a342218fbaf87050806162` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:51.625784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf58393-4da3-4606-af41-a659ae8aaea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=645258b0c9a342218fbaf87050806162)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:51.628894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf58393-4da3-4606-af41-a659ae8aaea0 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:51.696800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-edf58393-4da3-4606-af41-a659ae8aaea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645258b0c9a342218fbaf87050806162', 'request_id': 'req-edf58393-4da3-4606-af41-a659ae8aaea0'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.704804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-edf58393-4da3-4606-af41-a659ae8aaea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645258b0c9a342218fbaf87050806162', 'request_id': 'req-edf58393-4da3-4606-af41-a659ae8aaea0'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.711120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-edf58393-4da3-4606-af41-a659ae8aaea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645258b0c9a342218fbaf87050806162', 'request_id': 'req-edf58393-4da3-4606-af41-a659ae8aaea0'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.722655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-edf58393-4da3-4606-af41-a659ae8aaea0 admin admin] The token cache is being invalidate because project 645258b0c9a342218fbaf87050806162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:21:51.722888 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-edf58393-4da3-4606-af41-a659ae8aaea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.723525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-edf58393-4da3-4606-af41-a659ae8aaea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:51.725059 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1291/2577] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:21:51 2022] DELETE /identity/v3/projects/645258b0c9a342218fbaf87050806162 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:51.729905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf1d3c-858e-42ab-bbeb-309259a8860e None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:51.730195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf1d3c-858e-42ab-bbeb-309259a8860e None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:51.730596 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf1d3c-858e-42ab-bbeb-309259a8860e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:51.749333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-15bf1d3c-858e-42ab-bbeb-309259a8860e None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:51.750533 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-15bf1d3c-858e-42ab-bbeb-309259a8860e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:51.817026 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1287/2578] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:51.825686 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3876e-052a-487f-b469-602b182e5f48 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:51.825988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3876e-052a-487f-b469-602b182e5f48 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:51.826261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3876e-052a-487f-b469-602b182e5f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:51.844793 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-39a3876e-052a-487f-b469-602b182e5f48 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:51.845983 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-39a3876e-052a-487f-b469-602b182e5f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:51.853942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1292/2579] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:51.858511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf1d3c-858e-42ab-bbeb-309259a8860e None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:51.868210 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf1d3c-858e-42ab-bbeb-309259a8860e None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:51.873597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d6a03-e831-4850-81b2-c9a112a5d83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:51.874247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d6a03-e831-4850-81b2-c9a112a5d83a admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:51.874531 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d6a03-e831-4850-81b2-c9a112a5d83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:51.874845 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d6a03-e831-4850-81b2-c9a112a5d83a admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:51.875578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d6a03-e831-4850-81b2-c9a112a5d83a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:21:51.875887 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d6a03-e831-4850-81b2-c9a112a5d83a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:51.877783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d6a03-e831-4850-81b2-c9a112a5d83a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:51.890330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1288/2580] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:21:51.894583 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3876e-052a-487f-b469-602b182e5f48 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:51.904134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3876e-052a-487f-b469-602b182e5f48 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:51.909180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851d164-8930-414c-82b8-cc5d2b4a2813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:51.909816 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851d164-8930-414c-82b8-cc5d2b4a2813 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:51.910100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851d164-8930-414c-82b8-cc5d2b4a2813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:51.910373 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851d164-8930-414c-82b8-cc5d2b4a2813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:51.911090 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851d164-8930-414c-82b8-cc5d2b4a2813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:51.912958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851d164-8930-414c-82b8-cc5d2b4a2813 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:51.938718 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1293/2581] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:21:51 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:51.943211 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d6a03-e831-4850-81b2-c9a112a5d83a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:51.957366 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d6a03-e831-4850-81b2-c9a112a5d83a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:52.015349 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9af9af-d01c-4683-ba6b-192427c7ef50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:52.015951 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9af9af-d01c-4683-ba6b-192427c7ef50 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.016233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9af9af-d01c-4683-ba6b-192427c7ef50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.016508 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9af9af-d01c-4683-ba6b-192427c7ef50 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.017198 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9af9af-d01c-4683-ba6b-192427c7ef50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:52.019449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9af9af-d01c-4683-ba6b-192427c7ef50 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:52.039957 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1289/2582] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:21:51 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:52.044365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851d164-8930-414c-82b8-cc5d2b4a2813 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:52.054609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851d164-8930-414c-82b8-cc5d2b4a2813 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:52.059868 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d1ea1-953e-45de-af87-2b75ad325104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:52.060508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d1ea1-953e-45de-af87-2b75ad325104 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.060790 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d1ea1-953e-45de-af87-2b75ad325104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.061063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d1ea1-953e-45de-af87-2b75ad325104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.061797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d1ea1-953e-45de-af87-2b75ad325104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:52.063408 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d1ea1-953e-45de-af87-2b75ad325104 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:52.073688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1294/2583] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:21:52.078177 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9af9af-d01c-4683-ba6b-192427c7ef50 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:52.088922 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9af9af-d01c-4683-ba6b-192427c7ef50 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:52.093606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bfb61-1776-41b5-b21b-6507f007678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:52.094250 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bfb61-1776-41b5-b21b-6507f007678f admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.094532 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bfb61-1776-41b5-b21b-6507f007678f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.094840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bfb61-1776-41b5-b21b-6507f007678f admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.095562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bfb61-1776-41b5-b21b-6507f007678f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:52.097140 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bfb61-1776-41b5-b21b-6507f007678f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:52.107185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1290/2584] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:52.111314 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d1ea1-953e-45de-af87-2b75ad325104 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:52.125281 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d1ea1-953e-45de-af87-2b75ad325104 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:52.135228 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeff0bc-809c-473a-a7ff-8501d44db157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:52.136318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeff0bc-809c-473a-a7ff-8501d44db157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.136569 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeff0bc-809c-473a-a7ff-8501d44db157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.137497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeff0bc-809c-473a-a7ff-8501d44db157 admin admin] PATH_INFO: `/v3/projects/42357bafe43e4ee0bbfff499e09cda67/users/3faafdf6d07d41858b74539c79fef55c/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.140634 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:52.158900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeff0bc-809c-473a-a7ff-8501d44db157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42357bafe43e4ee0bbfff499e09cda67, user_id=3faafdf6d07d41858b74539c79fef55c, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:52.161633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeff0bc-809c-473a-a7ff-8501d44db157 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:52.179022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1295/2585] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:52 2022] PUT /identity/v3/projects/42357bafe43e4ee0bbfff499e09cda67/users/3faafdf6d07d41858b74539c79fef55c/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:52.191101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848bc3f-90e2-406f-8e23-309bb2b15df7 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.191597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848bc3f-90e2-406f-8e23-309bb2b15df7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.191679 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848bc3f-90e2-406f-8e23-309bb2b15df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.229275 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7848bc3f-90e2-406f-8e23-309bb2b15df7 None None] MFA Rules not processed for user `3faafdf6d07d41858b74539c79fef55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:52.231185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7848bc3f-90e2-406f-8e23-309bb2b15df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:52.285467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:52.316539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1291/2586] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:52.320566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeff0bc-809c-473a-a7ff-8501d44db157 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:52.388267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeff0bc-809c-473a-a7ff-8501d44db157 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:52.395996 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f067ce4-097b-41d5-ab25-ece23fed8ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:52.396675 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f067ce4-097b-41d5-ab25-ece23fed8ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.396950 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f067ce4-097b-41d5-ab25-ece23fed8ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.397231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f067ce4-097b-41d5-ab25-ece23fed8ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.397926 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f067ce4-097b-41d5-ab25-ece23fed8ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:52.399892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f067ce4-097b-41d5-ab25-ece23fed8ebb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:52.425604 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1296/2587] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:21:52 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:52.429632 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848bc3f-90e2-406f-8e23-309bb2b15df7 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:52.440965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848bc3f-90e2-406f-8e23-309bb2b15df7 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:52.497149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375e01a-933a-4272-a99e-08a5794ceba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:52.497809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375e01a-933a-4272-a99e-08a5794ceba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.498096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375e01a-933a-4272-a99e-08a5794ceba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.498374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375e01a-933a-4272-a99e-08a5794ceba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.499103 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375e01a-933a-4272-a99e-08a5794ceba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:52.501049 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375e01a-933a-4272-a99e-08a5794ceba6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:52.521162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1292/2588] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:21:52 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:52.525103 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f067ce4-097b-41d5-ab25-ece23fed8ebb admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:52.535487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f067ce4-097b-41d5-ab25-ece23fed8ebb admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:52.539986 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f792-1028-4eec-991c-5d10a1755040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:52.540613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f792-1028-4eec-991c-5d10a1755040 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.540895 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f792-1028-4eec-991c-5d10a1755040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.541177 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f792-1028-4eec-991c-5d10a1755040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.541892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7f792-1028-4eec-991c-5d10a1755040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:52.544264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7f792-1028-4eec-991c-5d10a1755040 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:52.554466 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1297/2589] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:21:52.558357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375e01a-933a-4272-a99e-08a5794ceba6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:52.568704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375e01a-933a-4272-a99e-08a5794ceba6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:52.575591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdcb21-565f-4a8a-b496-49ac5fcc73f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:52.576637 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdcb21-565f-4a8a-b496-49ac5fcc73f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.576929 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdcb21-565f-4a8a-b496-49ac5fcc73f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.577208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdcb21-565f-4a8a-b496-49ac5fcc73f0 admin admin] PATH_INFO: `/v3/projects/2d8f03cbbedb42609374c93ad59c3c2d/users/698769ac21d9484e80a428b952d6c897/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.592991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdcb21-565f-4a8a-b496-49ac5fcc73f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8f03cbbedb42609374c93ad59c3c2d, user_id=698769ac21d9484e80a428b952d6c897, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:52.595695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdcb21-565f-4a8a-b496-49ac5fcc73f0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:52.608453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1293/2590] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:52 2022] PUT /identity/v3/projects/2d8f03cbbedb42609374c93ad59c3c2d/users/698769ac21d9484e80a428b952d6c897/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:52.612521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f792-1028-4eec-991c-5d10a1755040 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:52.623352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f792-1028-4eec-991c-5d10a1755040 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:52.679354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42032692-1fa1-42b9-82e6-5978c39d34e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:52.680007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032692-1fa1-42b9-82e6-5978c39d34e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.680286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032692-1fa1-42b9-82e6-5978c39d34e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.680558 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032692-1fa1-42b9-82e6-5978c39d34e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.681263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42032692-1fa1-42b9-82e6-5978c39d34e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:52.682873 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42032692-1fa1-42b9-82e6-5978c39d34e5 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:52.692463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1298/2591] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:52.696675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdcb21-565f-4a8a-b496-49ac5fcc73f0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:52.707155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdcb21-565f-4a8a-b496-49ac5fcc73f0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:52.711809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cc4ff-9b07-40ec-b91f-733e26fe5577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:52.712675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cc4ff-9b07-40ec-b91f-733e26fe5577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.712959 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cc4ff-9b07-40ec-b91f-733e26fe5577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.713239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cc4ff-9b07-40ec-b91f-733e26fe5577 admin admin] PATH_INFO: `/v3/projects/2d8f03cbbedb42609374c93ad59c3c2d/users/698769ac21d9484e80a428b952d6c897/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.715850 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cc4ff-9b07-40ec-b91f-733e26fe5577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8f03cbbedb42609374c93ad59c3c2d, user_id=698769ac21d9484e80a428b952d6c897, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:52.718475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cc4ff-9b07-40ec-b91f-733e26fe5577 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:52.728528 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1294/2592] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:52 2022] PUT /identity/v3/projects/2d8f03cbbedb42609374c93ad59c3c2d/users/698769ac21d9484e80a428b952d6c897/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:21:52.739259 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a8042-1aaa-4ab6-99dc-e0bcf5512b63 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.739549 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a8042-1aaa-4ab6-99dc-e0bcf5512b63 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.739829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a8042-1aaa-4ab6-99dc-e0bcf5512b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.765668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e81a8042-1aaa-4ab6-99dc-e0bcf5512b63 None None] MFA Rules not processed for user `698769ac21d9484e80a428b952d6c897`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:52.766902 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e81a8042-1aaa-4ab6-99dc-e0bcf5512b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:52.807898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:52.835650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1299/2593] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:52.847709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cc4ff-9b07-40ec-b91f-733e26fe5577 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:52.849370 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-4e4cc4ff-9b07-40ec-b91f-733e26fe5577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:52.906647 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cc4ff-9b07-40ec-b91f-733e26fe5577 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:52.910272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf26f7e-99b1-43cf-aa36-929f504056b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:52.910939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf26f7e-99b1-43cf-aa36-929f504056b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:52.911221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf26f7e-99b1-43cf-aa36-929f504056b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:52.911491 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf26f7e-99b1-43cf-aa36-929f504056b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:52.920938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf26f7e-99b1-43cf-aa36-929f504056b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:52.922358 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf26f7e-99b1-43cf-aa36-929f504056b7 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:52.931810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1295/2594] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:21:52.998648 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a8042-1aaa-4ab6-99dc-e0bcf5512b63 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:53.008918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a8042-1aaa-4ab6-99dc-e0bcf5512b63 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:53.013426 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad0055-f7d7-4f74-a35a-c92632a3f680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:53.014067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad0055-f7d7-4f74-a35a-c92632a3f680 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:53.014355 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad0055-f7d7-4f74-a35a-c92632a3f680 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:53.014661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad0055-f7d7-4f74-a35a-c92632a3f680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:53.071537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad0055-f7d7-4f74-a35a-c92632a3f680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:53.072881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad0055-f7d7-4f74-a35a-c92632a3f680 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:53.082353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1300/2595] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:53.344937 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf26f7e-99b1-43cf-aa36-929f504056b7 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:53.389311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:53.413434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf26f7e-99b1-43cf-aa36-929f504056b7 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:53.418087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:53.418975 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:53.419256 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:53.419529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] PATH_INFO: `/v3/users/3faafdf6d07d41858b74539c79fef55c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:53.420727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3faafdf6d07d41858b74539c79fef55c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:53.422661 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:53.467313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3faafdf6d07d41858b74539c79fef55c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:53.473945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3faafdf6d07d41858b74539c79fef55c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:53.481124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3faafdf6d07d41858b74539c79fef55c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:53.481735 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3faafdf6d07d41858b74539c79fef55c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:53.482356 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3faafdf6d07d41858b74539c79fef55c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:53.499882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1296/2596] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:21:53 2022] DELETE /identity/v3/users/3faafdf6d07d41858b74539c79fef55c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:53.504705 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b9434-2297-4dd2-aca0-b385801e3cef None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:53.505002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b9434-2297-4dd2-aca0-b385801e3cef None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:53.505284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b9434-2297-4dd2-aca0-b385801e3cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:53.523459 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-d41b9434-2297-4dd2-aca0-b385801e3cef None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:53.524979 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d41b9434-2297-4dd2-aca0-b385801e3cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:53.589224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1301/2597] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:53.599402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:53.600806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:53.659949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d18ae-8400-4c2b-81a1-193f0f278af0 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:53.663692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2379d-a07f-4305-9071-2bd8f26d5cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:53.664603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2379d-a07f-4305-9071-2bd8f26d5cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:53.664731 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2379d-a07f-4305-9071-2bd8f26d5cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:53.664912 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2379d-a07f-4305-9071-2bd8f26d5cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:53.674468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2379d-a07f-4305-9071-2bd8f26d5cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:53.675928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2379d-a07f-4305-9071-2bd8f26d5cb3 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:53.686452 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1297/2598] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:53.977697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b9434-2297-4dd2-aca0-b385801e3cef None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:53.979278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d41b9434-2297-4dd2-aca0-b385801e3cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:53.996118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b9434-2297-4dd2-aca0-b385801e3cef None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:54.001175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:54.002038 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:54.002659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:54.003260 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] PATH_INFO: `/v3/projects/42357bafe43e4ee0bbfff499e09cda67` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:54.004584 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42357bafe43e4ee0bbfff499e09cda67)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:54.008223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:54.056865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42357bafe43e4ee0bbfff499e09cda67', 'request_id': 'req-03442b3a-02fc-402a-a66f-8ab75606d6a1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.063930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42357bafe43e4ee0bbfff499e09cda67', 'request_id': 'req-03442b3a-02fc-402a-a66f-8ab75606d6a1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.070054 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42357bafe43e4ee0bbfff499e09cda67', 'request_id': 'req-03442b3a-02fc-402a-a66f-8ab75606d6a1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.077820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:54.082188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] The token cache is being invalidate because project 42357bafe43e4ee0bbfff499e09cda67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:21:54.082813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.083710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.085326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1302/2599] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:21:53 2022] DELETE /identity/v3/projects/42357bafe43e4ee0bbfff499e09cda67 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:54.090392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2379d-a07f-4305-9071-2bd8f26d5cb3 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:54.101496 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2379d-a07f-4305-9071-2bd8f26d5cb3 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:54.151998 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:54.158974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab414d-7b7c-4a65-b6f5-dc17333baa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:54.159931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab414d-7b7c-4a65-b6f5-dc17333baa22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:54.160554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab414d-7b7c-4a65-b6f5-dc17333baa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:54.160861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab414d-7b7c-4a65-b6f5-dc17333baa22 admin admin] PATH_INFO: `/v3/users/698769ac21d9484e80a428b952d6c897` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:54.162274 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab414d-7b7c-4a65-b6f5-dc17333baa22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=698769ac21d9484e80a428b952d6c897)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:54.164259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab414d-7b7c-4a65-b6f5-dc17333baa22 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:54.209721 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c7ab414d-7b7c-4a65-b6f5-dc17333baa22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '698769ac21d9484e80a428b952d6c897'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.217157 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c7ab414d-7b7c-4a65-b6f5-dc17333baa22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '698769ac21d9484e80a428b952d6c897'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.224511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c7ab414d-7b7c-4a65-b6f5-dc17333baa22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '698769ac21d9484e80a428b952d6c897'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.225127 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c7ab414d-7b7c-4a65-b6f5-dc17333baa22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '698769ac21d9484e80a428b952d6c897'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.225708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c7ab414d-7b7c-4a65-b6f5-dc17333baa22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '698769ac21d9484e80a428b952d6c897'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.243164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1298/2600] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:21:54 2022] DELETE /identity/v3/users/698769ac21d9484e80a428b952d6c897 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:54.516026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:54.517866 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:54.538462 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03442b3a-02fc-402a-a66f-8ab75606d6a1 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:54.622712 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce727a-95db-4d1a-8215-a479400ed432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:54.623485 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce727a-95db-4d1a-8215-a479400ed432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:54.623761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce727a-95db-4d1a-8215-a479400ed432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:54.624029 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce727a-95db-4d1a-8215-a479400ed432 admin admin] PATH_INFO: `/v3/projects/2d8f03cbbedb42609374c93ad59c3c2d` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:54.625868 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce727a-95db-4d1a-8215-a479400ed432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8f03cbbedb42609374c93ad59c3c2d)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:54.629251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce727a-95db-4d1a-8215-a479400ed432 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:54.679158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8dce727a-95db-4d1a-8215-a479400ed432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8f03cbbedb42609374c93ad59c3c2d', 'request_id': 'req-8dce727a-95db-4d1a-8215-a479400ed432'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.687056 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8dce727a-95db-4d1a-8215-a479400ed432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8f03cbbedb42609374c93ad59c3c2d', 'request_id': 'req-8dce727a-95db-4d1a-8215-a479400ed432'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.693495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8dce727a-95db-4d1a-8215-a479400ed432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8f03cbbedb42609374c93ad59c3c2d', 'request_id': 'req-8dce727a-95db-4d1a-8215-a479400ed432'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.703698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8dce727a-95db-4d1a-8215-a479400ed432 admin admin] The token cache is being invalidate because project 2d8f03cbbedb42609374c93ad59c3c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:21:54.703978 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8dce727a-95db-4d1a-8215-a479400ed432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.704597 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-8dce727a-95db-4d1a-8215-a479400ed432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:54.706137 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1303/2601] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:21:54 2022] DELETE /identity/v3/projects/2d8f03cbbedb42609374c93ad59c3c2d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:54.711043 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd4d59-b39a-441a-9dad-b69195684858 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:54.711617 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd4d59-b39a-441a-9dad-b69195684858 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:54.711901 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd4d59-b39a-441a-9dad-b69195684858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:54.731693 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-bdbd4d59-b39a-441a-9dad-b69195684858 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:54.732895 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-bdbd4d59-b39a-441a-9dad-b69195684858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:54.798096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1299/2602] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:54.805748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202c1a7-ecf0-4435-ad55-2d4675fcdbda None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:54.806087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202c1a7-ecf0-4435-ad55-2d4675fcdbda None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:54.806454 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202c1a7-ecf0-4435-ad55-2d4675fcdbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:54.827319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-0202c1a7-ecf0-4435-ad55-2d4675fcdbda None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:54.828822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0202c1a7-ecf0-4435-ad55-2d4675fcdbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:54.837524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1304/2603] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:54.841924 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd4d59-b39a-441a-9dad-b69195684858 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:54.851459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd4d59-b39a-441a-9dad-b69195684858 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:54.856104 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b78235-8c2a-4a29-aae4-c1792f17169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:54.856751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b78235-8c2a-4a29-aae4-c1792f17169a admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:54.857031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b78235-8c2a-4a29-aae4-c1792f17169a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:54.857304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b78235-8c2a-4a29-aae4-c1792f17169a admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:54.858023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b78235-8c2a-4a29-aae4-c1792f17169a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:21:54.858351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b78235-8c2a-4a29-aae4-c1792f17169a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:54.859963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b78235-8c2a-4a29-aae4-c1792f17169a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:54.873487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1300/2604] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:21:54.877680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202c1a7-ecf0-4435-ad55-2d4675fcdbda None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:54.887319 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202c1a7-ecf0-4435-ad55-2d4675fcdbda None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:54.892340 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e3c0d-5d8f-422e-8fd0-ddc8e04340d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:54.892985 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e3c0d-5d8f-422e-8fd0-ddc8e04340d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:54.893264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e3c0d-5d8f-422e-8fd0-ddc8e04340d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:54.893536 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e3c0d-5d8f-422e-8fd0-ddc8e04340d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:54.894230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e3c0d-5d8f-422e-8fd0-ddc8e04340d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:54.896211 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e3c0d-5d8f-422e-8fd0-ddc8e04340d8 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:54.934747 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1305/2605] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:21:54 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:21:54.935902 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b78235-8c2a-4a29-aae4-c1792f17169a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:54.946518 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b78235-8c2a-4a29-aae4-c1792f17169a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:55.007924 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcc947-0386-454b-b5a1-42b19e0fe333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:55.008587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcc947-0386-454b-b5a1-42b19e0fe333 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:55.008871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcc947-0386-454b-b5a1-42b19e0fe333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:55.009258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcc947-0386-454b-b5a1-42b19e0fe333 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:55.009948 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcc947-0386-454b-b5a1-42b19e0fe333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:55.012470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcc947-0386-454b-b5a1-42b19e0fe333 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:55.021141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:55.040674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1301/2606] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:21:54 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:55.041885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e3c0d-5d8f-422e-8fd0-ddc8e04340d8 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:55.052908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e3c0d-5d8f-422e-8fd0-ddc8e04340d8 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:55.057622 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd7536-3ea7-411e-abe8-e6d4a53f3cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:55.058302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd7536-3ea7-411e-abe8-e6d4a53f3cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:55.058606 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd7536-3ea7-411e-abe8-e6d4a53f3cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:55.058907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd7536-3ea7-411e-abe8-e6d4a53f3cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:55.059627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd7536-3ea7-411e-abe8-e6d4a53f3cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:55.061265 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd7536-3ea7-411e-abe8-e6d4a53f3cb1 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:55.072370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1306/2607] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:55.076605 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcc947-0386-454b-b5a1-42b19e0fe333 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:55.086882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcc947-0386-454b-b5a1-42b19e0fe333 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:55.092263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a894009-0e9c-44ae-8fdf-a9c1e419f68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:55.092918 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a894009-0e9c-44ae-8fdf-a9c1e419f68f admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:55.093203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a894009-0e9c-44ae-8fdf-a9c1e419f68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:55.093479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a894009-0e9c-44ae-8fdf-a9c1e419f68f admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:55.094196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a894009-0e9c-44ae-8fdf-a9c1e419f68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:55.095791 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a894009-0e9c-44ae-8fdf-a9c1e419f68f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:55.108204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1302/2608] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:55.114661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd7536-3ea7-411e-abe8-e6d4a53f3cb1 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:55.128773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd7536-3ea7-411e-abe8-e6d4a53f3cb1 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:55.135627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a0490-73a5-4eae-b6c0-0411f2736d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:55.136634 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a0490-73a5-4eae-b6c0-0411f2736d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:55.137086 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a0490-73a5-4eae-b6c0-0411f2736d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:55.137575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a0490-73a5-4eae-b6c0-0411f2736d31 admin admin] PATH_INFO: `/v3/projects/8f604e6bc17247c1b2c62ab4e324f9f6/users/8c766765ac24408fb9b74d6dfec0b5e4/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:55.155974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a0490-73a5-4eae-b6c0-0411f2736d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f604e6bc17247c1b2c62ab4e324f9f6, user_id=8c766765ac24408fb9b74d6dfec0b5e4, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:55.158769 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a0490-73a5-4eae-b6c0-0411f2736d31 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:55.177668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1307/2609] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:55 2022] PUT /identity/v3/projects/8f604e6bc17247c1b2c62ab4e324f9f6/users/8c766765ac24408fb9b74d6dfec0b5e4/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:21:55.188999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e10a7-64f5-4ad1-8360-d94632967a67 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:55.189285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e10a7-64f5-4ad1-8360-d94632967a67 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:55.189589 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e10a7-64f5-4ad1-8360-d94632967a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:55.217491 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-d74e10a7-64f5-4ad1-8360-d94632967a67 None None] MFA Rules not processed for user `8c766765ac24408fb9b74d6dfec0b5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:55.218867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d74e10a7-64f5-4ad1-8360-d94632967a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:55.285101 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1303/2610] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:55.297113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a0490-73a5-4eae-b6c0-0411f2736d31 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:55.298889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-028a0490-73a5-4eae-b6c0-0411f2736d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:55.330255 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:55.359608 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a0490-73a5-4eae-b6c0-0411f2736d31 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:55.363193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232bea5-6c1c-47ff-a937-624748db603f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:55.363829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232bea5-6c1c-47ff-a937-624748db603f service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:55.364114 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232bea5-6c1c-47ff-a937-624748db603f service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:55.364391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232bea5-6c1c-47ff-a937-624748db603f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:55.373061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232bea5-6c1c-47ff-a937-624748db603f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:55.374553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232bea5-6c1c-47ff-a937-624748db603f service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:55.384035 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1308/2611] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:55.405102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e10a7-64f5-4ad1-8360-d94632967a67 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:55.466770 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e10a7-64f5-4ad1-8360-d94632967a67 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:55.471437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:55.472300 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:55.472588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:55.472866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] PATH_INFO: `/v3/users/8c766765ac24408fb9b74d6dfec0b5e4` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:55.474074 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c766765ac24408fb9b74d6dfec0b5e4)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:55.476633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:55.523866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c766765ac24408fb9b74d6dfec0b5e4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:55.531343 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c766765ac24408fb9b74d6dfec0b5e4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:55.539233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c766765ac24408fb9b74d6dfec0b5e4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:55.539884 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c766765ac24408fb9b74d6dfec0b5e4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:55.540668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c766765ac24408fb9b74d6dfec0b5e4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:55.555720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:55.568153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1304/2612] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:21:55 2022] DELETE /identity/v3/users/8c766765ac24408fb9b74d6dfec0b5e4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:55.573033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0188ee-3a38-473a-bc33-91bc0b092a8a None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:55.573330 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0188ee-3a38-473a-bc33-91bc0b092a8a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:55.573617 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0188ee-3a38-473a-bc33-91bc0b092a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:55.593592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-de0188ee-3a38-473a-bc33-91bc0b092a8a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:55.594847 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-de0188ee-3a38-473a-bc33-91bc0b092a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:55.656652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1309/2613] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:55.666364 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:55.667824 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:55.725954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746e216-9a89-44ac-95fe-c06c25945e9d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:55.729876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0531cf-7a8c-44fb-9e92-2387540a1e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:55.730455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0531cf-7a8c-44fb-9e92-2387540a1e34 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:55.730779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0531cf-7a8c-44fb-9e92-2387540a1e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:55.731064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0531cf-7a8c-44fb-9e92-2387540a1e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:55.740415 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0531cf-7a8c-44fb-9e92-2387540a1e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:55.741853 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0531cf-7a8c-44fb-9e92-2387540a1e34 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:55.753048 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1305/2614] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:21:56.039646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0188ee-3a38-473a-bc33-91bc0b092a8a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:56.041205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-de0188ee-3a38-473a-bc33-91bc0b092a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:56.057390 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0188ee-3a38-473a-bc33-91bc0b092a8a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:56.062953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a5282-2f6b-4d83-9636-dd84ae3fe282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:56.064019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a5282-2f6b-4d83-9636-dd84ae3fe282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:56.064288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a5282-2f6b-4d83-9636-dd84ae3fe282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:56.064551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a5282-2f6b-4d83-9636-dd84ae3fe282 admin admin] PATH_INFO: `/v3/projects/8f604e6bc17247c1b2c62ab4e324f9f6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:56.065869 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a5282-2f6b-4d83-9636-dd84ae3fe282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f604e6bc17247c1b2c62ab4e324f9f6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:56.068071 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a5282-2f6b-4d83-9636-dd84ae3fe282 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:56.116921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-237a5282-2f6b-4d83-9636-dd84ae3fe282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f604e6bc17247c1b2c62ab4e324f9f6', 'request_id': 'req-237a5282-2f6b-4d83-9636-dd84ae3fe282'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:56.125518 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-237a5282-2f6b-4d83-9636-dd84ae3fe282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f604e6bc17247c1b2c62ab4e324f9f6', 'request_id': 'req-237a5282-2f6b-4d83-9636-dd84ae3fe282'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:56.132344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-237a5282-2f6b-4d83-9636-dd84ae3fe282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f604e6bc17247c1b2c62ab4e324f9f6', 'request_id': 'req-237a5282-2f6b-4d83-9636-dd84ae3fe282'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:56.143060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-237a5282-2f6b-4d83-9636-dd84ae3fe282 admin admin] The token cache is being invalidate because project 8f604e6bc17247c1b2c62ab4e324f9f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:21:56.143444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-237a5282-2f6b-4d83-9636-dd84ae3fe282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:56.144185 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-237a5282-2f6b-4d83-9636-dd84ae3fe282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:21:56.145668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1310/2615] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:21:56 2022] DELETE /identity/v3/projects/8f604e6bc17247c1b2c62ab4e324f9f6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:56.150516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89470b4-d800-4ec5-bc49-76cd184e03ea None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:56.150838 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89470b4-d800-4ec5-bc49-76cd184e03ea None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:56.151116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89470b4-d800-4ec5-bc49-76cd184e03ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:56.169899 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-c89470b4-d800-4ec5-bc49-76cd184e03ea None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:56.171145 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c89470b4-d800-4ec5-bc49-76cd184e03ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:56.237199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1306/2616] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:56.245365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab2eb0-0409-436c-b3bc-0577d5bbdf79 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:56.245769 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab2eb0-0409-436c-b3bc-0577d5bbdf79 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:56.246877 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab2eb0-0409-436c-b3bc-0577d5bbdf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:56.276290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e5ab2eb0-0409-436c-b3bc-0577d5bbdf79 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:56.277818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e5ab2eb0-0409-436c-b3bc-0577d5bbdf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:56.288452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1311/2617] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:21:56.294226 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89470b4-d800-4ec5-bc49-76cd184e03ea None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:56.303243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89470b4-d800-4ec5-bc49-76cd184e03ea None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:56.310585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12751946-0a45-4328-a59e-01309d5a1fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:56.311289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751946-0a45-4328-a59e-01309d5a1fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:56.311578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751946-0a45-4328-a59e-01309d5a1fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:56.311859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751946-0a45-4328-a59e-01309d5a1fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:56.312603 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12751946-0a45-4328-a59e-01309d5a1fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:21:56.312919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12751946-0a45-4328-a59e-01309d5a1fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:56.315205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12751946-0a45-4328-a59e-01309d5a1fb8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:56.333952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1307/2618] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:21:56.339183 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab2eb0-0409-436c-b3bc-0577d5bbdf79 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:56.349379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab2eb0-0409-436c-b3bc-0577d5bbdf79 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:56.353961 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02821494-8a0c-45bb-82f6-a05cb76f33fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:56.354605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02821494-8a0c-45bb-82f6-a05cb76f33fb admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:56.354916 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02821494-8a0c-45bb-82f6-a05cb76f33fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:56.355195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02821494-8a0c-45bb-82f6-a05cb76f33fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:56.356512 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02821494-8a0c-45bb-82f6-a05cb76f33fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:56.358404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02821494-8a0c-45bb-82f6-a05cb76f33fb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:56.387647 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1312/2619] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:21:56 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:56.391709 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12751946-0a45-4328-a59e-01309d5a1fb8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:56.404476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12751946-0a45-4328-a59e-01309d5a1fb8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:56.480703 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de54dcb-f735-49af-857d-0137c5e4020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:56.481378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54dcb-f735-49af-857d-0137c5e4020b admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:56.481663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54dcb-f735-49af-857d-0137c5e4020b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:56.481950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54dcb-f735-49af-857d-0137c5e4020b admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:56.482693 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de54dcb-f735-49af-857d-0137c5e4020b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:56.484620 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de54dcb-f735-49af-857d-0137c5e4020b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:56.510882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1308/2620] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:21:56 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:21:56.512226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02821494-8a0c-45bb-82f6-a05cb76f33fb admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:56.523807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02821494-8a0c-45bb-82f6-a05cb76f33fb admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:56.529381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba1a17-a816-4865-932a-f46ddc7bcddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:56.530245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba1a17-a816-4865-932a-f46ddc7bcddb admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:56.530699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba1a17-a816-4865-932a-f46ddc7bcddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:56.531043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba1a17-a816-4865-932a-f46ddc7bcddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:56.531785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba1a17-a816-4865-932a-f46ddc7bcddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:56.533410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba1a17-a816-4865-932a-f46ddc7bcddb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:56.545040 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1313/2621] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:56.550357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de54dcb-f735-49af-857d-0137c5e4020b admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:56.564772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de54dcb-f735-49af-857d-0137c5e4020b admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:56.576253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0b2d8-5044-4cdf-ac90-896ec0938706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:56.577065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0b2d8-5044-4cdf-ac90-896ec0938706 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:56.577404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0b2d8-5044-4cdf-ac90-896ec0938706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:56.577745 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0b2d8-5044-4cdf-ac90-896ec0938706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:56.578536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0b2d8-5044-4cdf-ac90-896ec0938706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:56.580221 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0b2d8-5044-4cdf-ac90-896ec0938706 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:56.588112 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:56.597794 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1309/2622] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:21:56.599505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba1a17-a816-4865-932a-f46ddc7bcddb admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:56.620320 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba1a17-a816-4865-932a-f46ddc7bcddb admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:56.629288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b861f75-1e33-46b1-adf9-883efb49bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:56.630277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b861f75-1e33-46b1-adf9-883efb49bbf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:56.630641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b861f75-1e33-46b1-adf9-883efb49bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:56.631002 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b861f75-1e33-46b1-adf9-883efb49bbf6 admin admin] PATH_INFO: `/v3/projects/34b78bbd05384df5805cbc6774893f9d/users/93094e62fef34ea7a64c5ac26837dff0/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:56.644471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:21:56.649565 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b861f75-1e33-46b1-adf9-883efb49bbf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b78bbd05384df5805cbc6774893f9d, user_id=93094e62fef34ea7a64c5ac26837dff0, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:56.653282 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b861f75-1e33-46b1-adf9-883efb49bbf6 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:56.669949 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1314/2623] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:21:56 2022] PUT /identity/v3/projects/34b78bbd05384df5805cbc6774893f9d/users/93094e62fef34ea7a64c5ac26837dff0/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:21:56.680408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276dc56-62ef-4166-8c78-fae96a73efb4 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:56.680738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276dc56-62ef-4166-8c78-fae96a73efb4 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:56.680990 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276dc56-62ef-4166-8c78-fae96a73efb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:56.727999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f276dc56-62ef-4166-8c78-fae96a73efb4 None None] MFA Rules not processed for user `93094e62fef34ea7a64c5ac26837dff0`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:21:56.729228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f276dc56-62ef-4166-8c78-fae96a73efb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:56.797515 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1310/2624] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:21:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:21:56.809278 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b861f75-1e33-46b1-adf9-883efb49bbf6 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:21:56.810315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4b861f75-1e33-46b1-adf9-883efb49bbf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:21:56.869064 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b861f75-1e33-46b1-adf9-883efb49bbf6 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:21:56.872885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cc397-033e-484a-9e2e-44e7dd53e41c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:21:56.873535 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cc397-033e-484a-9e2e-44e7dd53e41c service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:21:56.873819 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cc397-033e-484a-9e2e-44e7dd53e41c service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:21:56.874098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cc397-033e-484a-9e2e-44e7dd53e41c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:21:56.883226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cc397-033e-484a-9e2e-44e7dd53e41c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:21:56.884649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cc397-033e-484a-9e2e-44e7dd53e41c service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:21:56.894033 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1315/2625] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:21:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:04.273552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276dc56-62ef-4166-8c78-fae96a73efb4 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:04.336002 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276dc56-62ef-4166-8c78-fae96a73efb4 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:04.340420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:04.341271 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:04.341546 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:04.341834 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] PATH_INFO: `/v3/users/93094e62fef34ea7a64c5ac26837dff0` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:04.343009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93094e62fef34ea7a64c5ac26837dff0)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:04.344904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:04.391332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93094e62fef34ea7a64c5ac26837dff0'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:04.398239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93094e62fef34ea7a64c5ac26837dff0'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:04.405812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93094e62fef34ea7a64c5ac26837dff0'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:04.406425 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93094e62fef34ea7a64c5ac26837dff0'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:04.407051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93094e62fef34ea7a64c5ac26837dff0'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:04.424608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1311/2626] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:22:04 2022] DELETE /identity/v3/users/93094e62fef34ea7a64c5ac26837dff0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:04.429146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01164d11-f67f-4f09-b7da-fd83509c5fec None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:04.429663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01164d11-f67f-4f09-b7da-fd83509c5fec None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:04.429935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01164d11-f67f-4f09-b7da-fd83509c5fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:04.447776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-01164d11-f67f-4f09-b7da-fd83509c5fec None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:04.449424 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-01164d11-f67f-4f09-b7da-fd83509c5fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:04.508519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1316/2627] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:04.518136 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:04.519557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:04.530437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:04.582194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805348e-7cb0-4b09-a939-2844b17b5a34 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:04.586066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7a342-58b1-4f3e-8f4c-499c46e5e9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:04.586669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7a342-58b1-4f3e-8f4c-499c46e5e9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:04.586955 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7a342-58b1-4f3e-8f4c-499c46e5e9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:04.587228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7a342-58b1-4f3e-8f4c-499c46e5e9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:04.598396 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7a342-58b1-4f3e-8f4c-499c46e5e9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:04.599993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7a342-58b1-4f3e-8f4c-499c46e5e9d9 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:04.610130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1312/2628] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:04.885476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01164d11-f67f-4f09-b7da-fd83509c5fec None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:04.887886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-01164d11-f67f-4f09-b7da-fd83509c5fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:04.905026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01164d11-f67f-4f09-b7da-fd83509c5fec None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:04.910059 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30360c-150a-41cf-b68e-229366c793e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:04.911133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30360c-150a-41cf-b68e-229366c793e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:04.911437 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30360c-150a-41cf-b68e-229366c793e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:04.911652 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30360c-150a-41cf-b68e-229366c793e9 admin admin] PATH_INFO: `/v3/projects/34b78bbd05384df5805cbc6774893f9d` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:04.912923 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30360c-150a-41cf-b68e-229366c793e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b78bbd05384df5805cbc6774893f9d)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:04.914887 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30360c-150a-41cf-b68e-229366c793e9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:04.965507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9f30360c-150a-41cf-b68e-229366c793e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b78bbd05384df5805cbc6774893f9d', 'request_id': 'req-9f30360c-150a-41cf-b68e-229366c793e9'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:04.973299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9f30360c-150a-41cf-b68e-229366c793e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b78bbd05384df5805cbc6774893f9d', 'request_id': 'req-9f30360c-150a-41cf-b68e-229366c793e9'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:04.980487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9f30360c-150a-41cf-b68e-229366c793e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b78bbd05384df5805cbc6774893f9d', 'request_id': 'req-9f30360c-150a-41cf-b68e-229366c793e9'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:04.991149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9f30360c-150a-41cf-b68e-229366c793e9 admin admin] The token cache is being invalidate because project 34b78bbd05384df5805cbc6774893f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:22:04.991435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9f30360c-150a-41cf-b68e-229366c793e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:04.992094 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-9f30360c-150a-41cf-b68e-229366c793e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:04.993640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1317/2629] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:22:04 2022] DELETE /identity/v3/projects/34b78bbd05384df5805cbc6774893f9d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:22:04.998740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2125c-887c-4ba6-ad6b-1eb2fff2bfeb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:04.999117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2125c-887c-4ba6-ad6b-1eb2fff2bfeb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:04.999461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2125c-887c-4ba6-ad6b-1eb2fff2bfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:05.019004 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-55e2125c-887c-4ba6-ad6b-1eb2fff2bfeb None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:05.020203 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-55e2125c-887c-4ba6-ad6b-1eb2fff2bfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:05.083377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1313/2630] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:22:05.092098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac67a-fdaa-4ae5-bd0b-d01940b0b806 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:05.092412 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac67a-fdaa-4ae5-bd0b-d01940b0b806 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:05.092692 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac67a-fdaa-4ae5-bd0b-d01940b0b806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:05.111291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-1feac67a-fdaa-4ae5-bd0b-d01940b0b806 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:05.112472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1feac67a-fdaa-4ae5-bd0b-d01940b0b806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:05.120268 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1318/2631] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:05.125194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2125c-887c-4ba6-ad6b-1eb2fff2bfeb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:05.138917 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2125c-887c-4ba6-ad6b-1eb2fff2bfeb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:05.143702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e38061-a209-4887-9887-51225022e468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:05.144384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e38061-a209-4887-9887-51225022e468 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:05.144665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e38061-a209-4887-9887-51225022e468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:05.145066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e38061-a209-4887-9887-51225022e468 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:05.146544 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e38061-a209-4887-9887-51225022e468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:22:05.146892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e38061-a209-4887-9887-51225022e468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:05.148742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e38061-a209-4887-9887-51225022e468 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:05.162655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1314/2632] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:22:05.166838 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feac67a-fdaa-4ae5-bd0b-d01940b0b806 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:05.177969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feac67a-fdaa-4ae5-bd0b-d01940b0b806 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:05.182679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad80e7-fd3f-475f-a152-e256cbcf673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:05.184846 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad80e7-fd3f-475f-a152-e256cbcf673e admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:05.185125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad80e7-fd3f-475f-a152-e256cbcf673e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:05.185394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad80e7-fd3f-475f-a152-e256cbcf673e admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:05.186207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad80e7-fd3f-475f-a152-e256cbcf673e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:05.188142 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad80e7-fd3f-475f-a152-e256cbcf673e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:05.192448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:05.223372 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1319/2633] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:22:05 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:22:05.227498 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e38061-a209-4887-9887-51225022e468 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:05.239734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e38061-a209-4887-9887-51225022e468 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:05.298717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ab53d-d1bb-48d7-a979-0c574c8a75a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:05.299517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ab53d-d1bb-48d7-a979-0c574c8a75a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:05.299646 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ab53d-d1bb-48d7-a979-0c574c8a75a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:05.299921 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ab53d-d1bb-48d7-a979-0c574c8a75a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:05.300611 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ab53d-d1bb-48d7-a979-0c574c8a75a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:05.302549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ab53d-d1bb-48d7-a979-0c574c8a75a9 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:05.326776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1315/2634] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:22:05 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:22:05.328348 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad80e7-fd3f-475f-a152-e256cbcf673e admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:05.338965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad80e7-fd3f-475f-a152-e256cbcf673e admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:05.349204 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aa9eb-4b5c-4358-b017-4b366123d95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:05.349875 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aa9eb-4b5c-4358-b017-4b366123d95c admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:05.350158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aa9eb-4b5c-4358-b017-4b366123d95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:05.350938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aa9eb-4b5c-4358-b017-4b366123d95c admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:05.351205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8aa9eb-4b5c-4358-b017-4b366123d95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:05.352806 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8aa9eb-4b5c-4358-b017-4b366123d95c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:05.363825 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1320/2635] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:22:05.367747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ab53d-d1bb-48d7-a979-0c574c8a75a9 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:05.378775 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ab53d-d1bb-48d7-a979-0c574c8a75a9 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:05.383420 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67307573-897a-494f-96df-e6af9c7f4c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:05.384014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67307573-897a-494f-96df-e6af9c7f4c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:05.384299 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67307573-897a-494f-96df-e6af9c7f4c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:05.384682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67307573-897a-494f-96df-e6af9c7f4c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:05.385384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67307573-897a-494f-96df-e6af9c7f4c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:05.387927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67307573-897a-494f-96df-e6af9c7f4c11 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:05.398227 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1316/2636] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:22:05.402508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aa9eb-4b5c-4358-b017-4b366123d95c admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:05.412607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aa9eb-4b5c-4358-b017-4b366123d95c admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:05.417200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2bbef-dbf9-485e-87d5-260712d9302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:05.418156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2bbef-dbf9-485e-87d5-260712d9302d admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:05.418444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2bbef-dbf9-485e-87d5-260712d9302d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:05.418785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2bbef-dbf9-485e-87d5-260712d9302d admin admin] PATH_INFO: `/v3/projects/2f9a4b16aa094e1e8e789351ee4eeb89/users/25c7f875e9fd4f83a1ddc857c4b52156/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:05.433946 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2bbef-dbf9-485e-87d5-260712d9302d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9a4b16aa094e1e8e789351ee4eeb89, user_id=25c7f875e9fd4f83a1ddc857c4b52156, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:05.436643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2bbef-dbf9-485e-87d5-260712d9302d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:05.449798 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1321/2637] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:22:05 2022] PUT /identity/v3/projects/2f9a4b16aa094e1e8e789351ee4eeb89/users/25c7f875e9fd4f83a1ddc857c4b52156/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:05.460706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190067b-fd67-4439-b230-92a4f77efbbb None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:05.460993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190067b-fd67-4439-b230-92a4f77efbbb None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:05.461265 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190067b-fd67-4439-b230-92a4f77efbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:05.487351 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-a190067b-fd67-4439-b230-92a4f77efbbb None None] MFA Rules not processed for user `25c7f875e9fd4f83a1ddc857c4b52156`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:05.488538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a190067b-fd67-4439-b230-92a4f77efbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:05.493475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:05.557371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1317/2638] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:05.569677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2bbef-dbf9-485e-87d5-260712d9302d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:05.571728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-55b2bbef-dbf9-485e-87d5-260712d9302d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:05.630755 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2bbef-dbf9-485e-87d5-260712d9302d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:05.634593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cdf5a-bd74-4e3e-b686-54abb78e3152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:05.635209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cdf5a-bd74-4e3e-b686-54abb78e3152 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:05.635496 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cdf5a-bd74-4e3e-b686-54abb78e3152 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:05.635777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cdf5a-bd74-4e3e-b686-54abb78e3152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:05.645057 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cdf5a-bd74-4e3e-b686-54abb78e3152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:05.646489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cdf5a-bd74-4e3e-b686-54abb78e3152 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:05.655573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1322/2639] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:22:07.020063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190067b-fd67-4439-b230-92a4f77efbbb None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:07.021716 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a190067b-fd67-4439-b230-92a4f77efbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:07.081250 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190067b-fd67-4439-b230-92a4f77efbbb None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:07.084945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30217bb3-667d-4521-ac50-7c881192c764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:07.085585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30217bb3-667d-4521-ac50-7c881192c764 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:07.085870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30217bb3-667d-4521-ac50-7c881192c764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:07.086174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30217bb3-667d-4521-ac50-7c881192c764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:07.088307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-30217bb3-667d-4521-ac50-7c881192c764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:07.156591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30217bb3-667d-4521-ac50-7c881192c764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:07.158031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30217bb3-667d-4521-ac50-7c881192c764 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:07.170410 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1318/2640] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:08.695173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cdf5a-bd74-4e3e-b686-54abb78e3152 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:08.709932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cdf5a-bd74-4e3e-b686-54abb78e3152 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:08.719433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:08.720415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:08.720885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:08.721200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] PATH_INFO: `/v3/users/25c7f875e9fd4f83a1ddc857c4b52156` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:08.722734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c7f875e9fd4f83a1ddc857c4b52156)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:08.724655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:08.788742 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c7f875e9fd4f83a1ddc857c4b52156'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:08.799302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c7f875e9fd4f83a1ddc857c4b52156'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:08.800138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c7f875e9fd4f83a1ddc857c4b52156'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:08.800933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c7f875e9fd4f83a1ddc857c4b52156'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:08.817767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c7f875e9fd4f83a1ddc857c4b52156'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:08.834657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1323/2641] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:22:08 2022] DELETE /identity/v3/users/25c7f875e9fd4f83a1ddc857c4b52156 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:08.838206 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015c7f2-a285-4721-be32-f4420890ef66 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:08.838766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015c7f2-a285-4721-be32-f4420890ef66 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:08.838933 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015c7f2-a285-4721-be32-f4420890ef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:08.862302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3015c7f2-a285-4721-be32-f4420890ef66 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:08.863572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3015c7f2-a285-4721-be32-f4420890ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:08.929222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:08.940653 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1319/2642] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:08.951354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:08.952811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:08.987764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:09.038933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc35a16-565a-4b8b-8bde-a3535a24dccd admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:09.041659 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f31d87-059e-4c5c-b993-471792b84da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:09.043419 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f31d87-059e-4c5c-b993-471792b84da3 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:09.043710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f31d87-059e-4c5c-b993-471792b84da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:09.043989 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f31d87-059e-4c5c-b993-471792b84da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:09.055226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f31d87-059e-4c5c-b993-471792b84da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:09.056713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f31d87-059e-4c5c-b993-471792b84da3 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:09.068257 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1324/2643] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:09.566147 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015c7f2-a285-4721-be32-f4420890ef66 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:09.567874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3015c7f2-a285-4721-be32-f4420890ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:09.586668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015c7f2-a285-4721-be32-f4420890ef66 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:09.592562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fa783-63b3-4ccd-a311-744572160b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:09.593384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fa783-63b3-4ccd-a311-744572160b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:09.593667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fa783-63b3-4ccd-a311-744572160b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:09.593949 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fa783-63b3-4ccd-a311-744572160b20 admin admin] PATH_INFO: `/v3/projects/2f9a4b16aa094e1e8e789351ee4eeb89` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:09.595240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fa783-63b3-4ccd-a311-744572160b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9a4b16aa094e1e8e789351ee4eeb89)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:09.597547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fa783-63b3-4ccd-a311-744572160b20 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:09.646640 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-063fa783-63b3-4ccd-a311-744572160b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9a4b16aa094e1e8e789351ee4eeb89', 'request_id': 'req-063fa783-63b3-4ccd-a311-744572160b20'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:09.653479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-063fa783-63b3-4ccd-a311-744572160b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9a4b16aa094e1e8e789351ee4eeb89', 'request_id': 'req-063fa783-63b3-4ccd-a311-744572160b20'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:09.659466 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-063fa783-63b3-4ccd-a311-744572160b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9a4b16aa094e1e8e789351ee4eeb89', 'request_id': 'req-063fa783-63b3-4ccd-a311-744572160b20'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:09.672692 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-063fa783-63b3-4ccd-a311-744572160b20 admin admin] The token cache is being invalidate because project 2f9a4b16aa094e1e8e789351ee4eeb89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:22:09.672984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-063fa783-63b3-4ccd-a311-744572160b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:09.673613 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-063fa783-63b3-4ccd-a311-744572160b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:09.675197 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1320/2644] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:22:09 2022] DELETE /identity/v3/projects/2f9a4b16aa094e1e8e789351ee4eeb89 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:09.680092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225941f5-5a5f-41bc-b812-2ce2bdd5f4f5 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:09.680386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225941f5-5a5f-41bc-b812-2ce2bdd5f4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:09.680667 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225941f5-5a5f-41bc-b812-2ce2bdd5f4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:09.697984 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-225941f5-5a5f-41bc-b812-2ce2bdd5f4f5 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:09.699746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-225941f5-5a5f-41bc-b812-2ce2bdd5f4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:09.771995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1325/2645] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:09.773814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41a047-7466-449c-9054-2ce0108ba93f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:09.774097 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41a047-7466-449c-9054-2ce0108ba93f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:09.774374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41a047-7466-449c-9054-2ce0108ba93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:09.793492 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-2e41a047-7466-449c-9054-2ce0108ba93f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:09.794637 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2e41a047-7466-449c-9054-2ce0108ba93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:09.803935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1321/2646] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:09.808241 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225941f5-5a5f-41bc-b812-2ce2bdd5f4f5 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:09.818120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225941f5-5a5f-41bc-b812-2ce2bdd5f4f5 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:09.823274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5044e32-45ea-4e9b-b4dc-79e465358c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:09.824438 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5044e32-45ea-4e9b-b4dc-79e465358c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:09.824722 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5044e32-45ea-4e9b-b4dc-79e465358c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:09.825043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5044e32-45ea-4e9b-b4dc-79e465358c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:09.825846 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5044e32-45ea-4e9b-b4dc-79e465358c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:22:09.826158 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5044e32-45ea-4e9b-b4dc-79e465358c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:09.827803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5044e32-45ea-4e9b-b4dc-79e465358c57 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:09.853776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1326/2647] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:22:09.854359 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41a047-7466-449c-9054-2ce0108ba93f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:09.867195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41a047-7466-449c-9054-2ce0108ba93f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:09.874675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa9b10-9270-4752-b4e6-74a733a0eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:09.875457 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa9b10-9270-4752-b4e6-74a733a0eeae admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:09.875740 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa9b10-9270-4752-b4e6-74a733a0eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:09.876013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa9b10-9270-4752-b4e6-74a733a0eeae admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:09.876747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa9b10-9270-4752-b4e6-74a733a0eeae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:09.880034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa9b10-9270-4752-b4e6-74a733a0eeae admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:09.914888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1322/2648] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:22:09 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:22:09.919465 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5044e32-45ea-4e9b-b4dc-79e465358c57 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:09.930788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5044e32-45ea-4e9b-b4dc-79e465358c57 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:10.015338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e3002-39d6-4cc3-9fe8-f495c99b8492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:10.016669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e3002-39d6-4cc3-9fe8-f495c99b8492 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:10.017234 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e3002-39d6-4cc3-9fe8-f495c99b8492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:10.017618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e3002-39d6-4cc3-9fe8-f495c99b8492 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:10.018406 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e3002-39d6-4cc3-9fe8-f495c99b8492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:10.027561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e3002-39d6-4cc3-9fe8-f495c99b8492 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:10.062189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1327/2649] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:22:09 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:22:10.063953 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa9b10-9270-4752-b4e6-74a733a0eeae admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:10.080488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa9b10-9270-4752-b4e6-74a733a0eeae admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:10.088604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b331ff5-b3a9-425f-944b-1e4d6e444f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:10.090714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b331ff5-b3a9-425f-944b-1e4d6e444f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:10.091116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b331ff5-b3a9-425f-944b-1e4d6e444f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:10.091554 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b331ff5-b3a9-425f-944b-1e4d6e444f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:10.093131 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b331ff5-b3a9-425f-944b-1e4d6e444f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:10.096012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b331ff5-b3a9-425f-944b-1e4d6e444f0a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:10.116718 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1323/2650] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:22:10.120964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e3002-39d6-4cc3-9fe8-f495c99b8492 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:10.142042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e3002-39d6-4cc3-9fe8-f495c99b8492 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:10.147632 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883850a9-6a9a-416e-8694-3f8a35db35cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:10.148747 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883850a9-6a9a-416e-8694-3f8a35db35cb admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:10.149295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883850a9-6a9a-416e-8694-3f8a35db35cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:10.149914 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883850a9-6a9a-416e-8694-3f8a35db35cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:10.150906 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883850a9-6a9a-416e-8694-3f8a35db35cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:10.154226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883850a9-6a9a-416e-8694-3f8a35db35cb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:10.200367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1328/2651] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:22:10.202050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b331ff5-b3a9-425f-944b-1e4d6e444f0a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:10.216060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b331ff5-b3a9-425f-944b-1e4d6e444f0a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:10.221991 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8e2cf-32ea-4943-a283-c0124af1addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:10.223311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8e2cf-32ea-4943-a283-c0124af1addd admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:10.223747 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8e2cf-32ea-4943-a283-c0124af1addd admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:10.224583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8e2cf-32ea-4943-a283-c0124af1addd admin admin] PATH_INFO: `/v3/projects/a5320fae41d64c7bb0f772e3643993d9/users/80d5c3ffbdf24f9cb78f5cbe782e2aa6/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:10.247228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8e2cf-32ea-4943-a283-c0124af1addd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5320fae41d64c7bb0f772e3643993d9, user_id=80d5c3ffbdf24f9cb78f5cbe782e2aa6, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:10.250658 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8e2cf-32ea-4943-a283-c0124af1addd admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:10.276890 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1324/2652] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:22:10 2022] PUT /identity/v3/projects/a5320fae41d64c7bb0f772e3643993d9/users/80d5c3ffbdf24f9cb78f5cbe782e2aa6/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:22:10.349377 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa028b5-43c6-4eee-a46a-78503046d26f None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:10.349666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa028b5-43c6-4eee-a46a-78503046d26f None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:10.349973 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa028b5-43c6-4eee-a46a-78503046d26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:10.391657 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-9fa028b5-43c6-4eee-a46a-78503046d26f None None] MFA Rules not processed for user `80d5c3ffbdf24f9cb78f5cbe782e2aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:10.393076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9fa028b5-43c6-4eee-a46a-78503046d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:10.423779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:10.477928 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1329/2653] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:10.490494 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8e2cf-32ea-4943-a283-c0124af1addd admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:10.492577 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-eae8e2cf-32ea-4943-a283-c0124af1addd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:10.539513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa028b5-43c6-4eee-a46a-78503046d26f None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:10.541023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9fa028b5-43c6-4eee-a46a-78503046d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:10.572915 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8e2cf-32ea-4943-a283-c0124af1addd admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:10.578287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc944c-4a0e-4d8b-a145-9599f80b4c45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:10.579091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc944c-4a0e-4d8b-a145-9599f80b4c45 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:10.579374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc944c-4a0e-4d8b-a145-9599f80b4c45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:10.579656 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc944c-4a0e-4d8b-a145-9599f80b4c45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:10.588731 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc944c-4a0e-4d8b-a145-9599f80b4c45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:10.591553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc944c-4a0e-4d8b-a145-9599f80b4c45 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:10.601936 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1325/2654] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:10.615371 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa028b5-43c6-4eee-a46a-78503046d26f None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:10.620102 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a238d8-5ed4-41b3-98c3-790d84dba66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:10.622098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a238d8-5ed4-41b3-98c3-790d84dba66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:10.622378 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a238d8-5ed4-41b3-98c3-790d84dba66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:10.622685 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a238d8-5ed4-41b3-98c3-790d84dba66d admin admin] PATH_INFO: `/v3/users/62c0039007d641c0aedaa781acaa0abe` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:10.623907 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a238d8-5ed4-41b3-98c3-790d84dba66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62c0039007d641c0aedaa781acaa0abe)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:10.625857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a238d8-5ed4-41b3-98c3-790d84dba66d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:10.682885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7a238d8-5ed4-41b3-98c3-790d84dba66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62c0039007d641c0aedaa781acaa0abe'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:10.690733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7a238d8-5ed4-41b3-98c3-790d84dba66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62c0039007d641c0aedaa781acaa0abe'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:10.691540 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7a238d8-5ed4-41b3-98c3-790d84dba66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62c0039007d641c0aedaa781acaa0abe'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:10.692190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7a238d8-5ed4-41b3-98c3-790d84dba66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62c0039007d641c0aedaa781acaa0abe'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:10.705200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7a238d8-5ed4-41b3-98c3-790d84dba66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62c0039007d641c0aedaa781acaa0abe'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:10.718252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1330/2655] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:22:10 2022] DELETE /identity/v3/users/62c0039007d641c0aedaa781acaa0abe => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:22:10.912384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc944c-4a0e-4d8b-a145-9599f80b4c45 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:10.927655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc944c-4a0e-4d8b-a145-9599f80b4c45 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:10.951778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:10.993321 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:10.994153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:10.994436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:10.994738 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b admin admin] PATH_INFO: `/v3/projects/9c4b18684de44714b4a54442a17720b7` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:10.996068 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4b18684de44714b4a54442a17720b7)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:10.997961 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:11.044172 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4b18684de44714b4a54442a17720b7', 'request_id': 'req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:11.050171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4b18684de44714b4a54442a17720b7', 'request_id': 'req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:11.055685 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4b18684de44714b4a54442a17720b7', 'request_id': 'req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:11.067748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b admin admin] The token cache is being invalidate because project 9c4b18684de44714b4a54442a17720b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:22:11.068045 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:11.068683 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-bbdbf676-f945-4c8a-b11b-9fbbf6b8360b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:11.070229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1326/2656] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:22:10 2022] DELETE /identity/v3/projects/9c4b18684de44714b4a54442a17720b7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:11.075874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bef22-9e16-477d-87e7-fedb749f9380 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:11.076166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bef22-9e16-477d-87e7-fedb749f9380 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:11.076447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bef22-9e16-477d-87e7-fedb749f9380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:11.095181 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-c63bef22-9e16-477d-87e7-fedb749f9380 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:11.096381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-c63bef22-9e16-477d-87e7-fedb749f9380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:11.139057 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:11.162379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1331/2657] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:22:11.170737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389865c1-95a2-40b7-8208-11a06aa6f61a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:11.171034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389865c1-95a2-40b7-8208-11a06aa6f61a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:11.171307 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389865c1-95a2-40b7-8208-11a06aa6f61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:11.189635 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-389865c1-95a2-40b7-8208-11a06aa6f61a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:11.190897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-389865c1-95a2-40b7-8208-11a06aa6f61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:11.199230 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1327/2658] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:11.203380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bef22-9e16-477d-87e7-fedb749f9380 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:11.212820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bef22-9e16-477d-87e7-fedb749f9380 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:11.218244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af3d33-d528-4b0f-9a58-f2cfbd59e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:11.218914 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af3d33-d528-4b0f-9a58-f2cfbd59e153 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:11.219196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af3d33-d528-4b0f-9a58-f2cfbd59e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:11.219470 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af3d33-d528-4b0f-9a58-f2cfbd59e153 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:11.220184 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af3d33-d528-4b0f-9a58-f2cfbd59e153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:22:11.220487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af3d33-d528-4b0f-9a58-f2cfbd59e153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:11.222098 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af3d33-d528-4b0f-9a58-f2cfbd59e153 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:11.233592 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1332/2659] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:22:11.237683 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389865c1-95a2-40b7-8208-11a06aa6f61a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:11.247103 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389865c1-95a2-40b7-8208-11a06aa6f61a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:11.251804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5b2bc-371b-4920-9a5e-09ccdc12b231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:11.252443 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5b2bc-371b-4920-9a5e-09ccdc12b231 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:11.252980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5b2bc-371b-4920-9a5e-09ccdc12b231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:11.253255 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5b2bc-371b-4920-9a5e-09ccdc12b231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:11.253933 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5b2bc-371b-4920-9a5e-09ccdc12b231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:11.255858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5b2bc-371b-4920-9a5e-09ccdc12b231 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:11.281539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1328/2660] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:22:11 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:22:11.285619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af3d33-d528-4b0f-9a58-f2cfbd59e153 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:11.295719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af3d33-d528-4b0f-9a58-f2cfbd59e153 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:11.350427 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881980b-8fbd-43cc-acb9-346da794f52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:11.351109 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881980b-8fbd-43cc-acb9-346da794f52c admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:11.351390 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881980b-8fbd-43cc-acb9-346da794f52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:11.351666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881980b-8fbd-43cc-acb9-346da794f52c admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:11.352358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881980b-8fbd-43cc-acb9-346da794f52c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:11.354292 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881980b-8fbd-43cc-acb9-346da794f52c admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:11.377195 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1333/2661] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:22:11 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:22:11.381587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5b2bc-371b-4920-9a5e-09ccdc12b231 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:11.394007 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5b2bc-371b-4920-9a5e-09ccdc12b231 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:11.398574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370715e1-03df-4460-a4be-936f72d5e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:11.399249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370715e1-03df-4460-a4be-936f72d5e0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:11.399530 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370715e1-03df-4460-a4be-936f72d5e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:11.399800 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370715e1-03df-4460-a4be-936f72d5e0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:11.400536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370715e1-03df-4460-a4be-936f72d5e0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:11.402354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370715e1-03df-4460-a4be-936f72d5e0d7 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:11.413130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1329/2662] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:22:11.417022 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881980b-8fbd-43cc-acb9-346da794f52c admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:11.427713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881980b-8fbd-43cc-acb9-346da794f52c admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:11.434723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd8d44-ad21-43a5-b28a-f54abd3bd80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:11.434723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd8d44-ad21-43a5-b28a-f54abd3bd80f admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:11.434723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd8d44-ad21-43a5-b28a-f54abd3bd80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:11.434723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd8d44-ad21-43a5-b28a-f54abd3bd80f admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:11.435143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd8d44-ad21-43a5-b28a-f54abd3bd80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:11.436475 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd8d44-ad21-43a5-b28a-f54abd3bd80f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:11.449925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1334/2663] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:22:11.453878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370715e1-03df-4460-a4be-936f72d5e0d7 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:11.464031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370715e1-03df-4460-a4be-936f72d5e0d7 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:11.469017 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a72bb3-6033-4e4d-859c-ad5f7690cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:11.469888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a72bb3-6033-4e4d-859c-ad5f7690cf5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:11.470165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a72bb3-6033-4e4d-859c-ad5f7690cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:11.470436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a72bb3-6033-4e4d-859c-ad5f7690cf5d admin admin] PATH_INFO: `/v3/projects/1b8d0602a7cb4af5b8da1bb7edb83fa6/users/b08a3dd720cf45ffaca3a013dff8db4f/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:11.485610 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a72bb3-6033-4e4d-859c-ad5f7690cf5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8d0602a7cb4af5b8da1bb7edb83fa6, user_id=b08a3dd720cf45ffaca3a013dff8db4f, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:11.488264 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a72bb3-6033-4e4d-859c-ad5f7690cf5d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:11.502105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1330/2664] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:22:11 2022] PUT /identity/v3/projects/1b8d0602a7cb4af5b8da1bb7edb83fa6/users/b08a3dd720cf45ffaca3a013dff8db4f/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:11.513634 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f9d5-792c-46dd-bd2a-c176ae7b3246 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:11.513922 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f9d5-792c-46dd-bd2a-c176ae7b3246 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:11.514198 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f9d5-792c-46dd-bd2a-c176ae7b3246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:11.540830 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-a9a5f9d5-792c-46dd-bd2a-c176ae7b3246 None None] MFA Rules not processed for user `b08a3dd720cf45ffaca3a013dff8db4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:11.542516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-a9a5f9d5-792c-46dd-bd2a-c176ae7b3246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:11.609435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1335/2665] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:11.620113 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a72bb3-6033-4e4d-859c-ad5f7690cf5d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:11.622654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e0a72bb3-6033-4e4d-859c-ad5f7690cf5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:11.673529 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:11.700865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a72bb3-6033-4e4d-859c-ad5f7690cf5d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:11.706417 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a337e-880a-460b-b29e-7e69c40c4833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:11.707083 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a337e-880a-460b-b29e-7e69c40c4833 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:11.707363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a337e-880a-460b-b29e-7e69c40c4833 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:11.707636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a337e-880a-460b-b29e-7e69c40c4833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:11.715263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a337e-880a-460b-b29e-7e69c40c4833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:11.716832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a337e-880a-460b-b29e-7e69c40c4833 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:11.725840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1331/2666] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:13.180809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f9d5-792c-46dd-bd2a-c176ae7b3246 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:13.182270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-a9a5f9d5-792c-46dd-bd2a-c176ae7b3246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:13.226612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:13.250999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f9d5-792c-46dd-bd2a-c176ae7b3246 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:13.256286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:13.257274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:13.257579 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:13.257850 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] PATH_INFO: `/v3/users/80d5c3ffbdf24f9cb78f5cbe782e2aa6` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:13.259173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d5c3ffbdf24f9cb78f5cbe782e2aa6)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:13.261154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:13.310379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d5c3ffbdf24f9cb78f5cbe782e2aa6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:13.319286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d5c3ffbdf24f9cb78f5cbe782e2aa6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:13.320138 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d5c3ffbdf24f9cb78f5cbe782e2aa6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:13.320979 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d5c3ffbdf24f9cb78f5cbe782e2aa6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:13.334999 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d5c3ffbdf24f9cb78f5cbe782e2aa6'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:13.350125 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1336/2667] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:22:13 2022] DELETE /identity/v3/users/80d5c3ffbdf24f9cb78f5cbe782e2aa6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:13.354795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ec3e-6bcd-46d8-9e4b-5e73f46a444f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:13.355557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ec3e-6bcd-46d8-9e4b-5e73f46a444f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:13.355557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ec3e-6bcd-46d8-9e4b-5e73f46a444f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:13.379541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6a72ec3e-6bcd-46d8-9e4b-5e73f46a444f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:13.381583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6a72ec3e-6bcd-46d8-9e4b-5e73f46a444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:13.448547 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1332/2668] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:13.458769 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:13.460199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:13.519691 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614c24f-f167-40a9-a385-095db947dd6e admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:13.523289 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a2669-b274-4dd8-a072-7d8edf256d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:13.523925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a2669-b274-4dd8-a072-7d8edf256d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:13.524223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a2669-b274-4dd8-a072-7d8edf256d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:13.524495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a2669-b274-4dd8-a072-7d8edf256d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:13.533788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a2669-b274-4dd8-a072-7d8edf256d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:13.535236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a2669-b274-4dd8-a072-7d8edf256d9c service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:13.544532 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1337/2669] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:13.876065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72ec3e-6bcd-46d8-9e4b-5e73f46a444f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:13.878133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6a72ec3e-6bcd-46d8-9e4b-5e73f46a444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:13.890583 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72ec3e-6bcd-46d8-9e4b-5e73f46a444f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:13.895330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:13.896241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:13.896648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:13.896867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] PATH_INFO: `/v3/projects/a5320fae41d64c7bb0f772e3643993d9` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:13.898717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5320fae41d64c7bb0f772e3643993d9)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:13.900733 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:13.957708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5320fae41d64c7bb0f772e3643993d9', 'request_id': 'req-c19a8885-4f68-418a-a8c4-5b57ad6513da'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:13.964015 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5320fae41d64c7bb0f772e3643993d9', 'request_id': 'req-c19a8885-4f68-418a-a8c4-5b57ad6513da'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:13.970250 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5320fae41d64c7bb0f772e3643993d9', 'request_id': 'req-c19a8885-4f68-418a-a8c4-5b57ad6513da'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:13.982848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] The token cache is being invalidate because project a5320fae41d64c7bb0f772e3643993d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:22:13.983606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:13.984236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:13.985774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1333/2670] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:22:13 2022] DELETE /identity/v3/projects/a5320fae41d64c7bb0f772e3643993d9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:18.628112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21728ace-579f-4fca-80e1-fd3926da3552 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:18.629267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21728ace-579f-4fca-80e1-fd3926da3552 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:18.629267 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21728ace-579f-4fca-80e1-fd3926da3552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:18.646304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-21728ace-579f-4fca-80e1-fd3926da3552 None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:18.647519 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-21728ace-579f-4fca-80e1-fd3926da3552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:18.702238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1338/2671] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:22:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:18.748930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:18.750407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:18.808589 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:18.826916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a8885-4f68-418a-a8c4-5b57ad6513da admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:18.831885 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bff1e-0229-464a-9243-77c909d379f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:18.832520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bff1e-0229-464a-9243-77c909d379f3 service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:18.832799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bff1e-0229-464a-9243-77c909d379f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:18.833073 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bff1e-0229-464a-9243-77c909d379f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:18.841050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bff1e-0229-464a-9243-77c909d379f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:18.842675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bff1e-0229-464a-9243-77c909d379f3 service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:18.851414 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1334/2672] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:22:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:22:19.041741 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21728ace-579f-4fca-80e1-fd3926da3552 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:19.042385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-21728ace-579f-4fca-80e1-fd3926da3552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:19.054004 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:19.131761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21728ace-579f-4fca-80e1-fd3926da3552 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:19.137701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:19.137889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:19.138061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:19.138309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] PATH_INFO: `/v3/users/b08a3dd720cf45ffaca3a013dff8db4f` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:19.139715 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08a3dd720cf45ffaca3a013dff8db4f)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:19.141655 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:19.215008 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08a3dd720cf45ffaca3a013dff8db4f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:19.226805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08a3dd720cf45ffaca3a013dff8db4f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:19.227645 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08a3dd720cf45ffaca3a013dff8db4f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:19.228811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08a3dd720cf45ffaca3a013dff8db4f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:19.245605 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08a3dd720cf45ffaca3a013dff8db4f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:19.270514 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1339/2673] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:22:19 2022] DELETE /identity/v3/users/b08a3dd720cf45ffaca3a013dff8db4f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:19.275662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d51c-0a4b-455e-9d2e-96a066199055 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:19.275662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d51c-0a4b-455e-9d2e-96a066199055 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:19.276040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d51c-0a4b-455e-9d2e-96a066199055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:19.298660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-fe57d51c-0a4b-455e-9d2e-96a066199055 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:19.298875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fe57d51c-0a4b-455e-9d2e-96a066199055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:19.417790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1335/2674] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:19.428465 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:19.430472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:19.524689 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae474c5-f974-4bab-98b2-3871f82fc56d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:19.530432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05418a80-7ff2-44c8-bbb8-bf1d0cf6e855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:19.531252 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05418a80-7ff2-44c8-bbb8-bf1d0cf6e855 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:19.531539 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05418a80-7ff2-44c8-bbb8-bf1d0cf6e855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:19.531807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05418a80-7ff2-44c8-bbb8-bf1d0cf6e855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:19.545744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05418a80-7ff2-44c8-bbb8-bf1d0cf6e855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:19.547937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05418a80-7ff2-44c8-bbb8-bf1d0cf6e855 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:19.571157 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1340/2675] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:20.115871 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d51c-0a4b-455e-9d2e-96a066199055 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:20.118008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fe57d51c-0a4b-455e-9d2e-96a066199055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:20.136582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d51c-0a4b-455e-9d2e-96a066199055 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:20.142925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:20.143938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:20.144280 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:20.144628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4 admin admin] PATH_INFO: `/v3/projects/1b8d0602a7cb4af5b8da1bb7edb83fa6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:20.145961 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8d0602a7cb4af5b8da1bb7edb83fa6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:20.148009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:20.227668 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8d0602a7cb4af5b8da1bb7edb83fa6', 'request_id': 'req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:20.235329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8d0602a7cb4af5b8da1bb7edb83fa6', 'request_id': 'req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:20.244796 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8d0602a7cb4af5b8da1bb7edb83fa6', 'request_id': 'req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:20.264201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4 admin admin] The token cache is being invalidate because project 1b8d0602a7cb4af5b8da1bb7edb83fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:22:20.264909 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:20.266028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-b6a8d18f-ab60-4760-a95c-c706d7d49fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:20.268054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1336/2676] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:22:20 2022] DELETE /identity/v3/projects/1b8d0602a7cb4af5b8da1bb7edb83fa6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:20.274074 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08feb56-6d15-4e7a-98ec-5609343aff73 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:20.274878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08feb56-6d15-4e7a-98ec-5609343aff73 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:20.274878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08feb56-6d15-4e7a-98ec-5609343aff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:20.304818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-b08feb56-6d15-4e7a-98ec-5609343aff73 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:20.307072 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b08feb56-6d15-4e7a-98ec-5609343aff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:20.360691 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:20.437908 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1341/2677] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:20.447427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f91e4-c100-4f81-883c-fbf39a209845 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:20.447919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f91e4-c100-4f81-883c-fbf39a209845 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:20.448259 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f91e4-c100-4f81-883c-fbf39a209845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:20.468223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-eb8f91e4-c100-4f81-883c-fbf39a209845 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:20.469178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-eb8f91e4-c100-4f81-883c-fbf39a209845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:20.477449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1337/2678] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:20.482404 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08feb56-6d15-4e7a-98ec-5609343aff73 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:20.495583 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08feb56-6d15-4e7a-98ec-5609343aff73 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:20.501495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d646a-a3b7-4b57-9bde-ac6daa05f25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:20.502890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d646a-a3b7-4b57-9bde-ac6daa05f25f admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:20.503347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d646a-a3b7-4b57-9bde-ac6daa05f25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:20.503701 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d646a-a3b7-4b57-9bde-ac6daa05f25f admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:20.504524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d646a-a3b7-4b57-9bde-ac6daa05f25f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:22:20.504883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d646a-a3b7-4b57-9bde-ac6daa05f25f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:20.506851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d646a-a3b7-4b57-9bde-ac6daa05f25f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:20.520732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1342/2679] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:22:20.525346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f91e4-c100-4f81-883c-fbf39a209845 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:20.535917 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f91e4-c100-4f81-883c-fbf39a209845 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:20.547923 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef7ad0-3c50-410a-b3ea-2b34b4905a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:20.548602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef7ad0-3c50-410a-b3ea-2b34b4905a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:20.548882 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef7ad0-3c50-410a-b3ea-2b34b4905a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:20.549156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef7ad0-3c50-410a-b3ea-2b34b4905a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:20.549849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef7ad0-3c50-410a-b3ea-2b34b4905a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:20.552053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef7ad0-3c50-410a-b3ea-2b34b4905a96 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:20.601883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1338/2680] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:22:20 2022] POST /identity/v3/projects => generated 381 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:22:20.606302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d646a-a3b7-4b57-9bde-ac6daa05f25f admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:20.618874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d646a-a3b7-4b57-9bde-ac6daa05f25f admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:20.710860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896e00-ca11-4347-a21f-9fe6fb552a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:20.711697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896e00-ca11-4347-a21f-9fe6fb552a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:20.712051 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896e00-ca11-4347-a21f-9fe6fb552a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:20.712396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896e00-ca11-4347-a21f-9fe6fb552a4e admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:20.713205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67896e00-ca11-4347-a21f-9fe6fb552a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:20.715251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67896e00-ca11-4347-a21f-9fe6fb552a4e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:20.738525 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1343/2681] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:22:20 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:22:20.742734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef7ad0-3c50-410a-b3ea-2b34b4905a96 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:20.756383 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef7ad0-3c50-410a-b3ea-2b34b4905a96 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:20.764051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938db0cf-d4e5-4f96-940e-6ae392c4cf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:20.765110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938db0cf-d4e5-4f96-940e-6ae392c4cf4c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:20.765654 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938db0cf-d4e5-4f96-940e-6ae392c4cf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:20.766167 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938db0cf-d4e5-4f96-940e-6ae392c4cf4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:20.767628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938db0cf-d4e5-4f96-940e-6ae392c4cf4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:20.770677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938db0cf-d4e5-4f96-940e-6ae392c4cf4c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:20.789604 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1339/2682] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:22:20.793223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896e00-ca11-4347-a21f-9fe6fb552a4e admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:20.807817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896e00-ca11-4347-a21f-9fe6fb552a4e admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:20.813178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f607b75-b1e5-4e44-a939-505025faa74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:20.813846 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f607b75-b1e5-4e44-a939-505025faa74f admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:20.814131 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f607b75-b1e5-4e44-a939-505025faa74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:20.814410 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f607b75-b1e5-4e44-a939-505025faa74f admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:20.815176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f607b75-b1e5-4e44-a939-505025faa74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:20.816789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f607b75-b1e5-4e44-a939-505025faa74f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:20.831317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1344/2683] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:22:20.835527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938db0cf-d4e5-4f96-940e-6ae392c4cf4c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:20.852302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938db0cf-d4e5-4f96-940e-6ae392c4cf4c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:20.858104 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f929b-ca71-4393-8ac7-4bfe80741e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:20.859153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f929b-ca71-4393-8ac7-4bfe80741e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:20.859644 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f929b-ca71-4393-8ac7-4bfe80741e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:20.860027 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f929b-ca71-4393-8ac7-4bfe80741e39 admin admin] PATH_INFO: `/v3/projects/88ae580516ff41a8830801a5bbf85654/users/d76de28608494b958fe25842735282b1/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:20.877994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f929b-ca71-4393-8ac7-4bfe80741e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ae580516ff41a8830801a5bbf85654, user_id=d76de28608494b958fe25842735282b1, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:20.880816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f929b-ca71-4393-8ac7-4bfe80741e39 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:20.907757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1340/2684] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:22:20 2022] PUT /identity/v3/projects/88ae580516ff41a8830801a5bbf85654/users/d76de28608494b958fe25842735282b1/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:22:20.917964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e743e-f19f-4aa5-a215-55dbb7593aeb None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:20.918264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e743e-f19f-4aa5-a215-55dbb7593aeb None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:20.918552 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e743e-f19f-4aa5-a215-55dbb7593aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:20.962245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-078e743e-f19f-4aa5-a215-55dbb7593aeb None None] MFA Rules not processed for user `d76de28608494b958fe25842735282b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:20.963724 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-078e743e-f19f-4aa5-a215-55dbb7593aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:21.070672 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1345/2685] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:21.074051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f929b-ca71-4393-8ac7-4bfe80741e39 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:21.081342 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:21.154804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f929b-ca71-4393-8ac7-4bfe80741e39 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:21.165729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4341d7-a573-4dc8-8830-591d2f923ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:21.166470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4341d7-a573-4dc8-8830-591d2f923ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:21.166712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4341d7-a573-4dc8-8830-591d2f923ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:21.166992 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4341d7-a573-4dc8-8830-591d2f923ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:21.167695 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4341d7-a573-4dc8-8830-591d2f923ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:21.174853 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4341d7-a573-4dc8-8830-591d2f923ff5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:21.213093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1341/2686] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:22:21 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:22:21.216876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e743e-f19f-4aa5-a215-55dbb7593aeb None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:21.234446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e743e-f19f-4aa5-a215-55dbb7593aeb None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:21.274753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:21.324486 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d95e-4613-420a-9188-5c8f6a073389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:21.330730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d95e-4613-420a-9188-5c8f6a073389 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:21.330730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d95e-4613-420a-9188-5c8f6a073389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:21.330730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d95e-4613-420a-9188-5c8f6a073389 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:21.330730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8d95e-4613-420a-9188-5c8f6a073389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:21.330730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8d95e-4613-420a-9188-5c8f6a073389 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:21.356069 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1346/2687] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:22:21 2022] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:22:21.360434 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4341d7-a573-4dc8-8830-591d2f923ff5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:21.373000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4341d7-a573-4dc8-8830-591d2f923ff5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:21.378674 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1132fb1-2054-431d-8c4f-d9e477d6f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:21.379724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1132fb1-2054-431d-8c4f-d9e477d6f737 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:21.380016 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1132fb1-2054-431d-8c4f-d9e477d6f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:21.380357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1132fb1-2054-431d-8c4f-d9e477d6f737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:21.381319 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1132fb1-2054-431d-8c4f-d9e477d6f737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:21.383056 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1132fb1-2054-431d-8c4f-d9e477d6f737 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:21.411150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1342/2688] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:22:21.415685 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d95e-4613-420a-9188-5c8f6a073389 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:21.436093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d95e-4613-420a-9188-5c8f6a073389 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:21.440997 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca1b3-12d3-4692-93c6-9cc108447281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:21.441966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca1b3-12d3-4692-93c6-9cc108447281 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:21.442316 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca1b3-12d3-4692-93c6-9cc108447281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:21.442857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca1b3-12d3-4692-93c6-9cc108447281 admin admin] PATH_INFO: `/v3/projects/15768f7e3ee644d39e4eda06d4bc50e1/users/7df57463055c4a7a9b594296af83d1d3/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:21.470576 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca1b3-12d3-4692-93c6-9cc108447281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15768f7e3ee644d39e4eda06d4bc50e1, user_id=7df57463055c4a7a9b594296af83d1d3, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:21.475312 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ca1b3-12d3-4692-93c6-9cc108447281 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:21.496477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1347/2689] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:22:21 2022] PUT /identity/v3/projects/15768f7e3ee644d39e4eda06d4bc50e1/users/7df57463055c4a7a9b594296af83d1d3/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:21.500590 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1132fb1-2054-431d-8c4f-d9e477d6f737 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:21.516586 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1132fb1-2054-431d-8c4f-d9e477d6f737 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:21.586581 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded5076-b0a2-4931-8e11-786eda48dfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:21.587406 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded5076-b0a2-4931-8e11-786eda48dfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:21.587761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded5076-b0a2-4931-8e11-786eda48dfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:21.588140 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded5076-b0a2-4931-8e11-786eda48dfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:21.588938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded5076-b0a2-4931-8e11-786eda48dfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:21.590681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded5076-b0a2-4931-8e11-786eda48dfc3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:21.602144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1343/2690] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:22:21.606254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca1b3-12d3-4692-93c6-9cc108447281 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:21.621190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca1b3-12d3-4692-93c6-9cc108447281 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:21.627468 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37a91c-f0ee-4a34-93c9-363c684badaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:21.628764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37a91c-f0ee-4a34-93c9-363c684badaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:21.629156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37a91c-f0ee-4a34-93c9-363c684badaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:21.629521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37a91c-f0ee-4a34-93c9-363c684badaf admin admin] PATH_INFO: `/v3/projects/15768f7e3ee644d39e4eda06d4bc50e1/users/7df57463055c4a7a9b594296af83d1d3/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:21.632036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37a91c-f0ee-4a34-93c9-363c684badaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=15768f7e3ee644d39e4eda06d4bc50e1, user_id=7df57463055c4a7a9b594296af83d1d3, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:21.635023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37a91c-f0ee-4a34-93c9-363c684badaf admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:21.647351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1348/2691] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:22:21 2022] PUT /identity/v3/projects/15768f7e3ee644d39e4eda06d4bc50e1/users/7df57463055c4a7a9b594296af83d1d3/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:21.660121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca4fc0-c3b1-4e01-b253-86e1af8877ee None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:21.660548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca4fc0-c3b1-4e01-b253-86e1af8877ee None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:21.661047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca4fc0-c3b1-4e01-b253-86e1af8877ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:21.690533 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-58ca4fc0-c3b1-4e01-b253-86e1af8877ee None None] MFA Rules not processed for user `7df57463055c4a7a9b594296af83d1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:21.691907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-58ca4fc0-c3b1-4e01-b253-86e1af8877ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:21.777150 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:21.782804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1344/2692] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:21.794800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37a91c-f0ee-4a34-93c9-363c684badaf admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:21.798318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-4d37a91c-f0ee-4a34-93c9-363c684badaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:21.871969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37a91c-f0ee-4a34-93c9-363c684badaf admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:21.876354 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bca0ea-f59f-4e70-ae61-f21a0bd5f3d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:21.877021 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bca0ea-f59f-4e70-ae61-f21a0bd5f3d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:21.877301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bca0ea-f59f-4e70-ae61-f21a0bd5f3d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:21.877572 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bca0ea-f59f-4e70-ae61-f21a0bd5f3d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:21.888251 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bca0ea-f59f-4e70-ae61-f21a0bd5f3d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:21.890524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bca0ea-f59f-4e70-ae61-f21a0bd5f3d9 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:21.901515 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1349/2693] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:22.370473 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca4fc0-c3b1-4e01-b253-86e1af8877ee None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:22.450549 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca4fc0-c3b1-4e01-b253-86e1af8877ee None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:22.458858 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:22.459979 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:22.460461 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:22.460890 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] PATH_INFO: `/v3/users/d76de28608494b958fe25842735282b1` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:22.462355 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76de28608494b958fe25842735282b1)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:22.465439 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:22.531865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76de28608494b958fe25842735282b1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:22.540024 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76de28608494b958fe25842735282b1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:22.552609 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76de28608494b958fe25842735282b1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:22.553543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76de28608494b958fe25842735282b1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:22.554272 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76de28608494b958fe25842735282b1'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:22.594502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1345/2694] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:22:22 2022] DELETE /identity/v3/users/d76de28608494b958fe25842735282b1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:22.596264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec804e3d-c3b6-4c28-a42a-d52d663a1941 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:22.596873 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec804e3d-c3b6-4c28-a42a-d52d663a1941 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:22.596873 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec804e3d-c3b6-4c28-a42a-d52d663a1941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:22.618293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ec804e3d-c3b6-4c28-a42a-d52d663a1941 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:22.619841 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ec804e3d-c3b6-4c28-a42a-d52d663a1941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:22.693627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1350/2695] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:22.703295 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:22.704883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:22.785252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032d37c-7939-4e01-9865-c3209d47f5fb admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:22.789081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37ecd-1ae7-45f3-90da-07a2d7bebc1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:22.789725 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37ecd-1ae7-45f3-90da-07a2d7bebc1d service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:22.790008 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37ecd-1ae7-45f3-90da-07a2d7bebc1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:22.790285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37ecd-1ae7-45f3-90da-07a2d7bebc1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:22.804592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37ecd-1ae7-45f3-90da-07a2d7bebc1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:22.806253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37ecd-1ae7-45f3-90da-07a2d7bebc1d service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:22.831422 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1346/2696] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:22:23.127417 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec804e3d-c3b6-4c28-a42a-d52d663a1941 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:23.129129 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ec804e3d-c3b6-4c28-a42a-d52d663a1941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:23.162979 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec804e3d-c3b6-4c28-a42a-d52d663a1941 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:23.168596 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:23.169611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:23.169965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:23.170665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] PATH_INFO: `/v3/projects/88ae580516ff41a8830801a5bbf85654` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:23.171515 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ae580516ff41a8830801a5bbf85654)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:23.173429 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:23.192380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:23.236666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ae580516ff41a8830801a5bbf85654', 'request_id': 'req-1cf4b777-5f7a-4e30-b098-2cac289efcc8'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:23.246405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ae580516ff41a8830801a5bbf85654', 'request_id': 'req-1cf4b777-5f7a-4e30-b098-2cac289efcc8'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:23.254509 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ae580516ff41a8830801a5bbf85654', 'request_id': 'req-1cf4b777-5f7a-4e30-b098-2cac289efcc8'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:23.274524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] The token cache is being invalidate because project 88ae580516ff41a8830801a5bbf85654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:22:23.275100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:23.275888 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:23.278073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1351/2697] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:22:23 2022] DELETE /identity/v3/projects/88ae580516ff41a8830801a5bbf85654 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:22:23.285757 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37ecd-1ae7-45f3-90da-07a2d7bebc1d service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:23.296700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37ecd-1ae7-45f3-90da-07a2d7bebc1d service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:23.319190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:23.374337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e8a85-2412-4920-a188-025b9543abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:23.375292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e8a85-2412-4920-a188-025b9543abde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:23.375597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e8a85-2412-4920-a188-025b9543abde admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:23.375873 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e8a85-2412-4920-a188-025b9543abde admin admin] PATH_INFO: `/v3/users/7df57463055c4a7a9b594296af83d1d3` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:23.377412 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e8a85-2412-4920-a188-025b9543abde admin admin] RBAC: Authorizing `identity:delete_user(user_id=7df57463055c4a7a9b594296af83d1d3)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:23.379919 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e8a85-2412-4920-a188-025b9543abde admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:23.454790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8a5e8a85-2412-4920-a188-025b9543abde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7df57463055c4a7a9b594296af83d1d3'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:23.464996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8a5e8a85-2412-4920-a188-025b9543abde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7df57463055c4a7a9b594296af83d1d3'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:23.477130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8a5e8a85-2412-4920-a188-025b9543abde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7df57463055c4a7a9b594296af83d1d3'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:23.477843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8a5e8a85-2412-4920-a188-025b9543abde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7df57463055c4a7a9b594296af83d1d3'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:23.478451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-8a5e8a85-2412-4920-a188-025b9543abde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7df57463055c4a7a9b594296af83d1d3'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:23.503782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1347/2698] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:22:23 2022] DELETE /identity/v3/users/7df57463055c4a7a9b594296af83d1d3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:23.903068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:23.905684 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:23.923982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4b777-5f7a-4e30-b098-2cac289efcc8 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:24.008364 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b55365-8446-4b66-a183-c0a000120d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:24.009499 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b55365-8446-4b66-a183-c0a000120d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:24.009978 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b55365-8446-4b66-a183-c0a000120d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:24.010255 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b55365-8446-4b66-a183-c0a000120d40 admin admin] PATH_INFO: `/v3/projects/15768f7e3ee644d39e4eda06d4bc50e1` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:24.011538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b55365-8446-4b66-a183-c0a000120d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15768f7e3ee644d39e4eda06d4bc50e1)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:24.014832 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b55365-8446-4b66-a183-c0a000120d40 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:24.077060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-76b55365-8446-4b66-a183-c0a000120d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15768f7e3ee644d39e4eda06d4bc50e1', 'request_id': 'req-76b55365-8446-4b66-a183-c0a000120d40'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:24.086399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-76b55365-8446-4b66-a183-c0a000120d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15768f7e3ee644d39e4eda06d4bc50e1', 'request_id': 'req-76b55365-8446-4b66-a183-c0a000120d40'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:24.094422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-76b55365-8446-4b66-a183-c0a000120d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15768f7e3ee644d39e4eda06d4bc50e1', 'request_id': 'req-76b55365-8446-4b66-a183-c0a000120d40'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:24.106070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-76b55365-8446-4b66-a183-c0a000120d40 admin admin] The token cache is being invalidate because project 15768f7e3ee644d39e4eda06d4bc50e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:22:24.106367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-76b55365-8446-4b66-a183-c0a000120d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:24.107045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-76b55365-8446-4b66-a183-c0a000120d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:24.110490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1352/2699] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:22:23 2022] DELETE /identity/v3/projects/15768f7e3ee644d39e4eda06d4bc50e1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:24.114521 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8718-e820-4597-b9c4-bd1e3686d71b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:24.114970 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8718-e820-4597-b9c4-bd1e3686d71b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:24.115346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8718-e820-4597-b9c4-bd1e3686d71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:24.137115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-f2cb8718-e820-4597-b9c4-bd1e3686d71b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:24.139087 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-f2cb8718-e820-4597-b9c4-bd1e3686d71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:24.209476 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1348/2700] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:24.217898 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46388359-ca6e-44d0-9553-654ca99375cc None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:24.218255 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46388359-ca6e-44d0-9553-654ca99375cc None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:24.218601 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46388359-ca6e-44d0-9553-654ca99375cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:24.238885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-46388359-ca6e-44d0-9553-654ca99375cc None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:24.240290 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-46388359-ca6e-44d0-9553-654ca99375cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:24.253371 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb8718-e820-4597-b9c4-bd1e3686d71b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:24.258719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1353/2701] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:24.264185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb8718-e820-4597-b9c4-bd1e3686d71b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:24.269185 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba5848-2f0c-4927-92c2-af5efed1ccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:24.269859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba5848-2f0c-4927-92c2-af5efed1ccfd admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:24.270153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba5848-2f0c-4927-92c2-af5efed1ccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:24.270783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba5848-2f0c-4927-92c2-af5efed1ccfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:24.271312 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba5848-2f0c-4927-92c2-af5efed1ccfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:22:24.272020 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba5848-2f0c-4927-92c2-af5efed1ccfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:24.273407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba5848-2f0c-4927-92c2-af5efed1ccfd admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:24.291145 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1349/2702] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:22:24.293781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46388359-ca6e-44d0-9553-654ca99375cc None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:24.303602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46388359-ca6e-44d0-9553-654ca99375cc None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:24.308389 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725307c1-608c-4abf-bd71-67db70d385dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:24.309039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725307c1-608c-4abf-bd71-67db70d385dd admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:24.309323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725307c1-608c-4abf-bd71-67db70d385dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:24.309595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725307c1-608c-4abf-bd71-67db70d385dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:24.315019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725307c1-608c-4abf-bd71-67db70d385dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:24.318010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725307c1-608c-4abf-bd71-67db70d385dd admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:24.348423 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1354/2703] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:22:24 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:22:24.352723 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba5848-2f0c-4927-92c2-af5efed1ccfd admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:24.364769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba5848-2f0c-4927-92c2-af5efed1ccfd admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:24.400507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:24.437876 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84467d5e-4926-4347-adab-8687bfea1b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:24.438662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84467d5e-4926-4347-adab-8687bfea1b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:24.439004 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84467d5e-4926-4347-adab-8687bfea1b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:24.439291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84467d5e-4926-4347-adab-8687bfea1b6a admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:24.439988 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84467d5e-4926-4347-adab-8687bfea1b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:24.441943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84467d5e-4926-4347-adab-8687bfea1b6a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:24.467565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1350/2704] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:22:24 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:22:24.471383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725307c1-608c-4abf-bd71-67db70d385dd admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:24.479337 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:24.488636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725307c1-608c-4abf-bd71-67db70d385dd admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:24.495186 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75477c1d-7554-4bef-95ea-4cb99842f681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:24.495935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477c1d-7554-4bef-95ea-4cb99842f681 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:24.496398 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477c1d-7554-4bef-95ea-4cb99842f681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:24.496676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477c1d-7554-4bef-95ea-4cb99842f681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:24.497400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75477c1d-7554-4bef-95ea-4cb99842f681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:24.499839 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75477c1d-7554-4bef-95ea-4cb99842f681 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:24.516772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1355/2705] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:22:24.517865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84467d5e-4926-4347-adab-8687bfea1b6a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:24.530916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84467d5e-4926-4347-adab-8687bfea1b6a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:24.536903 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871be277-4bd4-405e-9fd7-1518eceba7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:24.537597 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871be277-4bd4-405e-9fd7-1518eceba7fe admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:24.537910 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871be277-4bd4-405e-9fd7-1518eceba7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:24.538202 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871be277-4bd4-405e-9fd7-1518eceba7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:24.539242 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871be277-4bd4-405e-9fd7-1518eceba7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:24.542648 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871be277-4bd4-405e-9fd7-1518eceba7fe admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:24.558135 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1351/2706] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:22:24.559395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75477c1d-7554-4bef-95ea-4cb99842f681 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:24.579564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75477c1d-7554-4bef-95ea-4cb99842f681 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:24.584459 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3289e-d94f-45dc-bfff-2efb9e7fdc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:24.585516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3289e-d94f-45dc-bfff-2efb9e7fdc48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:24.585896 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3289e-d94f-45dc-bfff-2efb9e7fdc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:24.586274 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3289e-d94f-45dc-bfff-2efb9e7fdc48 admin admin] PATH_INFO: `/v3/projects/15c51d3d43dd4dbf9d61d32156e971e2/users/36f6c582b4e446b597f346c8cced39f5/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:24.608380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3289e-d94f-45dc-bfff-2efb9e7fdc48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c51d3d43dd4dbf9d61d32156e971e2, user_id=36f6c582b4e446b597f346c8cced39f5, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:24.612403 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3289e-d94f-45dc-bfff-2efb9e7fdc48 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:24.634680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1356/2707] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:22:24 2022] PUT /identity/v3/projects/15c51d3d43dd4dbf9d61d32156e971e2/users/36f6c582b4e446b597f346c8cced39f5/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:24.643628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae599-33cf-438c-a33d-4a0aaa30b830 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:24.644140 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae599-33cf-438c-a33d-4a0aaa30b830 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:24.644444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae599-33cf-438c-a33d-4a0aaa30b830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:24.681061 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-78aae599-33cf-438c-a33d-4a0aaa30b830 None None] MFA Rules not processed for user `36f6c582b4e446b597f346c8cced39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:24.682450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-78aae599-33cf-438c-a33d-4a0aaa30b830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:24.775204 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1352/2708] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:24.785025 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3289e-d94f-45dc-bfff-2efb9e7fdc48 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:24.786958 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-fab3289e-d94f-45dc-bfff-2efb9e7fdc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:24.876358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3289e-d94f-45dc-bfff-2efb9e7fdc48 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:24.880800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e5568-438b-410f-b375-bbd486e3f641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:24.881481 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e5568-438b-410f-b375-bbd486e3f641 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:24.881761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e5568-438b-410f-b375-bbd486e3f641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:24.882036 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e5568-438b-410f-b375-bbd486e3f641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:24.898936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e5568-438b-410f-b375-bbd486e3f641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:24.898936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e5568-438b-410f-b375-bbd486e3f641 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:24.906264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1357/2709] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:34.766698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:34.901434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:35.273746 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18e3bb-c1b2-4b0b-958e-6998e09c5c41 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:35.274394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18e3bb-c1b2-4b0b-958e-6998e09c5c41 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:35.274781 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18e3bb-c1b2-4b0b-958e-6998e09c5c41 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:35.276239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1353/2710] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:22:35.283971 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0129542-d452-415f-98fa-e0d104d81bc8 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:35.284258 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0129542-d452-415f-98fa-e0d104d81bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:35.284533 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0129542-d452-415f-98fa-e0d104d81bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:35.302420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e0129542-d452-415f-98fa-e0d104d81bc8 None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:35.303728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e0129542-d452-415f-98fa-e0d104d81bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:35.373079 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1358/2711] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:22:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:35.384841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18e3bb-c1b2-4b0b-958e-6998e09c5c41 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:35.386727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1b18e3bb-c1b2-4b0b-958e-6998e09c5c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:35.450460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18e3bb-c1b2-4b0b-958e-6998e09c5c41 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:35.454117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71bf72-d6d2-472c-a5e2-68782d87f59a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31a233e2fc784b01a3a8a24599f3c1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:35.454803 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71bf72-d6d2-472c-a5e2-68782d87f59a service glance] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:35.455089 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71bf72-d6d2-472c-a5e2-68782d87f59a service glance] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:35.455367 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71bf72-d6d2-472c-a5e2-68782d87f59a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:35.466790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71bf72-d6d2-472c-a5e2-68782d87f59a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:35.468595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71bf72-d6d2-472c-a5e2-68782d87f59a service glance] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:35.479920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1354/2712] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:35.556013 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdca85-bf8a-40c5-9767-4093886c73ee None None] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:35.556306 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdca85-bf8a-40c5-9767-4093886c73ee None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:35.556587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdca85-bf8a-40c5-9767-4093886c73ee None None] PATH_INFO: `/` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:35.557964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1359/2713] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:22:35.563701 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ef35d-54da-45ee-af7e-6a1652f8d505 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:35.564065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ef35d-54da-45ee-af7e-6a1652f8d505 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:35.564450 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ef35d-54da-45ee-af7e-6a1652f8d505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:35.584939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-1d4ef35d-54da-45ee-af7e-6a1652f8d505 None None] MFA Rules not processed for user `cdac6ddece434ed7abddcffe841476ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:35.586273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-1d4ef35d-54da-45ee-af7e-6a1652f8d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:35.645055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1355/2714] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:22:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:22:35.658170 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdca85-bf8a-40c5-9767-4093886c73ee None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:35.659934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8abdca85-bf8a-40c5-9767-4093886c73ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:35.674302 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdca85-bf8a-40c5-9767-4093886c73ee None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:35.677956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcc8aa-1c74-45b1-bf54-41eec6cb5632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:35.678631 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcc8aa-1c74-45b1-bf54-41eec6cb5632 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:35.678941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcc8aa-1c74-45b1-bf54-41eec6cb5632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:35.679216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcc8aa-1c74-45b1-bf54-41eec6cb5632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:35.686806 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcc8aa-1c74-45b1-bf54-41eec6cb5632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:35.688231 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcc8aa-1c74-45b1-bf54-41eec6cb5632 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:35.696210 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1360/2715] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:35.779957 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901f664-e5e0-4ca2-a457-de1f36444a06 None None] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:35.780475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901f664-e5e0-4ca2-a457-de1f36444a06 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:35.780582 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901f664-e5e0-4ca2-a457-de1f36444a06 None None] PATH_INFO: `/` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:35.782130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1356/2716] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 08:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 08:22:35.787883 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160e4a6-14db-49d3-a63f-3ffdb0ef0865 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:35.788174 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160e4a6-14db-49d3-a63f-3ffdb0ef0865 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:35.788453 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160e4a6-14db-49d3-a63f-3ffdb0ef0865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:35.807467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-8160e4a6-14db-49d3-a63f-3ffdb0ef0865 None None] MFA Rules not processed for user `c0956402a9bb4a9384111b36d5251749`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:35.808676 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8160e4a6-14db-49d3-a63f-3ffdb0ef0865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:35.818550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1361/2717] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 08:22:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:35.829608 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901f664-e5e0-4ca2-a457-de1f36444a06 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:35.840732 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901f664-e5e0-4ca2-a457-de1f36444a06 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:35.845368 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54ac53-81f7-4b45-9e54-cf2332225318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:35.846009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54ac53-81f7-4b45-9e54-cf2332225318 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:35.846290 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54ac53-81f7-4b45-9e54-cf2332225318 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:35.846564 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54ac53-81f7-4b45-9e54-cf2332225318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:35.857001 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54ac53-81f7-4b45-9e54-cf2332225318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:35.858501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54ac53-81f7-4b45-9e54-cf2332225318 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:35.869367 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1357/2718] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:39.898987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede89945-b836-4263-a774-de535422f8cb None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:39.899446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede89945-b836-4263-a774-de535422f8cb None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:39.899558 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede89945-b836-4263-a774-de535422f8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:39.917296 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ede89945-b836-4263-a774-de535422f8cb None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:39.918493 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ede89945-b836-4263-a774-de535422f8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:39.979537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1362/2719] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:22:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:39.993289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54ac53-81f7-4b45-9e54-cf2332225318 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:39.994755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ca54ac53-81f7-4b45-9e54-cf2332225318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:40.066084 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54ac53-81f7-4b45-9e54-cf2332225318 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:40.071536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cdc39-a7cd-45b1-b07b-767c08725ba8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:40.072625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cdc39-a7cd-45b1-b07b-767c08725ba8 service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:40.072625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cdc39-a7cd-45b1-b07b-767c08725ba8 service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:40.072840 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cdc39-a7cd-45b1-b07b-767c08725ba8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:40.081810 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cdc39-a7cd-45b1-b07b-767c08725ba8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:40.083519 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cdc39-a7cd-45b1-b07b-767c08725ba8 service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:40.096717 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1358/2720] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:22:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:22:42.787061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede89945-b836-4263-a774-de535422f8cb None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:42.861187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede89945-b836-4263-a774-de535422f8cb None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:42.866939 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:42.868172 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:42.868683 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:42.869162 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] PATH_INFO: `/v3/users/36f6c582b4e446b597f346c8cced39f5` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:42.870607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f6c582b4e446b597f346c8cced39f5)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:42.874344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:42.902996 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:42.951516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f6c582b4e446b597f346c8cced39f5'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:42.960299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f6c582b4e446b597f346c8cced39f5'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:42.961100 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f6c582b4e446b597f346c8cced39f5'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:42.961661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f6c582b4e446b597f346c8cced39f5'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:42.976110 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f6c582b4e446b597f346c8cced39f5'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:42.990822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1363/2721] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:22:42 2022] DELETE /identity/v3/users/36f6c582b4e446b597f346c8cced39f5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:42.995378 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e235950-c302-4d57-91f8-8f355320f15b None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:42.995844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e235950-c302-4d57-91f8-8f355320f15b None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:42.995943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e235950-c302-4d57-91f8-8f355320f15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:43.015761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7e235950-c302-4d57-91f8-8f355320f15b None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:43.016997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7e235950-c302-4d57-91f8-8f355320f15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:43.055814 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:43.112528 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1359/2722] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:22:43.120826 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:43.123066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:43.186649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54463d44-7f00-4d1d-9017-20b021620eb9 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:43.190226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb9927-5128-4414-a776-751433212260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:43.190909 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb9927-5128-4414-a776-751433212260 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:43.191193 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb9927-5128-4414-a776-751433212260 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:43.191471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb9927-5128-4414-a776-751433212260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:43.202503 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb9927-5128-4414-a776-751433212260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:43.208087 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb9927-5128-4414-a776-751433212260 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:43.228822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1364/2723] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:22:43.921313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e235950-c302-4d57-91f8-8f355320f15b None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:43.924798 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7e235950-c302-4d57-91f8-8f355320f15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:43.958665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e235950-c302-4d57-91f8-8f355320f15b None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:43.973705 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a7e5a-8819-4450-ad23-d5902575dadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:43.974790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7e5a-8819-4450-ad23-d5902575dadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:43.975329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7e5a-8819-4450-ad23-d5902575dadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:43.975708 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7e5a-8819-4450-ad23-d5902575dadb admin admin] PATH_INFO: `/v3/projects/15c51d3d43dd4dbf9d61d32156e971e2` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:43.980429 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a7e5a-8819-4450-ad23-d5902575dadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c51d3d43dd4dbf9d61d32156e971e2)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:43.982987 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a7e5a-8819-4450-ad23-d5902575dadb admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:44.049911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7c4a7e5a-8819-4450-ad23-d5902575dadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c51d3d43dd4dbf9d61d32156e971e2', 'request_id': 'req-7c4a7e5a-8819-4450-ad23-d5902575dadb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:44.057042 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7c4a7e5a-8819-4450-ad23-d5902575dadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c51d3d43dd4dbf9d61d32156e971e2', 'request_id': 'req-7c4a7e5a-8819-4450-ad23-d5902575dadb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:44.063612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7c4a7e5a-8819-4450-ad23-d5902575dadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c51d3d43dd4dbf9d61d32156e971e2', 'request_id': 'req-7c4a7e5a-8819-4450-ad23-d5902575dadb'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:44.078196 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7c4a7e5a-8819-4450-ad23-d5902575dadb admin admin] The token cache is being invalidate because project 15c51d3d43dd4dbf9d61d32156e971e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:22:44.078719 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7c4a7e5a-8819-4450-ad23-d5902575dadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:44.079453 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-7c4a7e5a-8819-4450-ad23-d5902575dadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:22:44.081407 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1360/2724] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:22:43 2022] DELETE /identity/v3/projects/15c51d3d43dd4dbf9d61d32156e971e2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:44.086910 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d780526-7e61-4e7d-b9aa-553f3f8185ad None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:44.087420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d780526-7e61-4e7d-b9aa-553f3f8185ad None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:44.087668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d780526-7e61-4e7d-b9aa-553f3f8185ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:44.126789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-2d780526-7e61-4e7d-b9aa-553f3f8185ad None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:44.128991 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-2d780526-7e61-4e7d-b9aa-553f3f8185ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:44.197578 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1365/2725] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:44.205656 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac628f-f65e-45a6-8218-1a93b7364fc6 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:44.205950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac628f-f65e-45a6-8218-1a93b7364fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:44.206236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac628f-f65e-45a6-8218-1a93b7364fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:44.224999 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-89ac628f-f65e-45a6-8218-1a93b7364fc6 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:44.226216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-89ac628f-f65e-45a6-8218-1a93b7364fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:44.235421 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1361/2726] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:22:44.239748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d780526-7e61-4e7d-b9aa-553f3f8185ad None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:44.250358 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d780526-7e61-4e7d-b9aa-553f3f8185ad None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:44.255169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2bc2e-fde5-4370-8264-1e4302222383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:44.255843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2bc2e-fde5-4370-8264-1e4302222383 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:44.256120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2bc2e-fde5-4370-8264-1e4302222383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:44.256390 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2bc2e-fde5-4370-8264-1e4302222383 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:44.257107 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2bc2e-fde5-4370-8264-1e4302222383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:22:44.257411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2bc2e-fde5-4370-8264-1e4302222383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:44.259050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2bc2e-fde5-4370-8264-1e4302222383 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:44.272321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1366/2727] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 08:22:44.277065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac628f-f65e-45a6-8218-1a93b7364fc6 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:44.289330 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac628f-f65e-45a6-8218-1a93b7364fc6 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:44.297023 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496ff93-1068-40cc-b7f1-7a70fd977db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:44.297739 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496ff93-1068-40cc-b7f1-7a70fd977db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:44.298027 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496ff93-1068-40cc-b7f1-7a70fd977db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:44.298363 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496ff93-1068-40cc-b7f1-7a70fd977db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:44.299187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496ff93-1068-40cc-b7f1-7a70fd977db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:44.301313 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496ff93-1068-40cc-b7f1-7a70fd977db3 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:44.355408 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1362/2728] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:22:44 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:22:44.356537 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2bc2e-fde5-4370-8264-1e4302222383 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:44.369010 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2bc2e-fde5-4370-8264-1e4302222383 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:44.396273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:44.443993 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d47ddf-1f16-4c8d-b11a-1e77907b575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:44.444662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d47ddf-1f16-4c8d-b11a-1e77907b575a admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:44.444963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d47ddf-1f16-4c8d-b11a-1e77907b575a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:44.445342 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d47ddf-1f16-4c8d-b11a-1e77907b575a admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:44.445942 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d47ddf-1f16-4c8d-b11a-1e77907b575a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:44.447900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d47ddf-1f16-4c8d-b11a-1e77907b575a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:44.473719 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1367/2729] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:22:44 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:22:44.477713 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496ff93-1068-40cc-b7f1-7a70fd977db3 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:44.491031 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496ff93-1068-40cc-b7f1-7a70fd977db3 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:44.496145 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8cbd5-015f-4aba-bb26-945746f3aadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:44.496995 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8cbd5-015f-4aba-bb26-945746f3aadb admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:44.497387 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8cbd5-015f-4aba-bb26-945746f3aadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:44.497772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8cbd5-015f-4aba-bb26-945746f3aadb admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:44.498804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8cbd5-015f-4aba-bb26-945746f3aadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:44.500557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8cbd5-015f-4aba-bb26-945746f3aadb admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:44.516809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1363/2730] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:22:44.518389 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d47ddf-1f16-4c8d-b11a-1e77907b575a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:44.529956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d47ddf-1f16-4c8d-b11a-1e77907b575a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:44.535134 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891a428-a2ef-4bc8-988e-19b006ae5650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:44.536136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891a428-a2ef-4bc8-988e-19b006ae5650 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:44.536422 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891a428-a2ef-4bc8-988e-19b006ae5650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:44.536697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891a428-a2ef-4bc8-988e-19b006ae5650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:44.537443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891a428-a2ef-4bc8-988e-19b006ae5650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:44.539105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891a428-a2ef-4bc8-988e-19b006ae5650 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:44.555699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1368/2731] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:22:44.556941 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8cbd5-015f-4aba-bb26-945746f3aadb admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:44.574669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8cbd5-015f-4aba-bb26-945746f3aadb admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:44.580092 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33824b63-8761-42a0-9cc6-0ef0f91564df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:44.581066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33824b63-8761-42a0-9cc6-0ef0f91564df admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:44.581411 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33824b63-8761-42a0-9cc6-0ef0f91564df admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:44.581790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33824b63-8761-42a0-9cc6-0ef0f91564df admin admin] PATH_INFO: `/v3/projects/8f0581e8737044bd9157b20187fc8d93/users/3dc7f2315ae6458eba5f2cbe867411d4/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:44.597631 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33824b63-8761-42a0-9cc6-0ef0f91564df admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0581e8737044bd9157b20187fc8d93, user_id=3dc7f2315ae6458eba5f2cbe867411d4, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:44.600392 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33824b63-8761-42a0-9cc6-0ef0f91564df admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:44.614192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1364/2732] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:22:44 2022] PUT /identity/v3/projects/8f0581e8737044bd9157b20187fc8d93/users/3dc7f2315ae6458eba5f2cbe867411d4/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:22:44.625350 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a046aa-f83c-4f3e-9a63-9f449e40817b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:44.625642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a046aa-f83c-4f3e-9a63-9f449e40817b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:44.625924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a046aa-f83c-4f3e-9a63-9f449e40817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:44.655153 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f8a046aa-f83c-4f3e-9a63-9f449e40817b None None] MFA Rules not processed for user `3dc7f2315ae6458eba5f2cbe867411d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:22:44.656382 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f8a046aa-f83c-4f3e-9a63-9f449e40817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:44.728772 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1369/2733] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:22:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:22:44.741269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33824b63-8761-42a0-9cc6-0ef0f91564df admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:44.743052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-33824b63-8761-42a0-9cc6-0ef0f91564df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:44.804742 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:44.809241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33824b63-8761-42a0-9cc6-0ef0f91564df admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:44.814966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14aba3-1537-4001-a11b-6867fcaa20ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31a233e2fc784b01a3a8a24599f3c1a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:44.816155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14aba3-1537-4001-a11b-6867fcaa20ad service glance] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:44.816607 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14aba3-1537-4001-a11b-6867fcaa20ad service glance] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:44.816841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14aba3-1537-4001-a11b-6867fcaa20ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:44.827409 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14aba3-1537-4001-a11b-6867fcaa20ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:44.828980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14aba3-1537-4001-a11b-6867fcaa20ad service glance] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:44.850689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1365/2734] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:48.962113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a046aa-f83c-4f3e-9a63-9f449e40817b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:48.963739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f8a046aa-f83c-4f3e-9a63-9f449e40817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:49.023591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a046aa-f83c-4f3e-9a63-9f449e40817b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:49.027253 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee344b44-a6cf-4ae5-8d54-eb706969edb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:49.028012 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee344b44-a6cf-4ae5-8d54-eb706969edb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:49.028927 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee344b44-a6cf-4ae5-8d54-eb706969edb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:49.029301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee344b44-a6cf-4ae5-8d54-eb706969edb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:49.031455 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ee344b44-a6cf-4ae5-8d54-eb706969edb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:49.082039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:22:49.096147 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee344b44-a6cf-4ae5-8d54-eb706969edb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:49.097602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee344b44-a6cf-4ae5-8d54-eb706969edb9 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:49.107517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1370/2735] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:50.091690 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14aba3-1537-4001-a11b-6867fcaa20ad service glance] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:50.093809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0c14aba3-1537-4001-a11b-6867fcaa20ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:50.204804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14aba3-1537-4001-a11b-6867fcaa20ad service glance] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:50.214126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd211f4-bb56-4f17-827e-8e9b60cb8693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:50.215365 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd211f4-bb56-4f17-827e-8e9b60cb8693 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:50.215865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd211f4-bb56-4f17-827e-8e9b60cb8693 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:50.216468 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd211f4-bb56-4f17-827e-8e9b60cb8693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:50.218537 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-dbd211f4-bb56-4f17-827e-8e9b60cb8693 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:50.231984 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd211f4-bb56-4f17-827e-8e9b60cb8693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:50.234459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd211f4-bb56-4f17-827e-8e9b60cb8693 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:50.246040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1366/2736] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:53.979760 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee344b44-a6cf-4ae5-8d54-eb706969edb9 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:53.989491 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee344b44-a6cf-4ae5-8d54-eb706969edb9 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:53.993238 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d2c37-159f-4dff-b70f-340593dd92f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:53.993906 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d2c37-159f-4dff-b70f-340593dd92f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:53.994170 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d2c37-159f-4dff-b70f-340593dd92f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:53.994452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d2c37-159f-4dff-b70f-340593dd92f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:53.996575 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-a99d2c37-159f-4dff-b70f-340593dd92f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:54.071392 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d2c37-159f-4dff-b70f-340593dd92f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:54.072852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d2c37-159f-4dff-b70f-340593dd92f6 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:54.086189 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1371/2737] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:22:57.497218 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd211f4-bb56-4f17-827e-8e9b60cb8693 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:22:57.500598 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-dbd211f4-bb56-4f17-827e-8e9b60cb8693 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:57.615501 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd211f4-bb56-4f17-827e-8e9b60cb8693 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:22:57.621635 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9edd37-e098-4d8d-a864-abd89979cbe5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:22:57.622356 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9edd37-e098-4d8d-a864-abd89979cbe5 service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:22:57.622682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9edd37-e098-4d8d-a864-abd89979cbe5 service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:22:57.623324 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9edd37-e098-4d8d-a864-abd89979cbe5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:22:57.624941 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2c9edd37-e098-4d8d-a864-abd89979cbe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:22:57.641146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9edd37-e098-4d8d-a864-abd89979cbe5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:22:57.643065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9edd37-e098-4d8d-a864-abd89979cbe5 service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:22:57.653540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1367/2738] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:22:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:23:01.306200 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d2c37-159f-4dff-b70f-340593dd92f6 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:01.307650 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-a99d2c37-159f-4dff-b70f-340593dd92f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:01.320481 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d2c37-159f-4dff-b70f-340593dd92f6 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:01.325976 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:01.326264 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:01.326548 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:01.326863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] PATH_INFO: `/v3/users/8b54a55cff584d948b96c1c439e57eda` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:01.328067 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b54a55cff584d948b96c1c439e57eda)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:01.329976 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:01.377415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b54a55cff584d948b96c1c439e57eda'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.384670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b54a55cff584d948b96c1c439e57eda'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.385364 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b54a55cff584d948b96c1c439e57eda'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.385974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b54a55cff584d948b96c1c439e57eda'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.398587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b54a55cff584d948b96c1c439e57eda'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.412046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1372/2739] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:23:01 2022] DELETE /identity/v3/users/8b54a55cff584d948b96c1c439e57eda => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:23:01.597726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9edd37-e098-4d8d-a864-abd89979cbe5 service placement] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:01.611187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9edd37-e098-4d8d-a864-abd89979cbe5 service placement] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:01.687743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:01.688684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:01.689120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:01.689405 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] PATH_INFO: `/v3/projects/cad2999c58284b92b7166848a3e1f261` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:01.690841 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad2999c58284b92b7166848a3e1f261)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:01.692875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:01.704316 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:01.752873 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad2999c58284b92b7166848a3e1f261', 'request_id': 'req-c66f1048-414e-4444-a256-d415c8f5a3f6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.759756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad2999c58284b92b7166848a3e1f261', 'request_id': 'req-c66f1048-414e-4444-a256-d415c8f5a3f6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.765971 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad2999c58284b92b7166848a3e1f261', 'request_id': 'req-c66f1048-414e-4444-a256-d415c8f5a3f6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.779844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] The token cache is being invalidate because project cad2999c58284b92b7166848a3e1f261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:23:01.780128 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.780771 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.782304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1368/2740] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:23:01 2022] DELETE /identity/v3/projects/cad2999c58284b92b7166848a3e1f261 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:23:01.789207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:01.790123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:01.805588 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59946-119a-4680-8c0b-62dbf0de1f8f admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:01.857595 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:01.866432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1434f5e-f2c8-4dcc-95a4-3b8c8a2afdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:01.867343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1434f5e-f2c8-4dcc-95a4-3b8c8a2afdde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:01.867637 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1434f5e-f2c8-4dcc-95a4-3b8c8a2afdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:01.868107 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1434f5e-f2c8-4dcc-95a4-3b8c8a2afdde admin admin] PATH_INFO: `/v3/users/44de390119624cbc944b5bd7794528ce` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:01.869478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1434f5e-f2c8-4dcc-95a4-3b8c8a2afdde admin admin] RBAC: Authorizing `identity:delete_user(user_id=44de390119624cbc944b5bd7794528ce)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:01.871599 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1434f5e-f2c8-4dcc-95a4-3b8c8a2afdde admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:01.918401 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b1434f5e-f2c8-4dcc-95a4-3b8c8a2afdde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44de390119624cbc944b5bd7794528ce'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.926553 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b1434f5e-f2c8-4dcc-95a4-3b8c8a2afdde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44de390119624cbc944b5bd7794528ce'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.927259 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b1434f5e-f2c8-4dcc-95a4-3b8c8a2afdde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44de390119624cbc944b5bd7794528ce'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.927867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b1434f5e-f2c8-4dcc-95a4-3b8c8a2afdde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44de390119624cbc944b5bd7794528ce'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.940019 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b1434f5e-f2c8-4dcc-95a4-3b8c8a2afdde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44de390119624cbc944b5bd7794528ce'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:01.955983 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1373/2741] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:23:01 2022] DELETE /identity/v3/users/44de390119624cbc944b5bd7794528ce => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:23:02.155853 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:02.157406 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:02.173585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f1048-414e-4444-a256-d415c8f5a3f6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:02.249208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:02.250115 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:02.250404 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:02.250712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] PATH_INFO: `/v3/projects/cf638c040b9e493e8f167d852dd0cfde` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:02.251945 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf638c040b9e493e8f167d852dd0cfde)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:02.254116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:02.305574 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf638c040b9e493e8f167d852dd0cfde', 'request_id': 'req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:02.312861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf638c040b9e493e8f167d852dd0cfde', 'request_id': 'req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:02.319245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf638c040b9e493e8f167d852dd0cfde', 'request_id': 'req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:02.333712 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] The token cache is being invalidate because project cf638c040b9e493e8f167d852dd0cfde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:23:02.334054 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:02.334677 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:02.336239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1369/2742] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:23:02 2022] DELETE /identity/v3/projects/cf638c040b9e493e8f167d852dd0cfde => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:23:03.991097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff706c-c413-4b83-acfd-79ecebed37e7 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:03.991627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff706c-c413-4b83-acfd-79ecebed37e7 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:03.991627 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff706c-c413-4b83-acfd-79ecebed37e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:04.011609 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e2ff706c-c413-4b83-acfd-79ecebed37e7 None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:23:04.012817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e2ff706c-c413-4b83-acfd-79ecebed37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:04.080668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1374/2743] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 21 08:23:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:23:04.096121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:04.098157 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:04.135046 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:04.178787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbf1aa-a52a-4f05-b2cf-969c4868a789 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:04.183892 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2255e4e-4f2e-4e93-895f-b7be9c9aab0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:04.184536 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2255e4e-4f2e-4e93-895f-b7be9c9aab0e service swift] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:04.184816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2255e4e-4f2e-4e93-895f-b7be9c9aab0e service swift] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:04.185183 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2255e4e-4f2e-4e93-895f-b7be9c9aab0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:04.196174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2255e4e-4f2e-4e93-895f-b7be9c9aab0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:04.197811 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2255e4e-4f2e-4e93-895f-b7be9c9aab0e service swift] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:04.207809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1370/2744] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:23:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:23:14.073053 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:14.203879 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=20 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:15.430258 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff706c-c413-4b83-acfd-79ecebed37e7 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:15.432007 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e2ff706c-c413-4b83-acfd-79ecebed37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:15.511345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff706c-c413-4b83-acfd-79ecebed37e7 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:15.517441 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:15.518490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:15.518885 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:15.519236 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] PATH_INFO: `/v3/users/3dc7f2315ae6458eba5f2cbe867411d4` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:15.520681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc7f2315ae6458eba5f2cbe867411d4)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:15.523173 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:15.578884 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc7f2315ae6458eba5f2cbe867411d4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:15.587091 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc7f2315ae6458eba5f2cbe867411d4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:15.587929 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc7f2315ae6458eba5f2cbe867411d4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:15.588720 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc7f2315ae6458eba5f2cbe867411d4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:15.602535 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc7f2315ae6458eba5f2cbe867411d4'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:15.616567 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1375/2745] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:23:15 2022] DELETE /identity/v3/users/3dc7f2315ae6458eba5f2cbe867411d4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:23:15.621245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d05490-df75-448f-b742-eb10fd01f113 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:15.621761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d05490-df75-448f-b742-eb10fd01f113 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:15.621861 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d05490-df75-448f-b742-eb10fd01f113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:15.640394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-12d05490-df75-448f-b742-eb10fd01f113 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:23:15.641702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-12d05490-df75-448f-b742-eb10fd01f113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:15.708864 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1371/2746] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:23:15.726674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:15.728130 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:15.800136 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d330e0-bd1e-460c-99cc-61520127ea38 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:15.803843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dc9cc-fe36-475b-8769-b0886cd0cd10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:15.804488 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dc9cc-fe36-475b-8769-b0886cd0cd10 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:15.804775 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dc9cc-fe36-475b-8769-b0886cd0cd10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:15.805050 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dc9cc-fe36-475b-8769-b0886cd0cd10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:15.815280 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dc9cc-fe36-475b-8769-b0886cd0cd10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:15.816730 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dc9cc-fe36-475b-8769-b0886cd0cd10 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:15.826476 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1376/2747] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:23:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:23:16.118402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d05490-df75-448f-b742-eb10fd01f113 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:16.120269 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-12d05490-df75-448f-b742-eb10fd01f113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:16.139236 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d05490-df75-448f-b742-eb10fd01f113 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:16.145356 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0d996-1b85-41af-ae46-fd270b7fa124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:16.146216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0d996-1b85-41af-ae46-fd270b7fa124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:16.146499 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0d996-1b85-41af-ae46-fd270b7fa124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:16.146802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0d996-1b85-41af-ae46-fd270b7fa124 admin admin] PATH_INFO: `/v3/projects/8f0581e8737044bd9157b20187fc8d93` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:16.148012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0d996-1b85-41af-ae46-fd270b7fa124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0581e8737044bd9157b20187fc8d93)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:16.149928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0d996-1b85-41af-ae46-fd270b7fa124 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:16.201728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-81e0d996-1b85-41af-ae46-fd270b7fa124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0581e8737044bd9157b20187fc8d93', 'request_id': 'req-81e0d996-1b85-41af-ae46-fd270b7fa124'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:16.209442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-81e0d996-1b85-41af-ae46-fd270b7fa124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0581e8737044bd9157b20187fc8d93', 'request_id': 'req-81e0d996-1b85-41af-ae46-fd270b7fa124'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:16.217573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-81e0d996-1b85-41af-ae46-fd270b7fa124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0581e8737044bd9157b20187fc8d93', 'request_id': 'req-81e0d996-1b85-41af-ae46-fd270b7fa124'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:16.231831 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-81e0d996-1b85-41af-ae46-fd270b7fa124 admin admin] The token cache is being invalidate because project 8f0581e8737044bd9157b20187fc8d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:23:16.232086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-81e0d996-1b85-41af-ae46-fd270b7fa124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:16.232887 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-81e0d996-1b85-41af-ae46-fd270b7fa124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:23:16.235191 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1372/2748] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:23:16 2022] DELETE /identity/v3/projects/8f0581e8737044bd9157b20187fc8d93 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:23:16.240286 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c046416-c96a-48b5-93e7-be5179ca49b7 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:16.240582 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c046416-c96a-48b5-93e7-be5179ca49b7 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:16.240867 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c046416-c96a-48b5-93e7-be5179ca49b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:16.261479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-3c046416-c96a-48b5-93e7-be5179ca49b7 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:23:16.262728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-3c046416-c96a-48b5-93e7-be5179ca49b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:16.281720 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:16.331458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1377/2749] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:23:16.339975 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ff6db-c7e7-4465-94d1-89b54dd3dcbe None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:16.340305 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ff6db-c7e7-4465-94d1-89b54dd3dcbe None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:16.340624 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ff6db-c7e7-4465-94d1-89b54dd3dcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:16.361634 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9e5ff6db-c7e7-4465-94d1-89b54dd3dcbe None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:23:16.362938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9e5ff6db-c7e7-4465-94d1-89b54dd3dcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:16.371021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1373/2750] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:23:16.376669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c046416-c96a-48b5-93e7-be5179ca49b7 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:16.391297 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c046416-c96a-48b5-93e7-be5179ca49b7 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:16.397322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dfbfe-0abb-46cd-a7cb-e852424be454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:16.398077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dfbfe-0abb-46cd-a7cb-e852424be454 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:16.398397 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dfbfe-0abb-46cd-a7cb-e852424be454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:16.398783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dfbfe-0abb-46cd-a7cb-e852424be454 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:16.399777 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dfbfe-0abb-46cd-a7cb-e852424be454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:23:16.400211 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dfbfe-0abb-46cd-a7cb-e852424be454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:16.402413 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dfbfe-0abb-46cd-a7cb-e852424be454 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:16.423433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1378/2751] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:23:16.428684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ff6db-c7e7-4465-94d1-89b54dd3dcbe None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:16.441631 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ff6db-c7e7-4465-94d1-89b54dd3dcbe None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:16.448051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e578c-db8b-4dd8-ac92-f1a9295fe6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:16.448842 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e578c-db8b-4dd8-ac92-f1a9295fe6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:16.449189 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e578c-db8b-4dd8-ac92-f1a9295fe6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:16.449482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e578c-db8b-4dd8-ac92-f1a9295fe6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:16.450326 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e578c-db8b-4dd8-ac92-f1a9295fe6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:16.453714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e578c-db8b-4dd8-ac92-f1a9295fe6e5 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:16.487997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1374/2752] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:23:16 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:23:16.492753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dfbfe-0abb-46cd-a7cb-e852424be454 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:16.505196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dfbfe-0abb-46cd-a7cb-e852424be454 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:16.580698 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226b471-3550-4ad6-9d8c-a361dd7e9812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:16.581699 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226b471-3550-4ad6-9d8c-a361dd7e9812 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:16.582162 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226b471-3550-4ad6-9d8c-a361dd7e9812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:16.582611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226b471-3550-4ad6-9d8c-a361dd7e9812 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:16.583835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226b471-3550-4ad6-9d8c-a361dd7e9812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:16.585817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226b471-3550-4ad6-9d8c-a361dd7e9812 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:16.610598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1379/2753] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:23:16 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:23:16.614980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e578c-db8b-4dd8-ac92-f1a9295fe6e5 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:16.625724 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e578c-db8b-4dd8-ac92-f1a9295fe6e5 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:16.630960 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2366c-df97-47d6-84c9-fde3f7f424f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:16.631651 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2366c-df97-47d6-84c9-fde3f7f424f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:16.631931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2366c-df97-47d6-84c9-fde3f7f424f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:16.632223 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2366c-df97-47d6-84c9-fde3f7f424f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:16.632925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2366c-df97-47d6-84c9-fde3f7f424f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:16.634511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2366c-df97-47d6-84c9-fde3f7f424f6 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:16.645331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1375/2754] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:23:16.649668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226b471-3550-4ad6-9d8c-a361dd7e9812 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:16.667448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226b471-3550-4ad6-9d8c-a361dd7e9812 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:16.672930 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f3564-53ec-48af-aeb0-0516c3c9b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:16.673599 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f3564-53ec-48af-aeb0-0516c3c9b9fa admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:16.673886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f3564-53ec-48af-aeb0-0516c3c9b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:16.674166 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f3564-53ec-48af-aeb0-0516c3c9b9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:16.674937 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f3564-53ec-48af-aeb0-0516c3c9b9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:16.676561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f3564-53ec-48af-aeb0-0516c3c9b9fa admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:16.687258 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1380/2755] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:23:16.691609 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2366c-df97-47d6-84c9-fde3f7f424f6 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:16.701931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2366c-df97-47d6-84c9-fde3f7f424f6 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:16.706906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c07af-6603-4e73-bb83-89837054d41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:16.707815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c07af-6603-4e73-bb83-89837054d41a admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:16.708096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c07af-6603-4e73-bb83-89837054d41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:16.708369 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c07af-6603-4e73-bb83-89837054d41a admin admin] PATH_INFO: `/v3/projects/e2c14f0f94af45b7b3117234993b591e/users/2f7b0c3b933d4bb5adb01bec696eed0b/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:16.726433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c07af-6603-4e73-bb83-89837054d41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c14f0f94af45b7b3117234993b591e, user_id=2f7b0c3b933d4bb5adb01bec696eed0b, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:16.729131 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c07af-6603-4e73-bb83-89837054d41a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:16.745374 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1376/2756] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:23:16 2022] PUT /identity/v3/projects/e2c14f0f94af45b7b3117234993b591e/users/2f7b0c3b933d4bb5adb01bec696eed0b/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:23:16.756301 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5414b15-d993-4bf7-9f58-06f62affbaaa None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:16.756584 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5414b15-d993-4bf7-9f58-06f62affbaaa None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:16.756860 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5414b15-d993-4bf7-9f58-06f62affbaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:16.779375 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e5414b15-d993-4bf7-9f58-06f62affbaaa None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:23:16.782015 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e5414b15-d993-4bf7-9f58-06f62affbaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:16.859753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1381/2757] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:23:16.869541 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c07af-6603-4e73-bb83-89837054d41a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:16.871338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-144c07af-6603-4e73-bb83-89837054d41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:16.898509 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:16.940216 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c07af-6603-4e73-bb83-89837054d41a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:16.945637 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fde945-fcc1-49fc-887a-692c36413ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:16.954141 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde945-fcc1-49fc-887a-692c36413ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:16.954557 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde945-fcc1-49fc-887a-692c36413ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:16.955070 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde945-fcc1-49fc-887a-692c36413ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:16.965978 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fde945-fcc1-49fc-887a-692c36413ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:16.967456 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fde945-fcc1-49fc-887a-692c36413ac2 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:16.979644 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1377/2758] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:23:17.867139 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a4bb5-760c-4da4-927b-8c9d4a59fc97 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:17.867818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a4bb5-760c-4da4-927b-8c9d4a59fc97 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:17.867818 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a4bb5-760c-4da4-927b-8c9d4a59fc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:17.897116 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-483a4bb5-760c-4da4-927b-8c9d4a59fc97 None None] MFA Rules not processed for user `2f7b0c3b933d4bb5adb01bec696eed0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:23:17.898360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-483a4bb5-760c-4da4-927b-8c9d4a59fc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:17.915845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:17.973456 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1382/2759] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:23:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:23:17.985711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fde945-fcc1-49fc-887a-692c36413ac2 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:17.988000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a8fde945-fcc1-49fc-887a-692c36413ac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:18.055034 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fde945-fcc1-49fc-887a-692c36413ac2 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:18.058893 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db895c-f7b7-4002-8556-de15e45c9bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:18.059539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db895c-f7b7-4002-8556-de15e45c9bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:18.059825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db895c-f7b7-4002-8556-de15e45c9bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:18.060102 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db895c-f7b7-4002-8556-de15e45c9bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:18.070130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db895c-f7b7-4002-8556-de15e45c9bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:18.071626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db895c-f7b7-4002-8556-de15e45c9bd6 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:18.086703 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1378/2760] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:23:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:23:19.453507 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55501c-5a6b-4b3a-b0bf-106f45bff940 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:19.454550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55501c-5a6b-4b3a-b0bf-106f45bff940 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:19.454550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55501c-5a6b-4b3a-b0bf-106f45bff940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:19.474677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ab55501c-5a6b-4b3a-b0bf-106f45bff940 None None] MFA Rules not processed for user `2f7b0c3b933d4bb5adb01bec696eed0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:23:19.475891 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ab55501c-5a6b-4b3a-b0bf-106f45bff940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:19.482856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1383/2761] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:23:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:23:19.763651 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db895c-f7b7-4002-8556-de15e45c9bd6 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:19.777133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db895c-f7b7-4002-8556-de15e45c9bd6 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:19.781287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee9da8-3920-44a5-9914-b62a9c002b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:19.781920 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee9da8-3920-44a5-9914-b62a9c002b71 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:19.783333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee9da8-3920-44a5-9914-b62a9c002b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:19.783333 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee9da8-3920-44a5-9914-b62a9c002b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:19.785116 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e5ee9da8-3920-44a5-9914-b62a9c002b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:19.795029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee9da8-3920-44a5-9914-b62a9c002b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:19.796449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee9da8-3920-44a5-9914-b62a9c002b71 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:19.804906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1379/2762] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:23:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:23:29.467584 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=22 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:29.800848 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=49 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:46.035329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139793fb-235b-4bef-aff0-6b9db7d33038 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:46.035852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139793fb-235b-4bef-aff0-6b9db7d33038 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:46.035852 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139793fb-235b-4bef-aff0-6b9db7d33038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:46.054076 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-139793fb-235b-4bef-aff0-6b9db7d33038 None None] MFA Rules not processed for user `2bc6e732127845a6be56f9b8be728f14`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:23:46.055304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-139793fb-235b-4bef-aff0-6b9db7d33038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:46.113718 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1384/2763] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:23:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:23:47.214872 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee9da8-3920-44a5-9914-b62a9c002b71 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:23:47.216428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e5ee9da8-3920-44a5-9914-b62a9c002b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:47.289367 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee9da8-3920-44a5-9914-b62a9c002b71 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:23:47.294252 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b614863-d84f-4bbd-9fd7-ae0e955c152f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:23:47.294925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b614863-d84f-4bbd-9fd7-ae0e955c152f service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:23:47.295206 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b614863-d84f-4bbd-9fd7-ae0e955c152f service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:23:47.295479 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b614863-d84f-4bbd-9fd7-ae0e955c152f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:23:47.297275 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-2b614863-d84f-4bbd-9fd7-ae0e955c152f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:23:47.309403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b614863-d84f-4bbd-9fd7-ae0e955c152f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:23:47.311021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b614863-d84f-4bbd-9fd7-ae0e955c152f service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:23:47.321448 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1380/2764] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:23:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:23:56.106820 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=25 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:23:57.316621 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=32 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:24:17.648523 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f3dfd-c2ea-49da-83bc-b6f34eca9991 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:24:17.649077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f3dfd-c2ea-49da-83bc-b6f34eca9991 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:24:17.649077 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f3dfd-c2ea-49da-83bc-b6f34eca9991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:24:17.668756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-375f3dfd-c2ea-49da-83bc-b6f34eca9991 None None] MFA Rules not processed for user `2f7b0c3b933d4bb5adb01bec696eed0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:24:17.669970 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-375f3dfd-c2ea-49da-83bc-b6f34eca9991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:24:17.677106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1385/2765] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:24:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:24:27.661709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:25:06.230436 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494464ee-3164-46d1-a28c-616b31401f30 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:25:06.230982 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494464ee-3164-46d1-a28c-616b31401f30 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:25:06.231088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494464ee-3164-46d1-a28c-616b31401f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:25:06.250011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-494464ee-3164-46d1-a28c-616b31401f30 None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:25:06.251253 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-494464ee-3164-46d1-a28c-616b31401f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:25:06.312641 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1381/2766] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:25:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:25:06.362163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f3dfd-c2ea-49da-83bc-b6f34eca9991 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:25:06.363623 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-375f3dfd-c2ea-49da-83bc-b6f34eca9991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:25:06.460084 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f3dfd-c2ea-49da-83bc-b6f34eca9991 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:25:06.465759 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8eab5-5300-42ec-83ef-ad430457fe7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:25:06.466414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8eab5-5300-42ec-83ef-ad430457fe7c service swift] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:25:06.466723 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8eab5-5300-42ec-83ef-ad430457fe7c service swift] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:25:06.467001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8eab5-5300-42ec-83ef-ad430457fe7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:25:06.476892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8eab5-5300-42ec-83ef-ad430457fe7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:25:06.478163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8eab5-5300-42ec-83ef-ad430457fe7c service swift] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:25:06.489120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1386/2767] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:25:11.899460 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494464ee-3164-46d1-a28c-616b31401f30 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:25:11.916905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494464ee-3164-46d1-a28c-616b31401f30 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:25:11.921787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:25:11.922962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:25:11.923262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:25:11.923522 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] PATH_INFO: `/v3/users/2f7b0c3b933d4bb5adb01bec696eed0b` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:25:11.924748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7b0c3b933d4bb5adb01bec696eed0b)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:25:11.926672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:25:11.980867 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7b0c3b933d4bb5adb01bec696eed0b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:25:11.990601 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7b0c3b933d4bb5adb01bec696eed0b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:25:12.005464 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7b0c3b933d4bb5adb01bec696eed0b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:25:12.006209 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7b0c3b933d4bb5adb01bec696eed0b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:25:12.006854 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7b0c3b933d4bb5adb01bec696eed0b'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:25:12.031517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1382/2768] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:25:11 2022] DELETE /identity/v3/users/2f7b0c3b933d4bb5adb01bec696eed0b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:25:12.231448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8eab5-5300-42ec-83ef-ad430457fe7c service swift] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:25:12.260458 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8eab5-5300-42ec-83ef-ad430457fe7c service swift] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:25:12.329612 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:25:12.330577 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:25:12.330941 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:25:12.331280 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] PATH_INFO: `/v3/projects/e2c14f0f94af45b7b3117234993b591e` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:25:12.332551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2c14f0f94af45b7b3117234993b591e)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:25:12.334506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:25:12.397756 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2c14f0f94af45b7b3117234993b591e', 'request_id': 'req-b7f2d269-0122-4654-a989-68384e4d9e5d'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:25:12.408583 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2c14f0f94af45b7b3117234993b591e', 'request_id': 'req-b7f2d269-0122-4654-a989-68384e4d9e5d'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:25:12.416116 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2c14f0f94af45b7b3117234993b591e', 'request_id': 'req-b7f2d269-0122-4654-a989-68384e4d9e5d'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:25:12.430055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] The token cache is being invalidate because project e2c14f0f94af45b7b3117234993b591e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:25:12.430444 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:25:12.431216 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:25:12.434431 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1387/2769] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:25:12 2022] DELETE /identity/v3/projects/e2c14f0f94af45b7b3117234993b591e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:25:17.387686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:25:17.389178 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:25:17.455047 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05783843-a4ef-4037-a7ca-e13fc6ff35fe admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:25:17.492311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:25:17.526266 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824378b-3c93-49e3-bf00-27f6ec8e6352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:25:17.526988 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824378b-3c93-49e3-bf00-27f6ec8e6352 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:25:17.527267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824378b-3c93-49e3-bf00-27f6ec8e6352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:25:17.527553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824378b-3c93-49e3-bf00-27f6ec8e6352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:25:17.529914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-d824378b-3c93-49e3-bf00-27f6ec8e6352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:25:17.621373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824378b-3c93-49e3-bf00-27f6ec8e6352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:25:17.622778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824378b-3c93-49e3-bf00-27f6ec8e6352 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:25:17.634160 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1383/2770] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:25:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:25:21.065380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:25:21.066879 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:25:21.080347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2d269-0122-4654-a989-68384e4d9e5d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:25:21.084117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e5b9e-2425-4243-a0f1-a30a12b9ced2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:25:21.084797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e5b9e-2425-4243-a0f1-a30a12b9ced2 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:25:21.085084 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e5b9e-2425-4243-a0f1-a30a12b9ced2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:25:21.085396 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e5b9e-2425-4243-a0f1-a30a12b9ced2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:25:21.087323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b32e5b9e-2425-4243-a0f1-a30a12b9ced2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:25:21.102807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e5b9e-2425-4243-a0f1-a30a12b9ced2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:25:21.104874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e5b9e-2425-4243-a0f1-a30a12b9ced2 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:25:21.117863 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1388/2771] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:25:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:25:21.495012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc234d-66ab-4119-ab1c-adb3afd9bb29 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:25:21.495565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc234d-66ab-4119-ab1c-adb3afd9bb29 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:25:21.495565 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc234d-66ab-4119-ab1c-adb3afd9bb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:25:21.514491 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-decc234d-66ab-4119-ab1c-adb3afd9bb29 None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:25:21.515749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-decc234d-66ab-4119-ab1c-adb3afd9bb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:25:21.577110 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1384/2772] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 08:25:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:25:21.590890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e5b9e-2425-4243-a0f1-a30a12b9ced2 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:25:21.592309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b32e5b9e-2425-4243-a0f1-a30a12b9ced2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:25:21.601835 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:25:21.668248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e5b9e-2425-4243-a0f1-a30a12b9ced2 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:25:21.673329 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da053f3-41fc-4b27-93b5-acb066e5250c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:25:21.673982 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da053f3-41fc-4b27-93b5-acb066e5250c service swift] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:25:21.674268 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da053f3-41fc-4b27-93b5-acb066e5250c service swift] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:25:21.674548 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da053f3-41fc-4b27-93b5-acb066e5250c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:25:21.683508 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da053f3-41fc-4b27-93b5-acb066e5250c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:25:21.685112 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da053f3-41fc-4b27-93b5-acb066e5250c service swift] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:25:21.693784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1389/2773] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:25:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:25:31.565591 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=64 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:25:31.690207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=29 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:25:35.939524 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813c099-48d5-44e7-9b01-84af55f63aac None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:25:35.940078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813c099-48d5-44e7-9b01-84af55f63aac None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:25:35.940078 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813c099-48d5-44e7-9b01-84af55f63aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:25:35.960832 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-3813c099-48d5-44e7-9b01-84af55f63aac None None] MFA Rules not processed for user `89cb97f51e6b4568a09e83cfbdf9e8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:25:35.962233 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3813c099-48d5-44e7-9b01-84af55f63aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:25:35.980480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1385/2774] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 21 08:25:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:25:35.997105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da053f3-41fc-4b27-93b5-acb066e5250c service swift] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:25:36.007992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da053f3-41fc-4b27-93b5-acb066e5250c service swift] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:25:36.013409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e2e22-3c2c-4b62-8970-d5a51b0040f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c29a6bfcf44b47ae368f47fdd04643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:25:36.014043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e2e22-3c2c-4b62-8970-d5a51b0040f3 service swift] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:25:36.014322 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e2e22-3c2c-4b62-8970-d5a51b0040f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:25:36.014593 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e2e22-3c2c-4b62-8970-d5a51b0040f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:25:36.023735 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e2e22-3c2c-4b62-8970-d5a51b0040f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:25:36.025614 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e2e22-3c2c-4b62-8970-d5a51b0040f3 service swift] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:25:36.035271 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1390/2775] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 08:25:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 08:25:45.954887 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:25:46.031295 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=6 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:08.779146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813c099-48d5-44e7-9b01-84af55f63aac None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:08.780578 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-3813c099-48d5-44e7-9b01-84af55f63aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:08.797248 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813c099-48d5-44e7-9b01-84af55f63aac None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:08.802778 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad152575-1f99-4d62-9d4d-978a09414d49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:08.803437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad152575-1f99-4d62-9d4d-978a09414d49 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:08.803719 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad152575-1f99-4d62-9d4d-978a09414d49 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:08.803994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad152575-1f99-4d62-9d4d-978a09414d49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:08.805849 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ad152575-1f99-4d62-9d4d-978a09414d49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:08.876931 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e2e22-3c2c-4b62-8970-d5a51b0040f3 service swift] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:08.878277 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-8d4e2e22-3c2c-4b62-8970-d5a51b0040f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:08.880431 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad152575-1f99-4d62-9d4d-978a09414d49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:08.882052 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad152575-1f99-4d62-9d4d-978a09414d49 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:08.891990 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e2e22-3c2c-4b62-8970-d5a51b0040f3 service swift] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:08.892270 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1386/2776] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:26:08.895613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de261bc5-090b-4dd1-b437-4183ff6d1fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:08.896248 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de261bc5-090b-4dd1-b437-4183ff6d1fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:08.896528 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de261bc5-090b-4dd1-b437-4183ff6d1fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:08.896804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de261bc5-090b-4dd1-b437-4183ff6d1fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:08.906114 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de261bc5-090b-4dd1-b437-4183ff6d1fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:08.907591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de261bc5-090b-4dd1-b437-4183ff6d1fc5 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:08.918763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1391/2777] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:26:09.879528 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad152575-1f99-4d62-9d4d-978a09414d49 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:09.882040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ad152575-1f99-4d62-9d4d-978a09414d49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:09.901627 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad152575-1f99-4d62-9d4d-978a09414d49 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:09.908354 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046ab9f-ac3e-4549-839f-7fafc00017cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:09.909179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046ab9f-ac3e-4549-839f-7fafc00017cf service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:09.909458 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046ab9f-ac3e-4549-839f-7fafc00017cf service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:09.909741 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046ab9f-ac3e-4549-839f-7fafc00017cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:09.912430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e046ab9f-ac3e-4549-839f-7fafc00017cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:09.926878 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046ab9f-ac3e-4549-839f-7fafc00017cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:09.928506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046ab9f-ac3e-4549-839f-7fafc00017cf service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:09.941942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1387/2778] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:26:13.418044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de261bc5-090b-4dd1-b437-4183ff6d1fc5 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:13.431505 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de261bc5-090b-4dd1-b437-4183ff6d1fc5 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:13.437833 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c992a8-6324-42fd-8950-c8b91262b9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:13.438823 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c992a8-6324-42fd-8950-c8b91262b9ef service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:13.439239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c992a8-6324-42fd-8950-c8b91262b9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:13.439641 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c992a8-6324-42fd-8950-c8b91262b9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:13.442235 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-06c992a8-6324-42fd-8950-c8b91262b9ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:13.545804 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c992a8-6324-42fd-8950-c8b91262b9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:13.547345 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c992a8-6324-42fd-8950-c8b91262b9ef service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:13.558190 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1392/2779] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:26:17.246181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046ab9f-ac3e-4549-839f-7fafc00017cf service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:17.248000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e046ab9f-ac3e-4549-839f-7fafc00017cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:17.305643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c992a8-6324-42fd-8950-c8b91262b9ef service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:17.308222 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-06c992a8-6324-42fd-8950-c8b91262b9ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:17.327280 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c992a8-6324-42fd-8950-c8b91262b9ef service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:17.332580 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb4df6-cd2f-4e54-bfe5-9cecb6cf37f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:17.333714 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb4df6-cd2f-4e54-bfe5-9cecb6cf37f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:17.334160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb4df6-cd2f-4e54-bfe5-9cecb6cf37f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:17.334611 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb4df6-cd2f-4e54-bfe5-9cecb6cf37f6 admin admin] PATH_INFO: `/v3/users/2bc6e732127845a6be56f9b8be728f14` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:17.335866 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb4df6-cd2f-4e54-bfe5-9cecb6cf37f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc6e732127845a6be56f9b8be728f14)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:17.337876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb4df6-cd2f-4e54-bfe5-9cecb6cf37f6 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:17.343595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046ab9f-ac3e-4549-839f-7fafc00017cf service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:17.348700 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f1f5a-cb24-4580-96b7-1f0323fd6c4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:17.349388 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f1f5a-cb24-4580-96b7-1f0323fd6c4b service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:17.349675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f1f5a-cb24-4580-96b7-1f0323fd6c4b service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:17.349952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f1f5a-cb24-4580-96b7-1f0323fd6c4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:17.351809 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9a8f1f5a-cb24-4580-96b7-1f0323fd6c4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:17.367137 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f1f5a-cb24-4580-96b7-1f0323fd6c4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:17.369672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f1f5a-cb24-4580-96b7-1f0323fd6c4b service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:17.385655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1388/2780] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:26:17.393223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-48eb4df6-cd2f-4e54-bfe5-9cecb6cf37f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc6e732127845a6be56f9b8be728f14'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:17.405164 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-48eb4df6-cd2f-4e54-bfe5-9cecb6cf37f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc6e732127845a6be56f9b8be728f14'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:17.406495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-48eb4df6-cd2f-4e54-bfe5-9cecb6cf37f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc6e732127845a6be56f9b8be728f14'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:17.407388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-48eb4df6-cd2f-4e54-bfe5-9cecb6cf37f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc6e732127845a6be56f9b8be728f14'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:17.429041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-48eb4df6-cd2f-4e54-bfe5-9cecb6cf37f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc6e732127845a6be56f9b8be728f14'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:17.445766 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1393/2781] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:26:17 2022] DELETE /identity/v3/users/2bc6e732127845a6be56f9b8be728f14 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:26:17.642237 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f1f5a-cb24-4580-96b7-1f0323fd6c4b service placement] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:17.660720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f1f5a-cb24-4580-96b7-1f0323fd6c4b service placement] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:17.723980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c577ece-0bc4-41d8-8627-27d0170f69c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:17.724836 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c577ece-0bc4-41d8-8627-27d0170f69c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:17.725121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c577ece-0bc4-41d8-8627-27d0170f69c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:17.725395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c577ece-0bc4-41d8-8627-27d0170f69c2 admin admin] PATH_INFO: `/v3/projects/df68cafb6dcd4a8c9e9593d3f13500f0` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:17.726568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c577ece-0bc4-41d8-8627-27d0170f69c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df68cafb6dcd4a8c9e9593d3f13500f0)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:17.729446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c577ece-0bc4-41d8-8627-27d0170f69c2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:17.747558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:17.778033 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4c577ece-0bc4-41d8-8627-27d0170f69c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'request_id': 'req-4c577ece-0bc4-41d8-8627-27d0170f69c2'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:17.794303 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4c577ece-0bc4-41d8-8627-27d0170f69c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'request_id': 'req-4c577ece-0bc4-41d8-8627-27d0170f69c2'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:17.800512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4c577ece-0bc4-41d8-8627-27d0170f69c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df68cafb6dcd4a8c9e9593d3f13500f0', 'request_id': 'req-4c577ece-0bc4-41d8-8627-27d0170f69c2'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:17.818011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4c577ece-0bc4-41d8-8627-27d0170f69c2 admin admin] The token cache is being invalidate because project df68cafb6dcd4a8c9e9593d3f13500f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:26:17.818475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4c577ece-0bc4-41d8-8627-27d0170f69c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:17.819314 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-4c577ece-0bc4-41d8-8627-27d0170f69c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:17.821306 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1389/2782] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:26:17 2022] DELETE /identity/v3/projects/df68cafb6dcd4a8c9e9593d3f13500f0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:17.827754 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2b2c7-0a82-4a61-abfd-63cd5f8b48cd None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:17.828028 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2b2c7-0a82-4a61-abfd-63cd5f8b48cd None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:17.828343 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2b2c7-0a82-4a61-abfd-63cd5f8b48cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:17.847432 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-dac2b2c7-0a82-4a61-abfd-63cd5f8b48cd None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:17.848725 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-dac2b2c7-0a82-4a61-abfd-63cd5f8b48cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:17.898121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:17.912954 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1394/2783] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:17.921146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa654c-686a-438e-a3dc-9769a1fc62c7 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:17.921482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa654c-686a-438e-a3dc-9769a1fc62c7 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:17.921776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa654c-686a-438e-a3dc-9769a1fc62c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:17.941144 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-cbfa654c-686a-438e-a3dc-9769a1fc62c7 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:17.942348 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cbfa654c-686a-438e-a3dc-9769a1fc62c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:17.951406 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1390/2784] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:17.955622 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2b2c7-0a82-4a61-abfd-63cd5f8b48cd None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:17.965821 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2b2c7-0a82-4a61-abfd-63cd5f8b48cd None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:17.970471 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50835897-5512-44c0-bfba-a81d650d45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:17.971160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835897-5512-44c0-bfba-a81d650d45be admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:17.971441 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835897-5512-44c0-bfba-a81d650d45be admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:17.971710 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50835897-5512-44c0-bfba-a81d650d45be admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:17.972460 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50835897-5512-44c0-bfba-a81d650d45be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:26:17.972761 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50835897-5512-44c0-bfba-a81d650d45be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:17.974361 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50835897-5512-44c0-bfba-a81d650d45be admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:17.987753 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1395/2785] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:26:17.992072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa654c-686a-438e-a3dc-9769a1fc62c7 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:18.002143 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa654c-686a-438e-a3dc-9769a1fc62c7 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:18.007088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bd28e-4810-4417-b936-c29728055b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:18.007734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bd28e-4810-4417-b936-c29728055b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.008012 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bd28e-4810-4417-b936-c29728055b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.008284 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bd28e-4810-4417-b936-c29728055b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.008973 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bd28e-4810-4417-b936-c29728055b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:18.011380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bd28e-4810-4417-b936-c29728055b40 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:18.043749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1391/2786] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:26:17 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:26:18.044924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50835897-5512-44c0-bfba-a81d650d45be admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:18.055442 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50835897-5512-44c0-bfba-a81d650d45be admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:18.113321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9cfe4-9d2a-4f61-b111-0b2ddb4cc7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:18.113895 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9cfe4-9d2a-4f61-b111-0b2ddb4cc7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.114176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9cfe4-9d2a-4f61-b111-0b2ddb4cc7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.114451 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9cfe4-9d2a-4f61-b111-0b2ddb4cc7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.115163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9cfe4-9d2a-4f61-b111-0b2ddb4cc7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:18.117072 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9cfe4-9d2a-4f61-b111-0b2ddb4cc7e6 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:18.138275 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1396/2787] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:26:18 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:26:18.142512 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bd28e-4810-4417-b936-c29728055b40 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:18.154665 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bd28e-4810-4417-b936-c29728055b40 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:18.159337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc265e15-3142-4555-a1d3-445b4c3e4bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:18.159994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc265e15-3142-4555-a1d3-445b4c3e4bae admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.160276 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc265e15-3142-4555-a1d3-445b4c3e4bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.160553 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc265e15-3142-4555-a1d3-445b4c3e4bae admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.161337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc265e15-3142-4555-a1d3-445b4c3e4bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:18.162968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc265e15-3142-4555-a1d3-445b4c3e4bae admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:18.175089 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1392/2788] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:26:18.179224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9cfe4-9d2a-4f61-b111-0b2ddb4cc7e6 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:18.190262 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9cfe4-9d2a-4f61-b111-0b2ddb4cc7e6 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:18.194965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01ab47-bd26-4525-9387-9fd27b62fe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:18.195960 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01ab47-bd26-4525-9387-9fd27b62fe19 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.195960 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01ab47-bd26-4525-9387-9fd27b62fe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.196237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01ab47-bd26-4525-9387-9fd27b62fe19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.196966 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01ab47-bd26-4525-9387-9fd27b62fe19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:18.198786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01ab47-bd26-4525-9387-9fd27b62fe19 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:18.209636 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1397/2789] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:26:18.214448 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc265e15-3142-4555-a1d3-445b4c3e4bae admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:18.224927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc265e15-3142-4555-a1d3-445b4c3e4bae admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:18.230662 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d38378-0a55-43e6-88d2-671c0963d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:18.231545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d38378-0a55-43e6-88d2-671c0963d6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.231822 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d38378-0a55-43e6-88d2-671c0963d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.232089 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d38378-0a55-43e6-88d2-671c0963d6ee admin admin] PATH_INFO: `/v3/projects/49859c611390444caefb26a63dc5869a/users/115fefb57f6d41f3bc143b5141a30277/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.249181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d38378-0a55-43e6-88d2-671c0963d6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=49859c611390444caefb26a63dc5869a, user_id=115fefb57f6d41f3bc143b5141a30277, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:18.251977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d38378-0a55-43e6-88d2-671c0963d6ee admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:18.272146 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1393/2790] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:26:18 2022] PUT /identity/v3/projects/49859c611390444caefb26a63dc5869a/users/115fefb57f6d41f3bc143b5141a30277/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:18.283555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2f80-fe1f-45d2-9f91-e9f31728ce6a None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.283845 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2f80-fe1f-45d2-9f91-e9f31728ce6a None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.284151 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2f80-fe1f-45d2-9f91-e9f31728ce6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.320513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-df8d2f80-fe1f-45d2-9f91-e9f31728ce6a None None] MFA Rules not processed for user `115fefb57f6d41f3bc143b5141a30277`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:18.322584 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-df8d2f80-fe1f-45d2-9f91-e9f31728ce6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:18.396367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1398/2791] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:18.402339 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d38378-0a55-43e6-88d2-671c0963d6ee admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:18.472156 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d38378-0a55-43e6-88d2-671c0963d6ee admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:18.477142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b579fc-7f42-4172-a5f1-3596baed5c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:18.477808 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b579fc-7f42-4172-a5f1-3596baed5c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.478093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b579fc-7f42-4172-a5f1-3596baed5c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.478375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b579fc-7f42-4172-a5f1-3596baed5c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.479132 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b579fc-7f42-4172-a5f1-3596baed5c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:18.481053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b579fc-7f42-4172-a5f1-3596baed5c5f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:18.507504 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1394/2792] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:26:18 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:26:18.512925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d2f80-fe1f-45d2-9f91-e9f31728ce6a None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:18.523733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d2f80-fe1f-45d2-9f91-e9f31728ce6a None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:18.572915 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:18.586559 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfdf4e-66c7-41c7-a2e5-a13c3f9d4e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:18.587365 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfdf4e-66c7-41c7-a2e5-a13c3f9d4e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.588207 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfdf4e-66c7-41c7-a2e5-a13c3f9d4e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.588479 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfdf4e-66c7-41c7-a2e5-a13c3f9d4e92 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.589180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfdf4e-66c7-41c7-a2e5-a13c3f9d4e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:18.591123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfdf4e-66c7-41c7-a2e5-a13c3f9d4e92 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:18.611834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1399/2793] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:26:18 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:26:18.616176 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b579fc-7f42-4172-a5f1-3596baed5c5f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:18.626751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b579fc-7f42-4172-a5f1-3596baed5c5f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:18.631879 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca92a6-d8be-455b-aacd-f7d01f90b8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:18.632543 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca92a6-d8be-455b-aacd-f7d01f90b8ac admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.632821 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca92a6-d8be-455b-aacd-f7d01f90b8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.633092 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca92a6-d8be-455b-aacd-f7d01f90b8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.633820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca92a6-d8be-455b-aacd-f7d01f90b8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:18.636262 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca92a6-d8be-455b-aacd-f7d01f90b8ac admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:18.647545 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1395/2794] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:26:18.652526 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfdf4e-66c7-41c7-a2e5-a13c3f9d4e92 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:18.662607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfdf4e-66c7-41c7-a2e5-a13c3f9d4e92 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:18.668055 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196fd46-3279-403c-bebf-f20a247bf3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:18.668974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196fd46-3279-403c-bebf-f20a247bf3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.669300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196fd46-3279-403c-bebf-f20a247bf3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.669613 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196fd46-3279-403c-bebf-f20a247bf3fb admin admin] PATH_INFO: `/v3/projects/62e2ea65c3b44843a114d16476b6d491/users/3e7d48a5b71d47f7a704048b735352a1/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.686555 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196fd46-3279-403c-bebf-f20a247bf3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e2ea65c3b44843a114d16476b6d491, user_id=3e7d48a5b71d47f7a704048b735352a1, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:18.691239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196fd46-3279-403c-bebf-f20a247bf3fb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:18.707874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1400/2795] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:26:18 2022] PUT /identity/v3/projects/62e2ea65c3b44843a114d16476b6d491/users/3e7d48a5b71d47f7a704048b735352a1/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:18.711890 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca92a6-d8be-455b-aacd-f7d01f90b8ac admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:18.723338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca92a6-d8be-455b-aacd-f7d01f90b8ac admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:18.737942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:18.796050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb9ef5-57d8-4d49-95f3-df20148c1d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:18.796726 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb9ef5-57d8-4d49-95f3-df20148c1d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.797010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb9ef5-57d8-4d49-95f3-df20148c1d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.797287 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb9ef5-57d8-4d49-95f3-df20148c1d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.798395 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb9ef5-57d8-4d49-95f3-df20148c1d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:18.800058 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb9ef5-57d8-4d49-95f3-df20148c1d37 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:18.811916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1396/2796] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:26:18.816550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196fd46-3279-403c-bebf-f20a247bf3fb admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:18.834709 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196fd46-3279-403c-bebf-f20a247bf3fb admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:18.835213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e30b46-5b5d-40c3-a529-7c225c1d1b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:18.836161 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e30b46-5b5d-40c3-a529-7c225c1d1b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.836445 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e30b46-5b5d-40c3-a529-7c225c1d1b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.836721 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e30b46-5b5d-40c3-a529-7c225c1d1b36 admin admin] PATH_INFO: `/v3/projects/62e2ea65c3b44843a114d16476b6d491/users/3e7d48a5b71d47f7a704048b735352a1/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.838935 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e30b46-5b5d-40c3-a529-7c225c1d1b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e2ea65c3b44843a114d16476b6d491, user_id=3e7d48a5b71d47f7a704048b735352a1, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:18.841734 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e30b46-5b5d-40c3-a529-7c225c1d1b36 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:18.853232 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1401/2797] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:26:18 2022] PUT /identity/v3/projects/62e2ea65c3b44843a114d16476b6d491/users/3e7d48a5b71d47f7a704048b735352a1/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:18.863703 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ec5aa-60a2-4518-824e-dce1d3113678 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:18.863997 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ec5aa-60a2-4518-824e-dce1d3113678 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:18.864286 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ec5aa-60a2-4518-824e-dce1d3113678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:18.894291 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-412ec5aa-60a2-4518-824e-dce1d3113678 None None] MFA Rules not processed for user `3e7d48a5b71d47f7a704048b735352a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:18.895573 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-412ec5aa-60a2-4518-824e-dce1d3113678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:18.970320 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1397/2798] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:18.981159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e30b46-5b5d-40c3-a529-7c225c1d1b36 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:18.983920 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b0e30b46-5b5d-40c3-a529-7c225c1d1b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:19.044853 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e30b46-5b5d-40c3-a529-7c225c1d1b36 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:19.048833 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f055e72-af3c-41e9-a12e-534dbae2c9a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:19.049680 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f055e72-af3c-41e9-a12e-534dbae2c9a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:19.050068 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f055e72-af3c-41e9-a12e-534dbae2c9a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:19.050440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f055e72-af3c-41e9-a12e-534dbae2c9a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:19.061892 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f055e72-af3c-41e9-a12e-534dbae2c9a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:19.063381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f055e72-af3c-41e9-a12e-534dbae2c9a1 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:19.073851 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1402/2799] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:26:19.121675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ec5aa-60a2-4518-824e-dce1d3113678 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:19.123121 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-412ec5aa-60a2-4518-824e-dce1d3113678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:19.138283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ec5aa-60a2-4518-824e-dce1d3113678 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:19.142200 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e8250-265d-48c0-af3e-4b52f8a739fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:19.142875 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e8250-265d-48c0-af3e-4b52f8a739fd service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:19.143164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e8250-265d-48c0-af3e-4b52f8a739fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:19.143444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e8250-265d-48c0-af3e-4b52f8a739fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:19.210225 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e8250-265d-48c0-af3e-4b52f8a739fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:19.211744 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e8250-265d-48c0-af3e-4b52f8a739fd service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:19.221187 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1398/2800] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:26:22.552876 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f055e72-af3c-41e9-a12e-534dbae2c9a1 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:22.635640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f055e72-af3c-41e9-a12e-534dbae2c9a1 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:22.640379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:22.641243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:22.641527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:22.641803 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] PATH_INFO: `/v3/users/115fefb57f6d41f3bc143b5141a30277` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:22.643031 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=115fefb57f6d41f3bc143b5141a30277)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:22.644959 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:22.699043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:22.701524 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115fefb57f6d41f3bc143b5141a30277'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:22.714380 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115fefb57f6d41f3bc143b5141a30277'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:22.715463 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115fefb57f6d41f3bc143b5141a30277'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:22.716309 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115fefb57f6d41f3bc143b5141a30277'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:22.732917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115fefb57f6d41f3bc143b5141a30277'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:22.746484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1403/2801] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:26:22 2022] DELETE /identity/v3/users/115fefb57f6d41f3bc143b5141a30277 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:22.751072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d0325-13eb-4437-b807-575079e1bdd9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:22.751564 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d0325-13eb-4437-b807-575079e1bdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:22.751675 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d0325-13eb-4437-b807-575079e1bdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:22.770164 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e00d0325-13eb-4437-b807-575079e1bdd9 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:22.771449 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e00d0325-13eb-4437-b807-575079e1bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:22.803088 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=100 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:22.835447 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1399/2802] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:22.845501 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:22.847078 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:22.916716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077959e-56ac-4a19-92fa-5ca6f567d7cf admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:22.920435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b38db5-30f7-454c-9407-28b82f177560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:22.921084 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b38db5-30f7-454c-9407-28b82f177560 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:22.921370 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b38db5-30f7-454c-9407-28b82f177560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:22.921649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b38db5-30f7-454c-9407-28b82f177560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:22.931955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b38db5-30f7-454c-9407-28b82f177560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:22.933394 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b38db5-30f7-454c-9407-28b82f177560 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:22.943374 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1404/2803] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:26:23.240922 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d0325-13eb-4437-b807-575079e1bdd9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:23.242660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e00d0325-13eb-4437-b807-575079e1bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:23.256877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d0325-13eb-4437-b807-575079e1bdd9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:23.261806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:23.262694 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:23.262974 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:23.263247 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] PATH_INFO: `/v3/projects/49859c611390444caefb26a63dc5869a` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:23.264511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=49859c611390444caefb26a63dc5869a)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:23.266445 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:23.319586 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49859c611390444caefb26a63dc5869a', 'request_id': 'req-e057318d-46ca-49ca-b11d-38f073485dcf'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.326689 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49859c611390444caefb26a63dc5869a', 'request_id': 'req-e057318d-46ca-49ca-b11d-38f073485dcf'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.332544 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49859c611390444caefb26a63dc5869a', 'request_id': 'req-e057318d-46ca-49ca-b11d-38f073485dcf'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.348475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] The token cache is being invalidate because project 49859c611390444caefb26a63dc5869a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:26:23.348761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.349433 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.352687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1400/2804] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:26:23 2022] DELETE /identity/v3/projects/49859c611390444caefb26a63dc5869a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:26:23.355713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b38db5-30f7-454c-9407-28b82f177560 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:23.365390 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b38db5-30f7-454c-9407-28b82f177560 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:23.435223 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b05d89-01b0-4238-85cc-171a6f10cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:23.436099 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b05d89-01b0-4238-85cc-171a6f10cba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:23.436383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b05d89-01b0-4238-85cc-171a6f10cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:23.436658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b05d89-01b0-4238-85cc-171a6f10cba8 admin admin] PATH_INFO: `/v3/users/3e7d48a5b71d47f7a704048b735352a1` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:23.437857 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b05d89-01b0-4238-85cc-171a6f10cba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7d48a5b71d47f7a704048b735352a1)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:23.439848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b05d89-01b0-4238-85cc-171a6f10cba8 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:23.491182 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d2b05d89-01b0-4238-85cc-171a6f10cba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7d48a5b71d47f7a704048b735352a1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.498813 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d2b05d89-01b0-4238-85cc-171a6f10cba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7d48a5b71d47f7a704048b735352a1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.499561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d2b05d89-01b0-4238-85cc-171a6f10cba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7d48a5b71d47f7a704048b735352a1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.500180 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d2b05d89-01b0-4238-85cc-171a6f10cba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7d48a5b71d47f7a704048b735352a1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.508566 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:23.514877 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d2b05d89-01b0-4238-85cc-171a6f10cba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7d48a5b71d47f7a704048b735352a1'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.530590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1405/2805] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:26:23 2022] DELETE /identity/v3/users/3e7d48a5b71d47f7a704048b735352a1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:23.816322 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:23.818044 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:23.833626 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057318d-46ca-49ca-b11d-38f073485dcf admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:23.896828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d2790-885e-4418-8125-c1796f43af24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:23.897698 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2790-885e-4418-8125-c1796f43af24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:23.897980 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2790-885e-4418-8125-c1796f43af24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:23.898258 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2790-885e-4418-8125-c1796f43af24 admin admin] PATH_INFO: `/v3/projects/62e2ea65c3b44843a114d16476b6d491` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:23.904715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d2790-885e-4418-8125-c1796f43af24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e2ea65c3b44843a114d16476b6d491)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:23.906755 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d2790-885e-4418-8125-c1796f43af24 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:23.957231 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-078d2790-885e-4418-8125-c1796f43af24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e2ea65c3b44843a114d16476b6d491', 'request_id': 'req-078d2790-885e-4418-8125-c1796f43af24'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.964562 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-078d2790-885e-4418-8125-c1796f43af24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e2ea65c3b44843a114d16476b6d491', 'request_id': 'req-078d2790-885e-4418-8125-c1796f43af24'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.969325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:23.971113 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-078d2790-885e-4418-8125-c1796f43af24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e2ea65c3b44843a114d16476b6d491', 'request_id': 'req-078d2790-885e-4418-8125-c1796f43af24'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.985749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-078d2790-885e-4418-8125-c1796f43af24 admin admin] The token cache is being invalidate because project 62e2ea65c3b44843a114d16476b6d491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:26:23.986040 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-078d2790-885e-4418-8125-c1796f43af24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.986703 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-078d2790-885e-4418-8125-c1796f43af24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:23.988260 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1401/2806] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:26:23 2022] DELETE /identity/v3/projects/62e2ea65c3b44843a114d16476b6d491 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:23.993472 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2ce87-baeb-4591-a3a7-7a43aa1e9cf6 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:23.994003 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2ce87-baeb-4591-a3a7-7a43aa1e9cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:23.994548 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2ce87-baeb-4591-a3a7-7a43aa1e9cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:24.014738 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-e8d2ce87-baeb-4591-a3a7-7a43aa1e9cf6 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:24.015995 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-e8d2ce87-baeb-4591-a3a7-7a43aa1e9cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:24.078239 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1406/2807] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:24.088059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788788c-080d-4d2e-b9b1-b89ff7115840 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:24.088368 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788788c-080d-4d2e-b9b1-b89ff7115840 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:24.088645 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788788c-080d-4d2e-b9b1-b89ff7115840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:24.107760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-e788788c-080d-4d2e-b9b1-b89ff7115840 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:24.108963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e788788c-080d-4d2e-b9b1-b89ff7115840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:24.117337 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1402/2808] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:24.122843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2ce87-baeb-4591-a3a7-7a43aa1e9cf6 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:24.132840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2ce87-baeb-4591-a3a7-7a43aa1e9cf6 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:24.139445 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb057d3-369d-480f-a238-f1fc153aed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:24.140123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb057d3-369d-480f-a238-f1fc153aed9e admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:24.140411 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb057d3-369d-480f-a238-f1fc153aed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:24.140688 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb057d3-369d-480f-a238-f1fc153aed9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:24.141436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb057d3-369d-480f-a238-f1fc153aed9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:26:24.141745 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb057d3-369d-480f-a238-f1fc153aed9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:24.143414 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb057d3-369d-480f-a238-f1fc153aed9e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:24.157393 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1407/2809] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:26:24.161962 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788788c-080d-4d2e-b9b1-b89ff7115840 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:24.172442 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788788c-080d-4d2e-b9b1-b89ff7115840 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:24.177246 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea996c8-5f42-45a6-b8d6-db3b12814e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:24.177906 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea996c8-5f42-45a6-b8d6-db3b12814e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:24.178192 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea996c8-5f42-45a6-b8d6-db3b12814e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:24.178469 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea996c8-5f42-45a6-b8d6-db3b12814e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:24.179199 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea996c8-5f42-45a6-b8d6-db3b12814e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:24.181182 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea996c8-5f42-45a6-b8d6-db3b12814e3e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:24.212954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1403/2810] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:26:24 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:26:24.215143 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb057d3-369d-480f-a238-f1fc153aed9e admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:24.225452 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb057d3-369d-480f-a238-f1fc153aed9e admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:24.289114 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb1742-6c84-42e8-acae-1f699036a3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:24.289791 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb1742-6c84-42e8-acae-1f699036a3bf admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:24.290072 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb1742-6c84-42e8-acae-1f699036a3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:24.290932 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb1742-6c84-42e8-acae-1f699036a3bf admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:24.291744 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb1742-6c84-42e8-acae-1f699036a3bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:24.293668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb1742-6c84-42e8-acae-1f699036a3bf admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:24.313918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1408/2811] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:26:24 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:26:24.317950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea996c8-5f42-45a6-b8d6-db3b12814e3e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:24.328998 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea996c8-5f42-45a6-b8d6-db3b12814e3e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:24.333650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbd28e-81c6-47c0-827b-5f794ede5dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:24.334308 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbd28e-81c6-47c0-827b-5f794ede5dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:24.334588 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbd28e-81c6-47c0-827b-5f794ede5dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:24.334894 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbd28e-81c6-47c0-827b-5f794ede5dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:24.335617 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbd28e-81c6-47c0-827b-5f794ede5dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:24.337751 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbd28e-81c6-47c0-827b-5f794ede5dd2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:24.348666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1404/2812] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:26:24.353834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb1742-6c84-42e8-acae-1f699036a3bf admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:24.364498 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb1742-6c84-42e8-acae-1f699036a3bf admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:24.369707 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6650c4-f12b-4501-b33d-43c651fb5db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:24.370385 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6650c4-f12b-4501-b33d-43c651fb5db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:24.370713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6650c4-f12b-4501-b33d-43c651fb5db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:24.370992 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6650c4-f12b-4501-b33d-43c651fb5db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:24.371732 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6650c4-f12b-4501-b33d-43c651fb5db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:24.373347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6650c4-f12b-4501-b33d-43c651fb5db9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:24.384799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1409/2813] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:26:24.389451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbd28e-81c6-47c0-827b-5f794ede5dd2 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:24.400382 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbd28e-81c6-47c0-827b-5f794ede5dd2 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:24.405167 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9661f75-1488-49c3-914a-6337f3b0ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:24.406051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9661f75-1488-49c3-914a-6337f3b0ec7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:24.406338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9661f75-1488-49c3-914a-6337f3b0ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:24.406642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9661f75-1488-49c3-914a-6337f3b0ec7d admin admin] PATH_INFO: `/v3/projects/41d9e73421fc48c3a9c18e170799c9a3/users/e12204a05871450d8e190c2a3d9c4f67/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:24.424702 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9661f75-1488-49c3-914a-6337f3b0ec7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d9e73421fc48c3a9c18e170799c9a3, user_id=e12204a05871450d8e190c2a3d9c4f67, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:24.427447 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9661f75-1488-49c3-914a-6337f3b0ec7d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:24.441041 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1405/2814] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:26:24 2022] PUT /identity/v3/projects/41d9e73421fc48c3a9c18e170799c9a3/users/e12204a05871450d8e190c2a3d9c4f67/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:24.446304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96721e-092d-4e7d-aaae-fa5184aea8e0 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:24.447856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96721e-092d-4e7d-aaae-fa5184aea8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:24.448163 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96721e-092d-4e7d-aaae-fa5184aea8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:24.467226 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ff96721e-092d-4e7d-aaae-fa5184aea8e0 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:24.468447 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ff96721e-092d-4e7d-aaae-fa5184aea8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:24.516435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:24.538873 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1410/2815] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:24.549462 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9661f75-1488-49c3-914a-6337f3b0ec7d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:24.551241 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e9661f75-1488-49c3-914a-6337f3b0ec7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:24.612475 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9661f75-1488-49c3-914a-6337f3b0ec7d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:24.617134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61392ef1-091b-413e-867a-24ec76c51956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:24.617789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61392ef1-091b-413e-867a-24ec76c51956 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:24.618066 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61392ef1-091b-413e-867a-24ec76c51956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:24.619090 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61392ef1-091b-413e-867a-24ec76c51956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:24.630483 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61392ef1-091b-413e-867a-24ec76c51956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:24.631961 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61392ef1-091b-413e-867a-24ec76c51956 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:24.642772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1406/2816] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:26:25.285646 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506003d8-7272-45e0-9c2c-eee1b5795d06 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:25.286506 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506003d8-7272-45e0-9c2c-eee1b5795d06 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:25.286702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506003d8-7272-45e0-9c2c-eee1b5795d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:25.328043 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-506003d8-7272-45e0-9c2c-eee1b5795d06 None None] MFA Rules not processed for user `e12204a05871450d8e190c2a3d9c4f67`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:25.329288 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-506003d8-7272-45e0-9c2c-eee1b5795d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:25.410085 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1411/2817] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:25.414188 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61392ef1-091b-413e-867a-24ec76c51956 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:25.425507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61392ef1-091b-413e-867a-24ec76c51956 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:25.430428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938af127-2176-471a-8b69-da651cb67eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:25.431720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938af127-2176-471a-8b69-da651cb67eee admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:25.432004 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938af127-2176-471a-8b69-da651cb67eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:25.432284 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938af127-2176-471a-8b69-da651cb67eee admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:25.432983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938af127-2176-471a-8b69-da651cb67eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:25.434928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938af127-2176-471a-8b69-da651cb67eee admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:25.471360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1407/2818] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:26:25 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:26:25.472515 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506003d8-7272-45e0-9c2c-eee1b5795d06 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:25.485797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506003d8-7272-45e0-9c2c-eee1b5795d06 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:25.547936 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fbb4c-2886-4cdc-b8d4-942ae3cfa252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:25.548608 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fbb4c-2886-4cdc-b8d4-942ae3cfa252 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:25.548886 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fbb4c-2886-4cdc-b8d4-942ae3cfa252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:25.549154 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fbb4c-2886-4cdc-b8d4-942ae3cfa252 admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:25.549840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fbb4c-2886-4cdc-b8d4-942ae3cfa252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:25.551817 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fbb4c-2886-4cdc-b8d4-942ae3cfa252 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:25.583161 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1412/2819] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:26:25 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:26:25.587706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938af127-2176-471a-8b69-da651cb67eee admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:25.598799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938af127-2176-471a-8b69-da651cb67eee admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:25.604072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1805c-c181-4838-adef-20ece0a2495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:25.604734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1805c-c181-4838-adef-20ece0a2495c admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:25.605019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1805c-c181-4838-adef-20ece0a2495c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:25.605288 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1805c-c181-4838-adef-20ece0a2495c admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:25.606009 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1805c-c181-4838-adef-20ece0a2495c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:25.607628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1805c-c181-4838-adef-20ece0a2495c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:25.618799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1408/2820] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:26:25.623117 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fbb4c-2886-4cdc-b8d4-942ae3cfa252 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:25.633786 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fbb4c-2886-4cdc-b8d4-942ae3cfa252 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:25.639176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2b89b-3b43-4187-9bd6-e83d906689e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:25.640097 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2b89b-3b43-4187-9bd6-e83d906689e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:25.640397 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2b89b-3b43-4187-9bd6-e83d906689e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:25.640661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2b89b-3b43-4187-9bd6-e83d906689e9 admin admin] PATH_INFO: `/v3/projects/670af3b564df48dfbb7f1a6ade9db917/users/cb336510da02476aa97df62b064c728f/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:25.656364 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2b89b-3b43-4187-9bd6-e83d906689e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670af3b564df48dfbb7f1a6ade9db917, user_id=cb336510da02476aa97df62b064c728f, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:25.659088 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2b89b-3b43-4187-9bd6-e83d906689e9 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:25.673551 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1413/2821] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:26:25 2022] PUT /identity/v3/projects/670af3b564df48dfbb7f1a6ade9db917/users/cb336510da02476aa97df62b064c728f/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:25.677456 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1805c-c181-4838-adef-20ece0a2495c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:25.688208 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1805c-c181-4838-adef-20ece0a2495c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:25.740064 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:25.748706 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b3236-db9c-4137-a4fd-1bc7ff5b61b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:25.749439 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3236-db9c-4137-a4fd-1bc7ff5b61b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:25.750055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3236-db9c-4137-a4fd-1bc7ff5b61b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:25.750338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3236-db9c-4137-a4fd-1bc7ff5b61b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:25.751384 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b3236-db9c-4137-a4fd-1bc7ff5b61b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:25.753157 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b3236-db9c-4137-a4fd-1bc7ff5b61b2 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:25.765184 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1409/2822] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:26:25.769969 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2b89b-3b43-4187-9bd6-e83d906689e9 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:25.781434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2b89b-3b43-4187-9bd6-e83d906689e9 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:25.786161 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a57ac2-9bf3-457f-9abb-9537b34313e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:25.787070 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a57ac2-9bf3-457f-9abb-9537b34313e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:25.787356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a57ac2-9bf3-457f-9abb-9537b34313e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:25.787631 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a57ac2-9bf3-457f-9abb-9537b34313e7 admin admin] PATH_INFO: `/v3/projects/670af3b564df48dfbb7f1a6ade9db917/users/cb336510da02476aa97df62b064c728f/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:25.789598 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a57ac2-9bf3-457f-9abb-9537b34313e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670af3b564df48dfbb7f1a6ade9db917, user_id=cb336510da02476aa97df62b064c728f, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:25.792888 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a57ac2-9bf3-457f-9abb-9537b34313e7 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:25.803467 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1414/2823] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:26:25 2022] PUT /identity/v3/projects/670af3b564df48dfbb7f1a6ade9db917/users/cb336510da02476aa97df62b064c728f/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:26.469535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac062ea2-cc5a-4198-a259-463ee0d9b75d None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:26.470003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac062ea2-cc5a-4198-a259-463ee0d9b75d None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:26.470165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac062ea2-cc5a-4198-a259-463ee0d9b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:26.502085 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-ac062ea2-cc5a-4198-a259-463ee0d9b75d None None] MFA Rules not processed for user `cb336510da02476aa97df62b064c728f`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:26.503572 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ac062ea2-cc5a-4198-a259-463ee0d9b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:26.592217 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1410/2824] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:26:26.604169 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a57ac2-9bf3-457f-9abb-9537b34313e7 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:26.605865 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-b1a57ac2-9bf3-457f-9abb-9537b34313e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:26.645880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:26.676056 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a57ac2-9bf3-457f-9abb-9537b34313e7 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:26.679933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445b636-f109-47db-86db-c2c6e75197f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:26.680581 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445b636-f109-47db-86db-c2c6e75197f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:26.680899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445b636-f109-47db-86db-c2c6e75197f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:26.681178 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445b636-f109-47db-86db-c2c6e75197f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:26.748955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445b636-f109-47db-86db-c2c6e75197f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:26.750415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445b636-f109-47db-86db-c2c6e75197f6 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:26.760963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1415/2825] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:26:28.163663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac062ea2-cc5a-4198-a259-463ee0d9b75d None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:28.166437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-ac062ea2-cc5a-4198-a259-463ee0d9b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:28.178749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac062ea2-cc5a-4198-a259-463ee0d9b75d None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:28.182485 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0cb15-f5a5-4caf-a270-3b7cf839f44c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:28.183179 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0cb15-f5a5-4caf-a270-3b7cf839f44c service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:28.183548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0cb15-f5a5-4caf-a270-3b7cf839f44c service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:28.183934 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0cb15-f5a5-4caf-a270-3b7cf839f44c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:28.193914 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0cb15-f5a5-4caf-a270-3b7cf839f44c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:28.195455 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0cb15-f5a5-4caf-a270-3b7cf839f44c service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:28.207939 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1411/2826] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:26:36.756311 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=33 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:38.202410 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=44 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:41.495965 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445b636-f109-47db-86db-c2c6e75197f6 service cinder] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:41.570801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445b636-f109-47db-86db-c2c6e75197f6 service cinder] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:41.575810 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:41.576695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:41.576978 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:41.577254 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] PATH_INFO: `/v3/users/e12204a05871450d8e190c2a3d9c4f67` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:41.578469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12204a05871450d8e190c2a3d9c4f67)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:41.580510 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:41.632188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12204a05871450d8e190c2a3d9c4f67'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:41.639481 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12204a05871450d8e190c2a3d9c4f67'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:41.640205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12204a05871450d8e190c2a3d9c4f67'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:41.640822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12204a05871450d8e190c2a3d9c4f67'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:41.655530 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12204a05871450d8e190c2a3d9c4f67'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:41.673783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1416/2827] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:26:41 2022] DELETE /identity/v3/users/e12204a05871450d8e190c2a3d9c4f67 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:41.884943 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0cb15-f5a5-4caf-a270-3b7cf839f44c service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:41.899942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0cb15-f5a5-4caf-a270-3b7cf839f44c service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:41.966743 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:41.967673 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:41.968000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:41.968315 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] PATH_INFO: `/v3/projects/41d9e73421fc48c3a9c18e170799c9a3` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:41.969681 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d9e73421fc48c3a9c18e170799c9a3)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:41.972427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:42.022602 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d9e73421fc48c3a9c18e170799c9a3', 'request_id': 'req-fd279e23-4c59-4f01-baae-a4cd96f9de2e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.030065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d9e73421fc48c3a9c18e170799c9a3', 'request_id': 'req-fd279e23-4c59-4f01-baae-a4cd96f9de2e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.035957 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d9e73421fc48c3a9c18e170799c9a3', 'request_id': 'req-fd279e23-4c59-4f01-baae-a4cd96f9de2e'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.058311 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] The token cache is being invalidate because project 41d9e73421fc48c3a9c18e170799c9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:26:42.058599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.059249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.060837 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1412/2828] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:26:41 2022] DELETE /identity/v3/projects/41d9e73421fc48c3a9c18e170799c9a3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:42.065323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:42.066940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:42.081573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9079092-8a40-4151-bc3d-d6aef7b8b1d2 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:42.161489 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa9a31-837e-4a9b-9a98-5671d6aa447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:42.162383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa9a31-837e-4a9b-9a98-5671d6aa447e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:42.162694 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa9a31-837e-4a9b-9a98-5671d6aa447e admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:42.162974 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa9a31-837e-4a9b-9a98-5671d6aa447e admin admin] PATH_INFO: `/v3/users/cb336510da02476aa97df62b064c728f` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:42.164341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa9a31-837e-4a9b-9a98-5671d6aa447e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb336510da02476aa97df62b064c728f)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:42.166436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa9a31-837e-4a9b-9a98-5671d6aa447e admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:42.191318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:42.227243 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1aaa9a31-837e-4a9b-9a98-5671d6aa447e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb336510da02476aa97df62b064c728f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.234291 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1aaa9a31-837e-4a9b-9a98-5671d6aa447e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb336510da02476aa97df62b064c728f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.235041 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1aaa9a31-837e-4a9b-9a98-5671d6aa447e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb336510da02476aa97df62b064c728f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.235668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1aaa9a31-837e-4a9b-9a98-5671d6aa447e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb336510da02476aa97df62b064c728f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.249132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-1aaa9a31-837e-4a9b-9a98-5671d6aa447e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb336510da02476aa97df62b064c728f'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.265063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1417/2829] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:26:42 2022] DELETE /identity/v3/users/cb336510da02476aa97df62b064c728f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:42.464304 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:42.465819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:42.480965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd279e23-4c59-4f01-baae-a4cd96f9de2e admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:42.558835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:42.559730 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:42.560013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:42.560300 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc admin admin] PATH_INFO: `/v3/projects/670af3b564df48dfbb7f1a6ade9db917` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:42.561952 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=670af3b564df48dfbb7f1a6ade9db917)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:42.564003 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:42.610801 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:42.625930 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670af3b564df48dfbb7f1a6ade9db917', 'request_id': 'req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.634380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670af3b564df48dfbb7f1a6ade9db917', 'request_id': 'req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.641332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670af3b564df48dfbb7f1a6ade9db917', 'request_id': 'req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.655787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc admin admin] The token cache is being invalidate because project 670af3b564df48dfbb7f1a6ade9db917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80270) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:26:42.656063 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.656682 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-ad22ad25-67c4-4cc9-be79-6717bf2b82cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:42.658239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1413/2830] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:26:42 2022] DELETE /identity/v3/projects/670af3b564df48dfbb7f1a6ade9db917 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:42.663310 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27f6ba-a15e-41cc-9fb9-2ed3b5c545c1 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:42.663884 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27f6ba-a15e-41cc-9fb9-2ed3b5c545c1 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:42.663884 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27f6ba-a15e-41cc-9fb9-2ed3b5c545c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:42.684307 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-7e27f6ba-a15e-41cc-9fb9-2ed3b5c545c1 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:42.685561 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-7e27f6ba-a15e-41cc-9fb9-2ed3b5c545c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:42.762757 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1418/2831] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:42.770782 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b934fcf-1fac-4978-a45e-d171c1bcb68f None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:42.771201 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b934fcf-1fac-4978-a45e-d171c1bcb68f None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:42.771555 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b934fcf-1fac-4978-a45e-d171c1bcb68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:42.792413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-0b934fcf-1fac-4978-a45e-d171c1bcb68f None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:42.793667 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0b934fcf-1fac-4978-a45e-d171c1bcb68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:42.802005 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1414/2832] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:42.811750 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27f6ba-a15e-41cc-9fb9-2ed3b5c545c1 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:42.818497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27f6ba-a15e-41cc-9fb9-2ed3b5c545c1 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:42.824328 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9f76e-bc0c-44e8-bcca-1605fcb30444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:42.825000 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9f76e-bc0c-44e8-bcca-1605fcb30444 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:42.825284 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9f76e-bc0c-44e8-bcca-1605fcb30444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:42.825564 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9f76e-bc0c-44e8-bcca-1605fcb30444 admin admin] PATH_INFO: `/v3/domains` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:42.826303 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9f76e-bc0c-44e8-bcca-1605fcb30444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:26:42.826607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9f76e-bc0c-44e8-bcca-1605fcb30444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:42.828245 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9f76e-bc0c-44e8-bcca-1605fcb30444 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:42.841433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1419/2833] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:26:42.845947 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b934fcf-1fac-4978-a45e-d171c1bcb68f None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:42.856616 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b934fcf-1fac-4978-a45e-d171c1bcb68f None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:42.861766 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdb1d9-b8ae-42a4-ab79-5b9a36d38a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:42.862480 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdb1d9-b8ae-42a4-ab79-5b9a36d38a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:42.862799 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdb1d9-b8ae-42a4-ab79-5b9a36d38a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:42.863077 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdb1d9-b8ae-42a4-ab79-5b9a36d38a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:42.863783 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdb1d9-b8ae-42a4-ab79-5b9a36d38a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:42.865737 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdb1d9-b8ae-42a4-ab79-5b9a36d38a4a admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:42.896676 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1415/2834] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:26:42 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:26:42.901748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9f76e-bc0c-44e8-bcca-1605fcb30444 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:42.912849 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9f76e-bc0c-44e8-bcca-1605fcb30444 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:42.976445 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90062ac9-0315-4cd7-857d-882d8aa8321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:42.977126 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90062ac9-0315-4cd7-857d-882d8aa8321a admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:42.977405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90062ac9-0315-4cd7-857d-882d8aa8321a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:42.977679 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90062ac9-0315-4cd7-857d-882d8aa8321a admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:42.978388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90062ac9-0315-4cd7-857d-882d8aa8321a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:42.980381 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90062ac9-0315-4cd7-857d-882d8aa8321a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:43.003167 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1420/2835] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:26:42 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:26:43.007865 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdb1d9-b8ae-42a4-ab79-5b9a36d38a4a admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:43.019784 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdb1d9-b8ae-42a4-ab79-5b9a36d38a4a admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:43.025086 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88503e66-6acf-4519-b162-de814f97dc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:43.025779 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88503e66-6acf-4519-b162-de814f97dc34 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:43.026067 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88503e66-6acf-4519-b162-de814f97dc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:43.026347 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88503e66-6acf-4519-b162-de814f97dc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:43.027133 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88503e66-6acf-4519-b162-de814f97dc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:43.028749 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88503e66-6acf-4519-b162-de814f97dc34 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:43.044840 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90062ac9-0315-4cd7-857d-882d8aa8321a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:43.051969 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1416/2836] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:26:43.056590 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90062ac9-0315-4cd7-857d-882d8aa8321a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:43.067104 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc7bef-d3c9-4a8e-bbbd-2ceb30cebe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:43.068147 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc7bef-d3c9-4a8e-bbbd-2ceb30cebe35 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:43.068610 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc7bef-d3c9-4a8e-bbbd-2ceb30cebe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:43.069063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc7bef-d3c9-4a8e-bbbd-2ceb30cebe35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:43.070327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc7bef-d3c9-4a8e-bbbd-2ceb30cebe35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:43.073782 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc7bef-d3c9-4a8e-bbbd-2ceb30cebe35 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:43.096159 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1421/2837] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:26:43.100539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88503e66-6acf-4519-b162-de814f97dc34 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:43.115336 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88503e66-6acf-4519-b162-de814f97dc34 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:43.120863 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345d9dd-71f9-4f93-a2df-2096bbf127c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:43.121769 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345d9dd-71f9-4f93-a2df-2096bbf127c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:43.122053 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345d9dd-71f9-4f93-a2df-2096bbf127c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:43.122334 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345d9dd-71f9-4f93-a2df-2096bbf127c8 admin admin] PATH_INFO: `/v3/projects/f3e72ba337ec40a585f511436c1f12bf/users/0c64aab9be0140e28a637bba81747754/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:43.140812 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345d9dd-71f9-4f93-a2df-2096bbf127c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e72ba337ec40a585f511436c1f12bf, user_id=0c64aab9be0140e28a637bba81747754, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:43.146113 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345d9dd-71f9-4f93-a2df-2096bbf127c8 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:43.162672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1417/2838] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:26:43 2022] PUT /identity/v3/projects/f3e72ba337ec40a585f511436c1f12bf/users/0c64aab9be0140e28a637bba81747754/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:43.173662 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87005340-e72e-48e1-92ec-b0a4c218a38b None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:43.173956 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87005340-e72e-48e1-92ec-b0a4c218a38b None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:43.174263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87005340-e72e-48e1-92ec-b0a4c218a38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:43.182520 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:43.205779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-87005340-e72e-48e1-92ec-b0a4c218a38b None None] MFA Rules not processed for user `0c64aab9be0140e28a637bba81747754`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:43.207054 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-87005340-e72e-48e1-92ec-b0a4c218a38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:43.276819 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1422/2839] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:43.281898 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345d9dd-71f9-4f93-a2df-2096bbf127c8 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:43.347816 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345d9dd-71f9-4f93-a2df-2096bbf127c8 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:43.353993 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111e58a-55fd-43fc-a485-78ad0100ed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:43.354731 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111e58a-55fd-43fc-a485-78ad0100ed67 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:43.355021 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111e58a-55fd-43fc-a485-78ad0100ed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:43.355302 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111e58a-55fd-43fc-a485-78ad0100ed67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:43.356029 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111e58a-55fd-43fc-a485-78ad0100ed67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:43.358069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111e58a-55fd-43fc-a485-78ad0100ed67 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:43.388750 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1418/2840] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:26:43 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:26:43.392763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87005340-e72e-48e1-92ec-b0a4c218a38b None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:43.405141 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87005340-e72e-48e1-92ec-b0a4c218a38b None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:43.470805 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c66fe-55bb-472c-b387-8e1cc1e0265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:43.471493 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c66fe-55bb-472c-b387-8e1cc1e0265a admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:43.471781 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c66fe-55bb-472c-b387-8e1cc1e0265a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:43.472063 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c66fe-55bb-472c-b387-8e1cc1e0265a admin admin] PATH_INFO: `/v3/users` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:43.472762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c66fe-55bb-472c-b387-8e1cc1e0265a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:43.474758 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c66fe-55bb-472c-b387-8e1cc1e0265a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:43.501430 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1423/2841] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:26:43 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:26:43.502636 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111e58a-55fd-43fc-a485-78ad0100ed67 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:43.513772 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111e58a-55fd-43fc-a485-78ad0100ed67 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:43.518403 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0eae1a-d357-4b3f-98c9-c70e408c9a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:43.519108 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0eae1a-d357-4b3f-98c9-c70e408c9a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:43.519391 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0eae1a-d357-4b3f-98c9-c70e408c9a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:43.519669 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0eae1a-d357-4b3f-98c9-c70e408c9a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:43.520394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0eae1a-d357-4b3f-98c9-c70e408c9a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:43.521976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0eae1a-d357-4b3f-98c9-c70e408c9a54 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:43.534035 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1419/2842] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:26:43.538201 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c66fe-55bb-472c-b387-8e1cc1e0265a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:43.548871 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c66fe-55bb-472c-b387-8e1cc1e0265a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:43.553490 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e48e0-4c39-4ebd-b642-bc98059b8b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:43.554360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e48e0-4c39-4ebd-b642-bc98059b8b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:43.554668 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e48e0-4c39-4ebd-b642-bc98059b8b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:43.554951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e48e0-4c39-4ebd-b642-bc98059b8b00 admin admin] PATH_INFO: `/v3/projects/60a4f320487145448a657646fc11bc6b/users/c13f93f3334f4438bfa3010ba4120ed9/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:43.569625 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e48e0-4c39-4ebd-b642-bc98059b8b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a4f320487145448a657646fc11bc6b, user_id=c13f93f3334f4438bfa3010ba4120ed9, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:43.572420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e48e0-4c39-4ebd-b642-bc98059b8b00 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:43.585746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1424/2843] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:26:43 2022] PUT /identity/v3/projects/60a4f320487145448a657646fc11bc6b/users/c13f93f3334f4438bfa3010ba4120ed9/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:43.590487 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0eae1a-d357-4b3f-98c9-c70e408c9a54 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:43.600631 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0eae1a-d357-4b3f-98c9-c70e408c9a54 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:43.631061 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:43.661091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32ffb7-076e-4cb3-93f3-7177b7163229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:43.661754 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32ffb7-076e-4cb3-93f3-7177b7163229 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:43.662038 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32ffb7-076e-4cb3-93f3-7177b7163229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:43.662334 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32ffb7-076e-4cb3-93f3-7177b7163229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:43.663080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32ffb7-076e-4cb3-93f3-7177b7163229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:43.665802 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32ffb7-076e-4cb3-93f3-7177b7163229 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:43.675696 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1420/2844] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:26:43.679967 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e48e0-4c39-4ebd-b642-bc98059b8b00 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:43.690376 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e48e0-4c39-4ebd-b642-bc98059b8b00 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:43.694953 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee7892-ccf4-4855-9152-0d6e9e1980f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:43.695836 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee7892-ccf4-4855-9152-0d6e9e1980f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:43.696115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee7892-ccf4-4855-9152-0d6e9e1980f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:43.696391 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee7892-ccf4-4855-9152-0d6e9e1980f8 admin admin] PATH_INFO: `/v3/projects/60a4f320487145448a657646fc11bc6b/users/c13f93f3334f4438bfa3010ba4120ed9/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:43.698367 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee7892-ccf4-4855-9152-0d6e9e1980f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a4f320487145448a657646fc11bc6b, user_id=c13f93f3334f4438bfa3010ba4120ed9, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:43.701042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee7892-ccf4-4855-9152-0d6e9e1980f8 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:43.712433 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1425/2845] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:26:43 2022] PUT /identity/v3/projects/60a4f320487145448a657646fc11bc6b/users/c13f93f3334f4438bfa3010ba4120ed9/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:43.723456 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988c8dc-3bec-42fc-a80d-80f89826faa2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:43.723678 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988c8dc-3bec-42fc-a80d-80f89826faa2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:43.723957 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988c8dc-3bec-42fc-a80d-80f89826faa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:43.752492 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-6988c8dc-3bec-42fc-a80d-80f89826faa2 None None] MFA Rules not processed for user `c13f93f3334f4438bfa3010ba4120ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:43.753786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-6988c8dc-3bec-42fc-a80d-80f89826faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:43.833124 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1421/2846] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:43.845409 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee7892-ccf4-4855-9152-0d6e9e1980f8 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:43.847152 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-90ee7892-ccf4-4855-9152-0d6e9e1980f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:43.903338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:43.909440 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee7892-ccf4-4855-9152-0d6e9e1980f8 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:43.913770 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6ef63-1b8e-44b8-b767-f50ed9458591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:43.915502 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6ef63-1b8e-44b8-b767-f50ed9458591 service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:43.915985 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6ef63-1b8e-44b8-b767-f50ed9458591 service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:43.917880 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6ef63-1b8e-44b8-b767-f50ed9458591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:43.980028 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6ef63-1b8e-44b8-b767-f50ed9458591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:43.981397 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6ef63-1b8e-44b8-b767-f50ed9458591 service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:43.990649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1426/2847] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:26:46.614857 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988c8dc-3bec-42fc-a80d-80f89826faa2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:46.702728 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988c8dc-3bec-42fc-a80d-80f89826faa2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:46.708870 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:46.709777 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:46.710060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:46.710352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] PATH_INFO: `/v3/users/0c64aab9be0140e28a637bba81747754` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:46.712295 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c64aab9be0140e28a637bba81747754)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:46.714297 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:46.765916 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c64aab9be0140e28a637bba81747754'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:46.771482 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:46.774082 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c64aab9be0140e28a637bba81747754'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:46.784815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c64aab9be0140e28a637bba81747754'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:46.785815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c64aab9be0140e28a637bba81747754'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:46.786823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c64aab9be0140e28a637bba81747754'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:46.812195 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1422/2848] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:26:46 2022] DELETE /identity/v3/users/0c64aab9be0140e28a637bba81747754 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:46.817208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374c171-8742-462c-a640-6081fd35f3d1 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:46.817728 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374c171-8742-462c-a640-6081fd35f3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:46.817834 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374c171-8742-462c-a640-6081fd35f3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:46.835418 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-1374c171-8742-462c-a640-6081fd35f3d1 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:46.838542 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1374c171-8742-462c-a640-6081fd35f3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:46.897783 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1427/2849] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:26:46.913126 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:46.915331 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:46.983055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc83266-f897-430e-a044-84c45ade608d admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:46.986760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f53d7-2290-486a-9640-9d33273193c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:46.987402 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f53d7-2290-486a-9640-9d33273193c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:46.987684 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f53d7-2290-486a-9640-9d33273193c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:46.987960 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f53d7-2290-486a-9640-9d33273193c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:46.998050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f53d7-2290-486a-9640-9d33273193c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:46.999531 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f53d7-2290-486a-9640-9d33273193c5 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:47.010563 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1423/2850] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:26:47.287341 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374c171-8742-462c-a640-6081fd35f3d1 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:47.288900 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-1374c171-8742-462c-a640-6081fd35f3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:47.304327 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374c171-8742-462c-a640-6081fd35f3d1 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:47.309938 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:47.310901 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:47.311105 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:47.311372 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] PATH_INFO: `/v3/projects/f3e72ba337ec40a585f511436c1f12bf` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:47.312661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e72ba337ec40a585f511436c1f12bf)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:47.314515 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:47.365069 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e72ba337ec40a585f511436c1f12bf', 'request_id': 'req-74033382-0a1b-4b33-ad13-8343eb3b005a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:47.373001 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e72ba337ec40a585f511436c1f12bf', 'request_id': 'req-74033382-0a1b-4b33-ad13-8343eb3b005a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:47.379674 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e72ba337ec40a585f511436c1f12bf', 'request_id': 'req-74033382-0a1b-4b33-ad13-8343eb3b005a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:47.390550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] The token cache is being invalidate because project f3e72ba337ec40a585f511436c1f12bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:26:47.390866 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:47.391512 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:47.393083 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1428/2851] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:26:47 2022] DELETE /identity/v3/projects/f3e72ba337ec40a585f511436c1f12bf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:47.397062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f53d7-2290-486a-9640-9d33273193c5 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:47.407835 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f53d7-2290-486a-9640-9d33273193c5 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:47.469789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40898991-63cf-4afb-9f21-d98fe658b85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:47.470686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40898991-63cf-4afb-9f21-d98fe658b85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:47.470966 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40898991-63cf-4afb-9f21-d98fe658b85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:47.471238 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40898991-63cf-4afb-9f21-d98fe658b85f admin admin] PATH_INFO: `/v3/users/c13f93f3334f4438bfa3010ba4120ed9` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:47.472456 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40898991-63cf-4afb-9f21-d98fe658b85f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c13f93f3334f4438bfa3010ba4120ed9)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:47.474382 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40898991-63cf-4afb-9f21-d98fe658b85f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:47.532477 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-40898991-63cf-4afb-9f21-d98fe658b85f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c13f93f3334f4438bfa3010ba4120ed9'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:47.539513 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-40898991-63cf-4afb-9f21-d98fe658b85f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c13f93f3334f4438bfa3010ba4120ed9'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:47.547535 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-40898991-63cf-4afb-9f21-d98fe658b85f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c13f93f3334f4438bfa3010ba4120ed9'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:47.548159 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-40898991-63cf-4afb-9f21-d98fe658b85f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c13f93f3334f4438bfa3010ba4120ed9'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:47.548760 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-40898991-63cf-4afb-9f21-d98fe658b85f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c13f93f3334f4438bfa3010ba4120ed9'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:47.560511 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:47.575490 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1424/2852] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:26:47 2022] DELETE /identity/v3/users/c13f93f3334f4438bfa3010ba4120ed9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:47.892677 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:47.894146 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:47.910318 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74033382-0a1b-4b33-ad13-8343eb3b005a admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:47.939881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:48.004940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe194f-444a-4560-a848-b5f2ba03fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:48.005828 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe194f-444a-4560-a848-b5f2ba03fc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:48.006115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe194f-444a-4560-a848-b5f2ba03fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:48.006395 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe194f-444a-4560-a848-b5f2ba03fc9a admin admin] PATH_INFO: `/v3/projects/60a4f320487145448a657646fc11bc6b` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:48.007718 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe194f-444a-4560-a848-b5f2ba03fc9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a4f320487145448a657646fc11bc6b)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:48.009663 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe194f-444a-4560-a848-b5f2ba03fc9a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:48.069669 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-90fe194f-444a-4560-a848-b5f2ba03fc9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a4f320487145448a657646fc11bc6b', 'request_id': 'req-90fe194f-444a-4560-a848-b5f2ba03fc9a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:48.077844 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-90fe194f-444a-4560-a848-b5f2ba03fc9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a4f320487145448a657646fc11bc6b', 'request_id': 'req-90fe194f-444a-4560-a848-b5f2ba03fc9a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:48.084292 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-90fe194f-444a-4560-a848-b5f2ba03fc9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a4f320487145448a657646fc11bc6b', 'request_id': 'req-90fe194f-444a-4560-a848-b5f2ba03fc9a'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:48.095421 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-90fe194f-444a-4560-a848-b5f2ba03fc9a admin admin] The token cache is being invalidate because project 60a4f320487145448a657646fc11bc6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:26:48.095703 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-90fe194f-444a-4560-a848-b5f2ba03fc9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:48.096347 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-90fe194f-444a-4560-a848-b5f2ba03fc9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:26:48.097890 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1429/2853] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:26:47 2022] DELETE /identity/v3/projects/60a4f320487145448a657646fc11bc6b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:48.105028 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6b644-97b4-4812-bdf8-7c76a7c773da None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:48.105793 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6b644-97b4-4812-bdf8-7c76a7c773da None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:48.106014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6b644-97b4-4812-bdf8-7c76a7c773da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:48.124687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-9fb6b644-97b4-4812-bdf8-7c76a7c773da None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:48.125886 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-9fb6b644-97b4-4812-bdf8-7c76a7c773da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:48.186249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1425/2854] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:48.194175 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9995670-8400-4bd5-a5ad-04d7d3567b0c None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:48.194464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9995670-8400-4bd5-a5ad-04d7d3567b0c None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:48.194789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9995670-8400-4bd5-a5ad-04d7d3567b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:48.213832 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-f9995670-8400-4bd5-a5ad-04d7d3567b0c None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:48.215093 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-f9995670-8400-4bd5-a5ad-04d7d3567b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:48.222947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1430/2855] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:48.227828 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6b644-97b4-4812-bdf8-7c76a7c773da None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:48.237612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6b644-97b4-4812-bdf8-7c76a7c773da None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:48.242155 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646fc8e-493d-4f4b-bf8e-7eb8a7fc6fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:48.242897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646fc8e-493d-4f4b-bf8e-7eb8a7fc6fba admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:48.243228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646fc8e-493d-4f4b-bf8e-7eb8a7fc6fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:48.243502 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646fc8e-493d-4f4b-bf8e-7eb8a7fc6fba admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:48.244232 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646fc8e-493d-4f4b-bf8e-7eb8a7fc6fba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:26:48.244538 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646fc8e-493d-4f4b-bf8e-7eb8a7fc6fba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:48.246142 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646fc8e-493d-4f4b-bf8e-7eb8a7fc6fba admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:48.258427 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1426/2856] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:26:48.262905 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9995670-8400-4bd5-a5ad-04d7d3567b0c None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:48.272364 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9995670-8400-4bd5-a5ad-04d7d3567b0c None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:48.277977 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a366-4c94-4daf-a115-a8f5664cf151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:48.278670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a366-4c94-4daf-a115-a8f5664cf151 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:48.278963 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a366-4c94-4daf-a115-a8f5664cf151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:48.279244 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a366-4c94-4daf-a115-a8f5664cf151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:48.279951 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078a366-4c94-4daf-a115-a8f5664cf151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:48.281889 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078a366-4c94-4daf-a115-a8f5664cf151 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:48.309681 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1431/2857] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:26:48 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:26:48.314014 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646fc8e-493d-4f4b-bf8e-7eb8a7fc6fba admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:48.324495 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646fc8e-493d-4f4b-bf8e-7eb8a7fc6fba admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:48.399866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cf891-cc23-4ac0-886d-8189a8bb5018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:48.400548 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cf891-cc23-4ac0-886d-8189a8bb5018 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:48.400877 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cf891-cc23-4ac0-886d-8189a8bb5018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:48.401153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cf891-cc23-4ac0-886d-8189a8bb5018 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:48.402019 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3cf891-cc23-4ac0-886d-8189a8bb5018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:48.404030 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3cf891-cc23-4ac0-886d-8189a8bb5018 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:48.428190 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1427/2858] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:26:48 2022] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:26:48.432176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a366-4c94-4daf-a115-a8f5664cf151 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:48.442431 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a366-4c94-4daf-a115-a8f5664cf151 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:48.454042 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe64097-ab23-4361-adad-d0ae18c8afa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:48.454749 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe64097-ab23-4361-adad-d0ae18c8afa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:48.455032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe64097-ab23-4361-adad-d0ae18c8afa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:48.455304 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe64097-ab23-4361-adad-d0ae18c8afa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:48.456058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe64097-ab23-4361-adad-d0ae18c8afa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:48.457658 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe64097-ab23-4361-adad-d0ae18c8afa5 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:48.470389 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1432/2859] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:26:48.474467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cf891-cc23-4ac0-886d-8189a8bb5018 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:48.484789 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cf891-cc23-4ac0-886d-8189a8bb5018 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:48.489531 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8886107-4ca7-471f-82cd-774aaa17f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:48.490193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8886107-4ca7-471f-82cd-774aaa17f2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:48.490481 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8886107-4ca7-471f-82cd-774aaa17f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:48.490806 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8886107-4ca7-471f-82cd-774aaa17f2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:48.491539 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8886107-4ca7-471f-82cd-774aaa17f2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:48.493357 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8886107-4ca7-471f-82cd-774aaa17f2b0 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:48.503756 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1428/2860] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:26:48.508799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe64097-ab23-4361-adad-d0ae18c8afa5 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:48.519106 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe64097-ab23-4361-adad-d0ae18c8afa5 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:48.524443 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31416387-be1e-452e-979e-ff7b214e5c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:48.525321 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416387-be1e-452e-979e-ff7b214e5c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:48.525603 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416387-be1e-452e-979e-ff7b214e5c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:48.525878 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416387-be1e-452e-979e-ff7b214e5c1d admin admin] PATH_INFO: `/v3/projects/5028b206a3734117885cd6696233cebf/users/56625b58ddf34746a019eacb20cd8b4c/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:48.541352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31416387-be1e-452e-979e-ff7b214e5c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5028b206a3734117885cd6696233cebf, user_id=56625b58ddf34746a019eacb20cd8b4c, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:48.544115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31416387-be1e-452e-979e-ff7b214e5c1d admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:48.558894 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1433/2861] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:26:48 2022] PUT /identity/v3/projects/5028b206a3734117885cd6696233cebf/users/56625b58ddf34746a019eacb20cd8b4c/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:26:48.571843 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633788-3a0b-4dcc-85f6-582f335fd1d9 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:48.572294 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633788-3a0b-4dcc-85f6-582f335fd1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:48.572663 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633788-3a0b-4dcc-85f6-582f335fd1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:48.601072 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-b4633788-3a0b-4dcc-85f6-582f335fd1d9 None None] MFA Rules not processed for user `56625b58ddf34746a019eacb20cd8b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:26:48.602298 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-b4633788-3a0b-4dcc-85f6-582f335fd1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:48.650080 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:48.669194 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1429/2862] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:26:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:26:48.679924 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31416387-be1e-452e-979e-ff7b214e5c1d admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:26:48.681672 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-31416387-be1e-452e-979e-ff7b214e5c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:26:48.741135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31416387-be1e-452e-979e-ff7b214e5c1d admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:26:48.745017 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec871de-1ddb-4702-a599-60116b33971b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:26:48.745661 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec871de-1ddb-4702-a599-60116b33971b service cinder] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:26:48.745940 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec871de-1ddb-4702-a599-60116b33971b service cinder] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:26:48.746213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec871de-1ddb-4702-a599-60116b33971b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:26:48.751478 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:48.756513 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec871de-1ddb-4702-a599-60116b33971b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:26:48.759435 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec871de-1ddb-4702-a599-60116b33971b service cinder] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:26:48.770260 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1434/2863] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:26:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:26:58.666273 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:26:58.765918 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:05.223656 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4633788-3a0b-4dcc-85f6-582f335fd1d9 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:05.295069 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4633788-3a0b-4dcc-85f6-582f335fd1d9 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:05.299813 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:05.300729 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:05.301093 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:05.301419 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] PATH_INFO: `/v3/users/56625b58ddf34746a019eacb20cd8b4c` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:05.302715 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] RBAC: Authorizing `identity:delete_user(user_id=56625b58ddf34746a019eacb20cd8b4c)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:05.305243 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:05.358373 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56625b58ddf34746a019eacb20cd8b4c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:27:05.371523 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56625b58ddf34746a019eacb20cd8b4c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:27:05.380249 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56625b58ddf34746a019eacb20cd8b4c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:27:05.380938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56625b58ddf34746a019eacb20cd8b4c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:27:05.381570 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56625b58ddf34746a019eacb20cd8b4c'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:27:05.399765 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1430/2864] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:27:05 2022] DELETE /identity/v3/users/56625b58ddf34746a019eacb20cd8b4c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:27:05.404383 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6924cb-3c8a-4d66-a91b-978ae5f12418 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:05.404976 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6924cb-3c8a-4d66-a91b-978ae5f12418 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:05.404976 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6924cb-3c8a-4d66-a91b-978ae5f12418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:05.423400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-6c6924cb-3c8a-4d66-a91b-978ae5f12418 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:27:05.424801 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6c6924cb-3c8a-4d66-a91b-978ae5f12418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:05.486837 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1435/2865] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:27:05.497907 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:05.499360 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:05.559114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bc45e-1a06-4d76-9095-fb500ed6920c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:05.562972 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17e5ce-3046-4ca6-97e1-add1be481389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:05.563618 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17e5ce-3046-4ca6-97e1-add1be481389 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:05.563904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17e5ce-3046-4ca6-97e1-add1be481389 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:05.564180 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17e5ce-3046-4ca6-97e1-add1be481389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:05.577081 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17e5ce-3046-4ca6-97e1-add1be481389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:05.578580 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17e5ce-3046-4ca6-97e1-add1be481389 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:05.589377 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1431/2866] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:27:05.882300 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6924cb-3c8a-4d66-a91b-978ae5f12418 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:05.883774 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-6c6924cb-3c8a-4d66-a91b-978ae5f12418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:05.896446 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6924cb-3c8a-4d66-a91b-978ae5f12418 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:05.902187 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8954cd6-09c4-4443-a975-28483b0ea167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:05.903149 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8954cd6-09c4-4443-a975-28483b0ea167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:05.903484 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8954cd6-09c4-4443-a975-28483b0ea167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:05.903708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8954cd6-09c4-4443-a975-28483b0ea167 admin admin] PATH_INFO: `/v3/projects/5028b206a3734117885cd6696233cebf` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:05.904960 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8954cd6-09c4-4443-a975-28483b0ea167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5028b206a3734117885cd6696233cebf)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:05.907420 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8954cd6-09c4-4443-a975-28483b0ea167 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:05.967237 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a8954cd6-09c4-4443-a975-28483b0ea167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5028b206a3734117885cd6696233cebf', 'request_id': 'req-a8954cd6-09c4-4443-a975-28483b0ea167'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:27:05.976128 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a8954cd6-09c4-4443-a975-28483b0ea167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5028b206a3734117885cd6696233cebf', 'request_id': 'req-a8954cd6-09c4-4443-a975-28483b0ea167'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:27:05.983196 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a8954cd6-09c4-4443-a975-28483b0ea167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5028b206a3734117885cd6696233cebf', 'request_id': 'req-a8954cd6-09c4-4443-a975-28483b0ea167'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:27:05.994854 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a8954cd6-09c4-4443-a975-28483b0ea167 admin admin] The token cache is being invalidate because project 5028b206a3734117885cd6696233cebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:27:05.995045 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a8954cd6-09c4-4443-a975-28483b0ea167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:27:05.995619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a8954cd6-09c4-4443-a975-28483b0ea167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:27:05.997160 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1436/2867] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:27:05 2022] DELETE /identity/v3/projects/5028b206a3734117885cd6696233cebf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:27:06.002263 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2aeab3-4e52-47fd-84a8-e5d6860a7a5a None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:06.002551 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2aeab3-4e52-47fd-84a8-e5d6860a7a5a None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:06.002874 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2aeab3-4e52-47fd-84a8-e5d6860a7a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:06.021091 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-7e2aeab3-4e52-47fd-84a8-e5d6860a7a5a None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:27:06.022329 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-7e2aeab3-4e52-47fd-84a8-e5d6860a7a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:06.041905 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:06.087606 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1432/2868] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:27:06.151743 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f619c1-7803-4653-97aa-5ff8f14d13f2 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:06.152060 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f619c1-7803-4653-97aa-5ff8f14d13f2 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:06.152344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f619c1-7803-4653-97aa-5ff8f14d13f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:06.174092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-24f619c1-7803-4653-97aa-5ff8f14d13f2 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:27:06.176032 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-24f619c1-7803-4653-97aa-5ff8f14d13f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:06.187855 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1437/2869] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:27:06.192107 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2aeab3-4e52-47fd-84a8-e5d6860a7a5a None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:06.202928 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2aeab3-4e52-47fd-84a8-e5d6860a7a5a None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:06.207625 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785208f2-ef5b-43b8-841f-31cb59cca690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:06.208285 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785208f2-ef5b-43b8-841f-31cb59cca690 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:06.208568 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785208f2-ef5b-43b8-841f-31cb59cca690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:06.208844 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785208f2-ef5b-43b8-841f-31cb59cca690 admin admin] PATH_INFO: `/v3/domains` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:06.209571 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785208f2-ef5b-43b8-841f-31cb59cca690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80270) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 08:27:06.209880 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785208f2-ef5b-43b8-841f-31cb59cca690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:06.212174 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785208f2-ef5b-43b8-841f-31cb59cca690 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:06.224406 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1433/2870] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 08:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 08:27:06.228800 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f619c1-7803-4653-97aa-5ff8f14d13f2 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:06.238351 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f619c1-7803-4653-97aa-5ff8f14d13f2 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:06.243848 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057b4cc-49af-43e1-94b0-c872b4697472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:06.244500 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057b4cc-49af-43e1-94b0-c872b4697472 admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:06.244788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057b4cc-49af-43e1-94b0-c872b4697472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:06.245199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057b4cc-49af-43e1-94b0-c872b4697472 admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:06.245841 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057b4cc-49af-43e1-94b0-c872b4697472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:06.247785 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057b4cc-49af-43e1-94b0-c872b4697472 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:06.274326 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1438/2871] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:27:06 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:27:06.278552 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785208f2-ef5b-43b8-841f-31cb59cca690 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:06.288599 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785208f2-ef5b-43b8-841f-31cb59cca690 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:06.351327 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf8088-93e9-41e5-bdaf-281d0bb8f20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:06.352000 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf8088-93e9-41e5-bdaf-281d0bb8f20f admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:06.352283 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf8088-93e9-41e5-bdaf-281d0bb8f20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:06.352559 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf8088-93e9-41e5-bdaf-281d0bb8f20f admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:06.353265 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf8088-93e9-41e5-bdaf-281d0bb8f20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:06.355267 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf8088-93e9-41e5-bdaf-281d0bb8f20f admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:06.377761 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1434/2872] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:27:06 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:27:06.382807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057b4cc-49af-43e1-94b0-c872b4697472 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:06.393727 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057b4cc-49af-43e1-94b0-c872b4697472 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:06.398731 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac11b2-d152-4564-9c06-b1732e7c1293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:06.399405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac11b2-d152-4564-9c06-b1732e7c1293 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:06.399708 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac11b2-d152-4564-9c06-b1732e7c1293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:06.400073 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac11b2-d152-4564-9c06-b1732e7c1293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:06.400811 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac11b2-d152-4564-9c06-b1732e7c1293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:06.402436 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac11b2-d152-4564-9c06-b1732e7c1293 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:06.414199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1439/2873] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 08:27:06.418642 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf8088-93e9-41e5-bdaf-281d0bb8f20f admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:06.430823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf8088-93e9-41e5-bdaf-281d0bb8f20f admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:06.435446 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f52c08-8e4b-43fb-9960-0775e65fcb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:06.436099 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f52c08-8e4b-43fb-9960-0775e65fcb64 admin admin] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:06.436380 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f52c08-8e4b-43fb-9960-0775e65fcb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:06.436659 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f52c08-8e4b-43fb-9960-0775e65fcb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:06.437379 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f52c08-8e4b-43fb-9960-0775e65fcb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:06.438994 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f52c08-8e4b-43fb-9960-0775e65fcb64 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:06.449123 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1435/2874] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:27:06.453450 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac11b2-d152-4564-9c06-b1732e7c1293 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:06.463527 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac11b2-d152-4564-9c06-b1732e7c1293 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:06.468230 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf6dec-7f53-4333-8ed1-38ac36290288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:06.469120 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf6dec-7f53-4333-8ed1-38ac36290288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:06.469399 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf6dec-7f53-4333-8ed1-38ac36290288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:06.469739 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf6dec-7f53-4333-8ed1-38ac36290288 admin admin] PATH_INFO: `/v3/projects/b65afb27ab304161aaa6aabe73c1c58e/users/7c428bd4817a40de8a378aa0935ae764/roles/9eb3c16b00c04e1c850bab61de15c44c` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:06.484716 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf6dec-7f53-4333-8ed1-38ac36290288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65afb27ab304161aaa6aabe73c1c58e, user_id=7c428bd4817a40de8a378aa0935ae764, role_id=9eb3c16b00c04e1c850bab61de15c44c)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:06.487649 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf6dec-7f53-4333-8ed1-38ac36290288 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:06.503418 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1440/2875] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:27:06 2022] PUT /identity/v3/projects/b65afb27ab304161aaa6aabe73c1c58e/users/7c428bd4817a40de8a378aa0935ae764/roles/9eb3c16b00c04e1c850bab61de15c44c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:27:06.508652 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb090292-8c4b-4814-8adb-892ecaaf1779 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:06.508938 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb090292-8c4b-4814-8adb-892ecaaf1779 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:06.509222 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb090292-8c4b-4814-8adb-892ecaaf1779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:06.527704 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-cb090292-8c4b-4814-8adb-892ecaaf1779 None None] MFA Rules not processed for user `5f407cfabb074543a5e85c709d5e3a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:27:06.528911 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-cb090292-8c4b-4814-8adb-892ecaaf1779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:06.591496 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1436/2876] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 08:27:06.601856 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf6dec-7f53-4333-8ed1-38ac36290288 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:06.603726 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-babf6dec-7f53-4333-8ed1-38ac36290288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:06.625949 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:06.664024 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf6dec-7f53-4333-8ed1-38ac36290288 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:06.667697 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7d8d0-4b79-43cb-b3eb-685aea9069da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:06.668356 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7d8d0-4b79-43cb-b3eb-685aea9069da service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:06.668635 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7d8d0-4b79-43cb-b3eb-685aea9069da service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:06.668904 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7d8d0-4b79-43cb-b3eb-685aea9069da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:06.677921 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7d8d0-4b79-43cb-b3eb-685aea9069da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:06.680023 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7d8d0-4b79-43cb-b3eb-685aea9069da service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:06.689488 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1441/2877] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:27:10.987120 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a15594-6b65-44a1-a720-816db7ae15e2 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:10.987666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a15594-6b65-44a1-a720-816db7ae15e2 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:10.987666 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a15594-6b65-44a1-a720-816db7ae15e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:11.018332 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-46a15594-6b65-44a1-a720-816db7ae15e2 None None] MFA Rules not processed for user `7c428bd4817a40de8a378aa0935ae764`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:27:11.019660 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-46a15594-6b65-44a1-a720-816db7ae15e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:11.042787 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:11.097517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1437/2878] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:27:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:27:11.102607 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7d8d0-4b79-43cb-b3eb-685aea9069da service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:11.112694 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7d8d0-4b79-43cb-b3eb-685aea9069da service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:11.118046 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45146b-eea9-4f02-afd2-ece23b9699eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:11.118843 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45146b-eea9-4f02-afd2-ece23b9699eb admin admin] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:11.119224 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45146b-eea9-4f02-afd2-ece23b9699eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:11.119619 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45146b-eea9-4f02-afd2-ece23b9699eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:11.120323 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45146b-eea9-4f02-afd2-ece23b9699eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:11.122263 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45146b-eea9-4f02-afd2-ece23b9699eb admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:11.157115 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1442/2879] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 08:27:11 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 08:27:11.161173 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a15594-6b65-44a1-a720-816db7ae15e2 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:11.173847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a15594-6b65-44a1-a720-816db7ae15e2 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:11.234325 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad231a-9ce4-467f-8ea3-945f9fe1bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:11.234827 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad231a-9ce4-467f-8ea3-945f9fe1bd34 admin admin] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:11.235117 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad231a-9ce4-467f-8ea3-945f9fe1bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:11.235394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad231a-9ce4-467f-8ea3-945f9fe1bd34 admin admin] PATH_INFO: `/v3/users` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:11.236149 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad231a-9ce4-467f-8ea3-945f9fe1bd34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:11.238067 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad231a-9ce4-467f-8ea3-945f9fe1bd34 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:11.264619 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1438/2880] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 08:27:11 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 08:27:11.268610 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45146b-eea9-4f02-afd2-ece23b9699eb admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:11.285388 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45146b-eea9-4f02-afd2-ece23b9699eb admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:11.290748 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fc757-129e-4ae4-a7f7-40bd54fb6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:11.291402 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fc757-129e-4ae4-a7f7-40bd54fb6474 admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:11.291672 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fc757-129e-4ae4-a7f7-40bd54fb6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:11.291949 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fc757-129e-4ae4-a7f7-40bd54fb6474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:11.292670 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fc757-129e-4ae4-a7f7-40bd54fb6474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:11.294273 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fc757-129e-4ae4-a7f7-40bd54fb6474 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:11.305608 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1443/2881] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:27:11.309883 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad231a-9ce4-467f-8ea3-945f9fe1bd34 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:11.321055 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad231a-9ce4-467f-8ea3-945f9fe1bd34 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:11.326516 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478839d5-2a0c-42b5-89d5-a1cf3a1e44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:11.327454 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478839d5-2a0c-42b5-89d5-a1cf3a1e44df admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:11.327734 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478839d5-2a0c-42b5-89d5-a1cf3a1e44df admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:11.328010 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478839d5-2a0c-42b5-89d5-a1cf3a1e44df admin admin] PATH_INFO: `/v3/projects/493d59fefb1e479a83854947d84e20eb/users/88f0b827101548fc87db6ff7cf4953b6/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:11.345639 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478839d5-2a0c-42b5-89d5-a1cf3a1e44df admin admin] RBAC: Authorizing `identity:create_grant(project_id=493d59fefb1e479a83854947d84e20eb, user_id=88f0b827101548fc87db6ff7cf4953b6, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:11.348394 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478839d5-2a0c-42b5-89d5-a1cf3a1e44df admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:11.362944 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1439/2882] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:27:11 2022] PUT /identity/v3/projects/493d59fefb1e479a83854947d84e20eb/users/88f0b827101548fc87db6ff7cf4953b6/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 08:27:11.366934 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fc757-129e-4ae4-a7f7-40bd54fb6474 admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:11.377713 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fc757-129e-4ae4-a7f7-40bd54fb6474 admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:11.440352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c223c48-49e5-4c91-b568-e9fdb279212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:11.441026 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c223c48-49e5-4c91-b568-e9fdb279212a admin admin] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:11.441315 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c223c48-49e5-4c91-b568-e9fdb279212a admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:11.441591 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c223c48-49e5-4c91-b568-e9fdb279212a admin admin] PATH_INFO: `/v3/roles` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:11.442317 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c223c48-49e5-4c91-b568-e9fdb279212a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:11.444541 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c223c48-49e5-4c91-b568-e9fdb279212a admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:11.455651 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1444/2883] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 08:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 08:27:11.461437 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478839d5-2a0c-42b5-89d5-a1cf3a1e44df admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:11.472171 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478839d5-2a0c-42b5-89d5-a1cf3a1e44df admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:11.477430 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af0f3d-50c5-4673-bc22-42cba6a8ae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:11.484361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af0f3d-50c5-4673-bc22-42cba6a8ae6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:11.484361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af0f3d-50c5-4673-bc22-42cba6a8ae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:11.484361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af0f3d-50c5-4673-bc22-42cba6a8ae6c admin admin] PATH_INFO: `/v3/projects/493d59fefb1e479a83854947d84e20eb/users/88f0b827101548fc87db6ff7cf4953b6/roles/6fcc322b483a475399974562c1e5bd43` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:11.484361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af0f3d-50c5-4673-bc22-42cba6a8ae6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=493d59fefb1e479a83854947d84e20eb, user_id=88f0b827101548fc87db6ff7cf4953b6, role_id=6fcc322b483a475399974562c1e5bd43)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:11.484361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af0f3d-50c5-4673-bc22-42cba6a8ae6c admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:11.495317 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1440/2884] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 08:27:11 2022] PUT /identity/v3/projects/493d59fefb1e479a83854947d84e20eb/users/88f0b827101548fc87db6ff7cf4953b6/roles/6fcc322b483a475399974562c1e5bd43 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:27:16.197018 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e84d31-028e-440a-945e-95fa87df2505 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:16.197497 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e84d31-028e-440a-945e-95fa87df2505 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:16.197770 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e84d31-028e-440a-945e-95fa87df2505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:16.237379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-07e84d31-028e-440a-945e-95fa87df2505 None None] MFA Rules not processed for user `88f0b827101548fc87db6ff7cf4953b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:27:16.238654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-07e84d31-028e-440a-945e-95fa87df2505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:16.424927 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1445/2885] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:27:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:27:16.447820 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af0f3d-50c5-4673-bc22-42cba6a8ae6c admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:16.450550 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-64af0f3d-50c5-4673-bc22-42cba6a8ae6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:16.603804 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af0f3d-50c5-4673-bc22-42cba6a8ae6c admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:16.609711 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4364c7-680b-42ce-93c9-0267b5019b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:16.610488 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4364c7-680b-42ce-93c9-0267b5019b26 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:16.610888 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4364c7-680b-42ce-93c9-0267b5019b26 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:16.611245 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4364c7-680b-42ce-93c9-0267b5019b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:16.617925 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:16.712587 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4364c7-680b-42ce-93c9-0267b5019b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:16.714239 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4364c7-680b-42ce-93c9-0267b5019b26 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:16.730439 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1441/2886] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:27:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:27:26.420338 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:26.721656 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=24 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:31.305092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40455349-1834-4882-a65f-c2b1f2244ac5 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:31.305642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40455349-1834-4882-a65f-c2b1f2244ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:31.305774 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40455349-1834-4882-a65f-c2b1f2244ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:31.325299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-40455349-1834-4882-a65f-c2b1f2244ac5 None None] MFA Rules not processed for user `7c428bd4817a40de8a378aa0935ae764`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:27:31.326538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-40455349-1834-4882-a65f-c2b1f2244ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:31.333746 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1446/2887] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:27:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:27:31.691963 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4364c7-680b-42ce-93c9-0267b5019b26 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:31.696161 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-8d4364c7-680b-42ce-93c9-0267b5019b26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:31.758965 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4364c7-680b-42ce-93c9-0267b5019b26 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:31.762746 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b26a1-3446-4f91-9150-e3a0662e0424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:31.763445 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b26a1-3446-4f91-9150-e3a0662e0424 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:31.763727 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b26a1-3446-4f91-9150-e3a0662e0424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:31.764145 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b26a1-3446-4f91-9150-e3a0662e0424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:31.765977 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-0a0b26a1-3446-4f91-9150-e3a0662e0424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:31.777416 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b26a1-3446-4f91-9150-e3a0662e0424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:31.778941 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b26a1-3446-4f91-9150-e3a0662e0424 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:31.787983 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1442/2888] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:27:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:27:32.287794 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40455349-1834-4882-a65f-c2b1f2244ac5 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:32.289346 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-40455349-1834-4882-a65f-c2b1f2244ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:32.377665 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40455349-1834-4882-a65f-c2b1f2244ac5 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:32.384695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b912a-fea4-4a2b-ab82-5e444c1c2369 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:32.385360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b912a-fea4-4a2b-ab82-5e444c1c2369 service placement] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:32.385643 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b912a-fea4-4a2b-ab82-5e444c1c2369 service placement] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:32.385917 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b912a-fea4-4a2b-ab82-5e444c1c2369 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:32.387745 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-520b912a-fea4-4a2b-ab82-5e444c1c2369 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:32.401307 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b912a-fea4-4a2b-ab82-5e444c1c2369 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:32.402955 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b912a-fea4-4a2b-ab82-5e444c1c2369 service placement] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:32.414762 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1447/2889] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:27:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:27:34.164558 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b26a1-3446-4f91-9150-e3a0662e0424 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:34.174975 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b26a1-3446-4f91-9150-e3a0662e0424 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:34.185869 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a74236-b2e1-49f3-9ebc-ae1b82bdf627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:34.186586 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a74236-b2e1-49f3-9ebc-ae1b82bdf627 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:34.186950 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a74236-b2e1-49f3-9ebc-ae1b82bdf627 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:34.187193 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a74236-b2e1-49f3-9ebc-ae1b82bdf627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:34.189138 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-e4a74236-b2e1-49f3-9ebc-ae1b82bdf627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:34.200459 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a74236-b2e1-49f3-9ebc-ae1b82bdf627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:34.201968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a74236-b2e1-49f3-9ebc-ae1b82bdf627 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:34.212261 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1443/2890] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:27:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:27:42.409360 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=35 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:44.207013 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=32 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:45.289464 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b912a-fea4-4a2b-ab82-5e444c1c2369 service placement] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:45.304121 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b912a-fea4-4a2b-ab82-5e444c1c2369 service placement] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:45.309745 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d9777-7921-4ec6-b2bf-29534904fe54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:45.310386 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d9777-7921-4ec6-b2bf-29534904fe54 service nova] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:45.310702 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d9777-7921-4ec6-b2bf-29534904fe54 service nova] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:45.310988 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d9777-7921-4ec6-b2bf-29534904fe54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:45.312767 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-db9d9777-7921-4ec6-b2bf-29534904fe54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:27:45.326487 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d9777-7921-4ec6-b2bf-29534904fe54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:45.331550 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d9777-7921-4ec6-b2bf-29534904fe54 service nova] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:45.341113 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1448/2891] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:27:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:27:48.074051 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a74236-b2e1-49f3-9ebc-ae1b82bdf627 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:27:48.083612 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a74236-b2e1-49f3-9ebc-ae1b82bdf627 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:27:48.087576 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aac877-40d3-4f24-bb0f-cccf41b013f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:27:48.088219 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aac877-40d3-4f24-bb0f-cccf41b013f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:27:48.088506 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aac877-40d3-4f24-bb0f-cccf41b013f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:27:48.088786 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aac877-40d3-4f24-bb0f-cccf41b013f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:27:48.098470 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aac877-40d3-4f24-bb0f-cccf41b013f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:27:48.100037 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aac877-40d3-4f24-bb0f-cccf41b013f4 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:27:48.111220 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1444/2892] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:27:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:27:55.337209 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=6 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:27:58.106671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=6 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:29:33.201469 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d9777-7921-4ec6-b2bf-29534904fe54 service nova] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:29:33.202991 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-db9d9777-7921-4ec6-b2bf-29534904fe54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:29:33.291759 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d9777-7921-4ec6-b2bf-29534904fe54 service nova] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:29:33.296987 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a8fd-3796-46e0-a527-64148d7a00ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:29:33.297640 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a8fd-3796-46e0-a527-64148d7a00ae service placement] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:29:33.297925 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a8fd-3796-46e0-a527-64148d7a00ae service placement] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:29:33.298205 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a8fd-3796-46e0-a527-64148d7a00ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:29:33.300044 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-5665a8fd-3796-46e0-a527-64148d7a00ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:29:33.312135 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665a8fd-3796-46e0-a527-64148d7a00ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:29:33.313764 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665a8fd-3796-46e0-a527-64148d7a00ae service placement] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:29:33.324415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1449/2893] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:29:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:29:43.319809 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=37 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:29:47.656958 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c41395-fd5e-48ee-96e9-32e0fc2ef748 None None] REQUEST_METHOD: `POST` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:29:47.657510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c41395-fd5e-48ee-96e9-32e0fc2ef748 None None] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:29:47.657510 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c41395-fd5e-48ee-96e9-32e0fc2ef748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:29:47.676159 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.auth.core [None req-92c41395-fd5e-48ee-96e9-32e0fc2ef748 None None] MFA Rules not processed for user `7c428bd4817a40de8a378aa0935ae764`. Rule list: `[]` (Enabled: `True`). {{(pid=80270) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:29:47.677361 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-92c41395-fd5e-48ee-96e9-32e0fc2ef748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:29:47.684289 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1445/2894] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:29:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:29:48.020642 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a8fd-3796-46e0-a527-64148d7a00ae service placement] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:29:48.040261 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a8fd-3796-46e0-a527-64148d7a00ae service placement] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:29:48.044573 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8ddce-2ee3-40ff-843e-096c6c3e7917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:29:48.045352 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8ddce-2ee3-40ff-843e-096c6c3e7917 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:29:48.045633 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8ddce-2ee3-40ff-843e-096c6c3e7917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:29:48.045911 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8ddce-2ee3-40ff-843e-096c6c3e7917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:29:48.047779 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-91c8ddce-2ee3-40ff-843e-096c6c3e7917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:29:48.071574 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8ddce-2ee3-40ff-843e-096c6c3e7917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:29:48.073039 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8ddce-2ee3-40ff-843e-096c6c3e7917 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:29:48.082197 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1450/2895] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:29:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:29:57.670560 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=3 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:29:58.077653 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=15 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:30:10.397467 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c41395-fd5e-48ee-96e9-32e0fc2ef748 None None] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:30:10.412795 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c41395-fd5e-48ee-96e9-32e0fc2ef748 None None] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:30:10.418491 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2056a6-a54a-4c47-a33a-c6e34e2a729b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:30:10.419212 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2056a6-a54a-4c47-a33a-c6e34e2a729b service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:30:10.419528 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2056a6-a54a-4c47-a33a-c6e34e2a729b service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:30:10.419815 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2056a6-a54a-4c47-a33a-c6e34e2a729b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:30:10.421686 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5a2056a6-a54a-4c47-a33a-c6e34e2a729b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:30:10.437165 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2056a6-a54a-4c47-a33a-c6e34e2a729b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:30:10.439517 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2056a6-a54a-4c47-a33a-c6e34e2a729b service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:30:10.451846 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1446/2896] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:30:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:30:20.446866 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=6 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:31:38.764208 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac447cf8-dd9c-4cc6-865d-15d34b3afbf4 None None] REQUEST_METHOD: `POST` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:31:38.764787 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac447cf8-dd9c-4cc6-865d-15d34b3afbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:31:38.765256 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac447cf8-dd9c-4cc6-865d-15d34b3afbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:31:38.788448 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.auth.core [None req-ac447cf8-dd9c-4cc6-865d-15d34b3afbf4 None None] MFA Rules not processed for user `7c428bd4817a40de8a378aa0935ae764`. Rule list: `[]` (Enabled: `True`). {{(pid=80269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 08:31:38.789666 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-ac447cf8-dd9c-4cc6-865d-15d34b3afbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:31:38.797299 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1451/2897] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 08:31:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 08:31:38.835671 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2056a6-a54a-4c47-a33a-c6e34e2a729b service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:31:38.837162 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5a2056a6-a54a-4c47-a33a-c6e34e2a729b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:31:38.928525 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2056a6-a54a-4c47-a33a-c6e34e2a729b service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:31:38.932134 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa6664-28bb-4020-b789-85de635a64b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e7b70349d9427e899ee290dda2d3c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:31:38.932776 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa6664-28bb-4020-b789-85de635a64b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:31:38.933065 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa6664-28bb-4020-b789-85de635a64b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:31:38.933338 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa6664-28bb-4020-b789-85de635a64b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:31:38.935152 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-94fa6664-28bb-4020-b789-85de635a64b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:31:38.970540 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa6664-28bb-4020-b789-85de635a64b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:31:38.972016 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa6664-28bb-4020-b789-85de635a64b8 service cinder] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:31:38.993823 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1447/2898] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:31:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:31:39.759492 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac447cf8-dd9c-4cc6-865d-15d34b3afbf4 None None] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:31:39.771405 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac447cf8-dd9c-4cc6-865d-15d34b3afbf4 None None] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:31:39.775119 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fd843-a4f8-46b4-ab14-cbb2188975b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:31:39.775773 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fd843-a4f8-46b4-ab14-cbb2188975b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:31:39.776058 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fd843-a4f8-46b4-ab14-cbb2188975b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:31:39.776335 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fd843-a4f8-46b4-ab14-cbb2188975b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:31:39.778118 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-cc3fd843-a4f8-46b4-ab14-cbb2188975b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:31:39.793108 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fd843-a4f8-46b4-ab14-cbb2188975b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:31:39.794558 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fd843-a4f8-46b4-ab14-cbb2188975b3 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:31:39.807964 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1452/2899] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:31:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:31:42.197375 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa6664-28bb-4020-b789-85de635a64b8 service cinder] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:31:42.200032 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-94fa6664-28bb-4020-b789-85de635a64b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:31:42.221687 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa6664-28bb-4020-b789-85de635a64b8 service cinder] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:31:42.229181 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6117b-747a-4459-b67b-25d01b4554f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0956402a9bb4a9384111b36d5251749', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:31:42.230059 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6117b-747a-4459-b67b-25d01b4554f5 service nova] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:31:42.230428 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6117b-747a-4459-b67b-25d01b4554f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:31:42.230927 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6117b-747a-4459-b67b-25d01b4554f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:31:42.233205 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-a5a6117b-747a-4459-b67b-25d01b4554f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:31:42.261774 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6117b-747a-4459-b67b-25d01b4554f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:31:42.263780 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6117b-747a-4459-b67b-25d01b4554f5 service nova] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:31:42.279235 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1448/2900] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:31:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 08:31:49.802176 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=9 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:31:52.273520 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=53 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:32:34.981213 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fd843-a4f8-46b4-ab14-cbb2188975b3 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:32:34.990415 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fd843-a4f8-46b4-ab14-cbb2188975b3 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:32:34.994156 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f650d-6274-468f-b584-92c1dc50d391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:32:34.994807 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f650d-6274-468f-b584-92c1dc50d391 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:32:34.995092 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f650d-6274-468f-b584-92c1dc50d391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:32:34.995362 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f650d-6274-468f-b584-92c1dc50d391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:32:35.003486 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f650d-6274-468f-b584-92c1dc50d391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:32:35.004899 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f650d-6274-468f-b584-92c1dc50d391 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:32:35.013132 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1453/2901] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:32:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:32:45.009270 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=6 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:33:34.435062 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6117b-747a-4459-b67b-25d01b4554f5 service nova] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:33:34.444790 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6117b-747a-4459-b67b-25d01b4554f5 service nova] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:33:34.448451 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7e6d6-f5db-4375-ad7b-e925bda197c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:33:34.449228 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7e6d6-f5db-4375-ad7b-e925bda197c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:33:34.449585 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7e6d6-f5db-4375-ad7b-e925bda197c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:33:34.449935 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7e6d6-f5db-4375-ad7b-e925bda197c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:33:34.459748 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7e6d6-f5db-4375-ad7b-e925bda197c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:33:34.461207 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7e6d6-f5db-4375-ad7b-e925bda197c2 service neutron] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:33:34.470385 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1449/2902] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:33:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:33:44.466365 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=6 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:33:47.897600 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f650d-6274-468f-b584-92c1dc50d391 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:33:47.906495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f650d-6274-468f-b584-92c1dc50d391 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:33:47.910400 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3daf2-5cb7-4b41-896e-f1d7e7310972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdac6ddece434ed7abddcffe841476ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:33:47.911066 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3daf2-5cb7-4b41-896e-f1d7e7310972 service neutron] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:33:47.911353 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3daf2-5cb7-4b41-896e-f1d7e7310972 service neutron] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:33:47.911622 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3daf2-5cb7-4b41-896e-f1d7e7310972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:33:47.983379 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3daf2-5cb7-4b41-896e-f1d7e7310972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:33:47.984952 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3daf2-5cb7-4b41-896e-f1d7e7310972 service neutron] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:33:48.005483 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1454/2903] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:33:51.094897 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7e6d6-f5db-4375-ad7b-e925bda197c2 service neutron] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:33:51.109633 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7e6d6-f5db-4375-ad7b-e925bda197c2 service neutron] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:33:51.114859 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b376c-8f3b-4d51-8144-d61edebde6b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:33:51.115507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b376c-8f3b-4d51-8144-d61edebde6b2 service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:33:51.116153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b376c-8f3b-4d51-8144-d61edebde6b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:33:51.116463 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b376c-8f3b-4d51-8144-d61edebde6b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:33:51.118444 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-438b376c-8f3b-4d51-8144-d61edebde6b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:33:51.131153 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b376c-8f3b-4d51-8144-d61edebde6b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:33:51.132996 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b376c-8f3b-4d51-8144-d61edebde6b2 service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:33:51.156303 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1450/2904] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:33:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:33:54.108738 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3daf2-5cb7-4b41-896e-f1d7e7310972 service neutron] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:33:54.126788 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3daf2-5cb7-4b41-896e-f1d7e7310972 service neutron] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:33:54.135521 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8dc756-d22f-4b16-bbd4-126ae479d2ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:33:54.136188 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8dc756-d22f-4b16-bbd4-126ae479d2ae service placement] REQUEST_METHOD: `GET` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:33:54.136474 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8dc756-d22f-4b16-bbd4-126ae479d2ae service placement] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:33:54.136784 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8dc756-d22f-4b16-bbd4-126ae479d2ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:33:54.138763 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-9f8dc756-d22f-4b16-bbd4-126ae479d2ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:33:54.152572 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8dc756-d22f-4b16-bbd4-126ae479d2ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:33:54.154192 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8dc756-d22f-4b16-bbd4-126ae479d2ae service placement] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:33:54.166538 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1455/2905] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:33:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:33:54.184114 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b376c-8f3b-4d51-8144-d61edebde6b2 service placement] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:33:54.198376 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b376c-8f3b-4d51-8144-d61edebde6b2 service placement] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:33:54.203942 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:33:54.204889 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:33:54.205240 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:33:54.205580 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] PATH_INFO: `/v3/users/7c428bd4817a40de8a378aa0935ae764` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:33:54.206989 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c428bd4817a40de8a378aa0935ae764)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:33:54.209050 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:33:54.259819 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c428bd4817a40de8a378aa0935ae764'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.266976 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c428bd4817a40de8a378aa0935ae764'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.275011 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c428bd4817a40de8a378aa0935ae764'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.275628 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c428bd4817a40de8a378aa0935ae764'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.276229 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c428bd4817a40de8a378aa0935ae764'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.293507 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1451/2906] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:33:54 2022] DELETE /identity/v3/users/7c428bd4817a40de8a378aa0935ae764 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:33:54.479822 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8dc756-d22f-4b16-bbd4-126ae479d2ae service placement] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:33:54.503776 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8dc756-d22f-4b16-bbd4-126ae479d2ae service placement] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:33:54.564048 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:33:54.565199 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:33:54.565344 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:33:54.565618 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] PATH_INFO: `/v3/projects/b65afb27ab304161aaa6aabe73c1c58e` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:33:54.566933 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65afb27ab304161aaa6aabe73c1c58e)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:33:54.569678 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:33:54.622695 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65afb27ab304161aaa6aabe73c1c58e', 'request_id': 'req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.630133 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65afb27ab304161aaa6aabe73c1c58e', 'request_id': 'req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.637587 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65afb27ab304161aaa6aabe73c1c58e', 'request_id': 'req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.641602 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:33:54.662654 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] The token cache is being invalidate because project b65afb27ab304161aaa6aabe73c1c58e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:33:54.662947 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.663589 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.665123 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1456/2907] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:33:54 2022] DELETE /identity/v3/projects/b65afb27ab304161aaa6aabe73c1c58e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:33:54.669105 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:33:54.670595 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:33:54.684352 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04a36f-69c3-4346-9274-5861641bdff4 admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:33:54.741300 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:33:54.742130 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:33:54.742413 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:33:54.742720 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] PATH_INFO: `/v3/users/88f0b827101548fc87db6ff7cf4953b6` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:33:54.743904 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f0b827101548fc87db6ff7cf4953b6)` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:33:54.745847 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:33:54.792672 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f0b827101548fc87db6ff7cf4953b6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.799650 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f0b827101548fc87db6ff7cf4953b6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.803714 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:33:54.808292 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f0b827101548fc87db6ff7cf4953b6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.809346 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f0b827101548fc87db6ff7cf4953b6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.809968 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.notifications [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f0b827101548fc87db6ff7cf4953b6'} {{(pid=80270) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:54.829071 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1452/2908] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 08:33:54 2022] DELETE /identity/v3/users/88f0b827101548fc87db6ff7cf4953b6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:33:55.006789 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] Authenticating user token {{(pid=80269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:33:55.008390 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.fernet_utils [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:33:55.020799 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f6f8d-532b-4185-a4fd-f66e9a3b1f4b admin admin] Validating token access rules against request {{(pid=80269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:33:55.080874 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbda804-6551-4f7e-a799-05ae81f38f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f407cfabb074543a5e85c709d5e3a86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e195a21c654d5fa117864a568a0c62', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:33:55.081733 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbda804-6551-4f7e-a799-05ae81f38f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:33:55.082016 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbda804-6551-4f7e-a799-05ae81f38f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:33:55.082293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbda804-6551-4f7e-a799-05ae81f38f84 admin admin] PATH_INFO: `/v3/projects/493d59fefb1e479a83854947d84e20eb` {{(pid=80269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:33:55.083517 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbda804-6551-4f7e-a799-05ae81f38f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=493d59fefb1e479a83854947d84e20eb)` {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:33:55.085477 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbda804-6551-4f7e-a799-05ae81f38f84 admin admin] RBAC: Authorization granted {{(pid=80269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:33:55.134293 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-3fbda804-6551-4f7e-a799-05ae81f38f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493d59fefb1e479a83854947d84e20eb', 'request_id': 'req-3fbda804-6551-4f7e-a799-05ae81f38f84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:55.141829 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-3fbda804-6551-4f7e-a799-05ae81f38f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493d59fefb1e479a83854947d84e20eb', 'request_id': 'req-3fbda804-6551-4f7e-a799-05ae81f38f84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:55.148881 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-3fbda804-6551-4f7e-a799-05ae81f38f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493d59fefb1e479a83854947d84e20eb', 'request_id': 'req-3fbda804-6551-4f7e-a799-05ae81f38f84'} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:55.159516 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-3fbda804-6551-4f7e-a799-05ae81f38f84 admin admin] The token cache is being invalidate because project 493d59fefb1e479a83854947d84e20eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 08:33:55.159797 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-3fbda804-6551-4f7e-a799-05ae81f38f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:55.160434 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG keystone.notifications [None req-3fbda804-6551-4f7e-a799-05ae81f38f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 08:33:55.162061 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: [pid: 80269|app: 0|req: 1457/2909] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 08:33:55 2022] DELETE /identity/v3/projects/493d59fefb1e479a83854947d84e20eb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 08:34:04.825655 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=8,keystone:DELETE=2 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:34:05.156495 dv-cinder-836973-7-iscsi devstack@keystone.service[80269]: DEBUG dbcounter [-] [80269] Writing DB stats keystone:DELETE=8,keystone:SELECT=58,keystone:INSERT=1 {{(pid=80269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 08:34:43.184060 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] Authenticating user token {{(pid=80270) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 08:34:43.185527 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:34:43.256954 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981d2b6-86f0-46e8-810e-5fc8afdeccbe admin admin] Validating token access rules against request {{(pid=80270) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 08:34:43.317833 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400efe5-be78-41f6-a0ef-c6e4f4503f73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53dfc3572d05469ca7e2de1acea3629a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c279ceb26daa45ba821e6ffb1db4f4f0', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80270) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 08:34:43.318491 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400efe5-be78-41f6-a0ef-c6e4f4503f73 service placement] REQUEST_METHOD: `GET` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 08:34:43.318825 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400efe5-be78-41f6-a0ef-c6e4f4503f73 service placement] SCRIPT_NAME: `/identity` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 08:34:43.319109 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400efe5-be78-41f6-a0ef-c6e4f4503f73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80270) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 08:34:43.320931 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.fernet_utils [None req-5400efe5-be78-41f6-a0ef-c6e4f4503f73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80270) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 08:34:43.333496 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400efe5-be78-41f6-a0ef-c6e4f4503f73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 08:34:43.335145 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400efe5-be78-41f6-a0ef-c6e4f4503f73 service placement] RBAC: Authorization granted {{(pid=80270) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 08:34:43.345592 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: [pid: 80270|app: 0|req: 1453/2910] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 08:34:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 08:34:53.341096 dv-cinder-836973-7-iscsi devstack@keystone.service[80270]: DEBUG dbcounter [-] [80270] Writing DB stats keystone:SELECT=58 {{(pid=80270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}